The project aims to provide a solution to an industrial problematic by providing data streaming infrastructure to monitor real-time data.
With the environmental urge regarding climate change, eCO2mix-Streaming retrieves France live energy production and consumption data, stores it within a database and produces relevant insights.
Among the created visualizations :
- Energy consumption against forecasts
- Energy production type distribution
- CO2 emissions
Prior to installing the project, you need to download and setup Git and Docker, referring to the following documentation:
- https://git-scm.com/book/en/v2/Getting-Started-Installing-Git
- https://docs.docker.com/engine/install/
- Clone the repository
- Run Docker compose
docker compose up- Go to http://0.0.0.0:5601/app/dashboards and select the available dashboard.
Distributed under the Creative Commons Zero v1.0 Universal License. See LICENSE for more information.
Ganiyu, Y. (2023, December 4). Realtime streaming with Apache Flink: End to end data engineering project. YouTube. https://youtu.be/deepQRXnniM?si=nOpgyGbQEY_-fU0D
RTE. (n.d.). Données éco2mix Nationales Temps réel. Open Data Réseaux Énergies ( ODRÉ). https://odre.opendatasoft.com/explore/dataset/eco2mix-national-tr/information/?disjunctive.nature