Project Overview: Create an ETL (Extract, Transform, Load) pipeline that extracts data from a source, transforms it according to certain rules, and loads it into a target database.
Objectives: Gain familiarity with ETL processes and workflows. Develop skills in data transformation and normalization. Learn to automate data pipeline processes.
Skills: Data modeling, batch processing, automation.
Tools & Technologies: Python, SQL, Apache Airflow.