DataEngineering
| Projects | Descriptions | Topics | |
|---|---|---|---|
| - | Airflow | Azure_web_app #dag | |
| - | Azure SQL Database | Azure_sql_db | |
| - | BigQuery | GCP | |
| - | Bigtable Database | GCP, nosql, backup, cbt | |
| - | Automotive | Cosmosdb, cassandra, cql | |
| - | Data Factory | Blob, datafactory, bicep | |
| - | Dataflow & Apache Beam | IAM | |
| - | Dataproc Cluster | Apache Hadoop, MapReduce, Spark, YARN, HDFS | |
| - | Data Build Tool | DBT, duckdb | |
| - | Deltalake | Spark, Synapse | |
| - | Fabric | Microsoft_fabric | |
| - | Streaming Entertainment Scalable & Fast Database | DynamoDB, NoSQL | |
| - | Finance & Operations (Fleet Management) | Dynamic 365, Office Integration, Functional Consultant | |
| - | Aviation / Aerospace | Scrapy, mongodb, fastapi | |
| - | Apache Kafka | Zookeeper, gcp | |
| - | Healthcare / Medical | Matplotlib, numpy, cv2, postgres, grafana | |
| - | Aurora and RDS | Multi-AZ, Read Replica Database, MariaDB | |
| - | Python Library | Data Analysis, Dataframe, pandas, sqlite3 | |
| - | Amazon RDS to Google Cloud SQL Database Migration | MySQL | |
| - | VR Game | Snowflake, Data Engineering, ELT | |
| - | Stock Market / Finance | Snowflake, yfinance | |
| - | Public Transportation | Synapse-analytics, power_bi |