omar-gamal99/talabat_bootcamp
May 2025 – May 2025
1 Month active
Languages Used
Python
Technical Skills
AirflowBigQueryCloud Storage ConfigurationData EngineeringETLGoogle Cloud Storage
AhmedMarzouk01
PROFILE
Ahmedmarzouk01
Developed and delivered an end-to-end ETL pipeline for the omar-gamal99/talabat_bootcamp repository, enabling automated data movement from PostgreSQL to Google Cloud Storage and BigQuery using Airflow. The work involved implementing a new Airflow DAG to orchestrate the extraction, transfer, and loading of data, with Python as the primary language. Addressed reliability and maintainability by fixing syntax issues in extraction scripts, correcting BigQuery table naming, and standardizing naming conventions for DAGs and storage buckets. These improvements reduced manual intervention and improved data consistency, demonstrating practical data engineering skills across Airflow, Python, PostgreSQL, and Google Cloud Storage environments.
Overall Statistics
Feature vs Bugs
50%Features
Repository Contributions
7Total
Bugs
1
Commits
7
Features
1
Lines of code
144
Activity Months1
Your Network
22 peopleWork History
May 2025
7 Commits • 1 Features
May 1, 2025In May 2025, delivered an end-to-end Airflow-based ETL pipeline for omar-gamal99/talabat_bootcamp, enabling reliable data flow from PostgreSQL to Google Cloud Storage and BigQuery. Implemented a new Airflow DAG to run a Python function and orchestrate the complete ETL process, including data transfer to GCS and loading into BigQuery. Accompanied by targeted fixes to the data transfer DAG and storage naming/configuration to improve reliability and maintainability (syntax fixes in extraction, corrected BigQuery table naming, clarified DAG naming, and standardized GCS bucket/file naming). These changes reduce manual intervention, improve data consistency, and accelerate analytics readiness.
7 Commits • 1 Features
May 1, 2025In May 2025, delivered an end-to-end Airflow-based ETL pipeline for omar-gamal99/talabat_bootcamp, enabling reliable data flow from PostgreSQL to Google Cloud Storage and BigQuery. Implemented a new Airflow DAG to run a Python function and orchestrate the complete ETL process, including data transfer to GCS and loading into BigQuery. Accompanied by targeted fixes to the data transfer DAG and storage naming/configuration to improve reliability and maintainability (syntax fixes in extraction, corrected BigQuery table naming, clarified DAG naming, and standardized GCS bucket/file naming). These changes reduce manual intervention, improve data consistency, and accelerate analytics readiness.
May 2025
Activity
Loading activity data...
Quality Metrics
Correctness94.2%
Maintainability94.2%
Architecture91.4%
Performance91.4%
AI Usage20.0%
Skills & Technologies
Programming Languages
Python
Technical Skills
AirflowBigQueryCloud Storage ConfigurationData EngineeringETLGoogle Cloud StoragePostgreSQLPython
Repositories Contributed To
Overview of all repositories you've contributed to across your timeline