We are looking for an experienced Data Engineer / ETL Developer with solid hands-on experience in Python, GCP, BigQuery, ETL pipelines, Data Quality, and Azure to support an enterprise data platform project.Key ResponsibilitiesDevelop, maintain, and troubleshoot ETL/data processing pipelinesWork with Python, BigQuery, GCS, Dataproc and PySparkImplement data ingestion, transformation, deduplication and enrichmentWork with Data Quality (DQ/DQA) checks and validation frameworksHandle SCD Type 2 / historical data versioningWork with configuration-driven ETL frameworks and metadata-driven processingSupport Azure ↔ GCP hybrid data pipelinesWork with Azure Storage, Databricks and data ingestion processesTroubleshoot pipeline, processing,
networking and data-quality issuesWork with Airflow DAGs for scheduling and batch processingMaintain processing status, audit logs and pipeline monitoringSupport migration from artifact-specific ETL scripts toward standardized/configuration-driven pipelinesRequired Technical SkillsMust Have:PythonBigQueryGCPGCSETL / Data EngineeringData Quality / Data ValidationSQLAirflowGood to Have:Dataproc / PySparkAzureAzure DatabricksFastAPISpring BootDocker / KubernetesPub/SubService BusSCD Type 2Configuration-driven / metadata-driven ETL
📌 Freelance Opportunity – AccuForge Data Engineering / ETL (St.Thomas Mount)
🏢 IndiTech Consulting
📍 St.Thomas Mount
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.