12 Aug
|
Factspan
|
Kolkata
Job Description
Job Title: Data Engineer Offshore (GCP / Airflow / SQL / Python)
Experience: 6 to 9 years
Employment Type: Full Time
Must Have
Tech: GCP, SQL, Python, Airflow
Domain: MarTech, Retail
Key Responsibilities
Design and develop data ingestion, transformation, and orchestration pipelines using GCP (BigQuery, Dataflow, Cloud Composer) and Airflow.
Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability.
Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation.
Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data.
Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules.
Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
Collaborate with QA team for end-to-end test validation and ensure production readiness.
Participate in daily Agile ceremonies, sprint reviews, and deployment planning.
Required Technical Skills
Strong hands-on experience in GCP services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
Proficiency in SQL for data profiling, transformation, and performance optimization.
Proficiency in Python for pipeline automation, scripting, and orchestration.
Experience building batch and streaming data pipelines.
Exposure to working with marketing or customer engagement platforms is a plus.
Understanding of data quality, logging, monitoring, and alerting best practices.
Preferred Skills
Experience in Airflow DAG development for complex data pipelines.
Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs.
Knowledge of data modeling for campaign orchestration and audience segmentation.
Experience with CI/CD and DevOps principles for data deployments.
Robust troubleshooting and performance tuning skills.
Soft Skills & Attributes
Stron
📌 Factspan - Data Engineer - Google Cloud Platform (Kolkata)
🏢 Factspan
📍 Kolkata