13 Aug
|
Factspan Analytics
|
India
13 Aug
Factspan Analytics
India
Job Title: Data Engineer Offshore (GCP / Airflow / SQL / Python)
Experience: 6 to 9years
Employment Type: Full Time
Must have :
Tech : GCP, SQL, Python, Airflow
Domain : MarTech, Retail
Key Responsibilities
- Design and develop data ingestion, transformation, and orchestration pipelines using GCP (BigQuery, Dataflow, Cloud Composer) and Airflow.
- Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability.
- Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation.
- Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data.
- Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules.
- Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
- Collaborate with QA team for end-to-end test validation and ensure production readiness.
- Participate in daily Agile ceremonies, sprint reviews, and deployment planning.
Required Technical Skills
- Solid hands-on experience in GCP services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
- Proficiency in SQL for data profiling, transformation, and performance optimization.
- Proficiency in Python for pipeline automation, scripting, and orchestration.
- Experience building batch and streaming data pipelines.
- Exposure to working with marketing or customer engagement platforms is a plus.
- Understanding of data quality, logging, monitoring, and alerting best practices.
Preferred Skills
- Experience in Airflow DAG development for complex data pipelines.
- Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs.
- Knowledge of data modeling for campaign orchestration and audience segmentation.
- Experience with CI/CD and DevOps principles for data deployments.
- Strong troubleshooting and performance tuning skills.
Soft Skill
📌 Gcp Data Engineer (India)
🏢 Factspan Analytics
📍 India