Key Responsibilities:

Responsibilities

- Build, maintain and optimize data pipelines for our Enterprise Data Platform using Google Cloud Platform technologies.

- Ingest recent data sources from initial discovery & data architecture, through ETL authoring, operationalizing using Dataflow, Airflow (Cloud Composer) DAGs, and post launch lifecycle.

- Research and test new big-data technologies and tools.

- Advanced SQL queries, and modeling.

- Engage vendors with required features to meet business needs.

- Leverage the full value of our vendor integrations and APIs.

- Optimize BigQuery and ETL resources to decrease spend & increase performance.

Minimum Qualifications

- Bachelor’s degree in data science, computer science or similar majors with a GPA of at least 3.0 or equivalent experience

- 7+ years of experience in Data Engineering





- 7+ years of experience in at least one OOP language, preferably Python

- Deep SQL knowledge / experience

- Experience in complex pipeline task management (i.e., Airflow and Beam)

- Experience building Data Models

- Experience with Github

Desired Qualifications

- Google Cloud Platform tools or equivalent platform experience using tools s/a BigQuery, Dataflow / Apache Beam, Cloud Composer / Airflow, Pub/Sub, Apache Spark

- Experience using DBT

- Experience with Scalr/Terraform

- Experience with CI/CD

- Experience with marketing technologies like a CDP (Customer Data Platform) and SFMC (Saleforce Marketing Cloud)

📌 Process Manager (Pune)
🏢 eClerx
📍 Pune