16 Oct
|
Recruito
|
Gurugram
Responsibilities
- Design scalable data platforms and pipelines on GCP.
- Build batch, incremental, and streaming data pipelines.
- Develop and optimize transformations using BigQuery, SQL, and Dataform/dbt.
- Build reusable, metadata-driven data-processing frameworks.
- Develop distributed processing solutions using Dataflow, Beam, and Spark.
- Define data models, schemas, and data quality standards.
- Optimize performance, reliability, and cloud costs.
- Lead code reviews and guide engineers on technical decisions.
- Own solutions from design through deployment and production support.
Requirements
- Experience building enterprise-scale data platforms.
- Robust hands-on experience with GCP and BigQuery.
- Advanced SQL and Python skills.
- Experience with Dataform/dbt and Cloud Composer/Apache Airflow.
- Hands-on experience with Dataflow/Apache Beam and Dataproc/Spark.
- Strong understanding of batch, incremental, and streaming processing.
- Experience building reusable, metadata-driven frameworks.
- Expertise in data modeling, data contracts, and schema management.
- Knowledge of data quality, lineage, monitoring, and observability.
- Experience with Git, automated testing, and CI/CD.
- Strong architectural decision-making and problem-solving skills.
📌 Senior Data Engineer (Gurugram)
🏢 Recruito
📍 Gurugram