We are seeking a skilled and proactive Data Engineer to design, build, and maintain robust, scalable, and optimized data pipelines and architectures. In this role, you will collaborate closely with Data Scientists, Business Intelligence Analysts, and Software Engineers to transform raw enterprise data into clean, accessible, and high-performance data models.

The ideal candidate has hands-on experience with modern cloud data platforms, distributed computing, streaming and batch ETL/ELT pipelines, data modeling, and robust data governance practices.

2. Key Responsibilities

Pipeline Development & Architecture

- Design & Build ETL/ELT Pipelines: Develop scalable batch and real-time streaming data ingestion and transformation pipelines from diverse sources (APIs, transactional DBs, Kafka, logs, flat files).
- Data Modeling & Storage: Architect and optimize dimensional data models (Star/Snowflake schemas, One Big Table), data lakes, data lakehouses, and relational/NoSQL data stores.
- Workflow Orchestration: Implement and maintain pipeline scheduling, dependency management, and monitoring using modern orchestrators (, Apache Airflow, Prefect, Dagster).

Performance, Reliability & Scalability

- Query & Storage Optimization: Fine-tune SQL queries, indexing, partitioning, caching, and distributed compute workloads (, Spark, Trino, DuckDB).
- Data Quality & Testing: Implement automated data validation, anomaly detection, and schema evolution testing (, Outstanding Expectations, Soda, dbt tests).
- Monitoring & Alerting: Build observability frameworks for pipeline uptime, latency, SLA adherence, and data freshness.

Collaboration & Governance

- Data Governance & Security: Enforce enterprise data security, role-based access control (RBAC), data lineage, and compliance standards (GDPR, CCPA, SOC2, HIPAA).




- Stakeholder Enablement: Partner with downstream data consumers (BI developers, ML engineers, business stakeholders) to understand data requirements and deliver self-service datasets.
- CI/CD & Dev Ops: Champion Infrastructure as Code (Terraform), containerization (Docker, Kubernetes), and CI/CD best practices for data products.

3. Required Qualifications & Skills

Technical Competencies

- Programming Languages: Proficiency in Python and/or Scala/Java, with strong knowledge of software engineering best practices (OOP, clean code, unit testing, git).
- SQL & Data Warehousing: Advanced SQL proficiency; deep expertise in modern cloud data warehouses (, Snowflake, Google Big Query, AWS Redshift, Databricks Lakehouse).
- Distributed Computing: Hands-on experience with Apache Spark / PySpark, Apache Flink, or Hadoop ecosystems.
- Data Transformation & Orchestration: Experience with modern data stack tools such as dbt (data build tool) and Apache Airflow.
- Cloud Infrastructure: Solid experience with at least one major cloud provider (AWS, GCP, or Azure) and core data services (, S3/GCS/ADLS, Glue, EMR, Big Query, Lambda/Cloud Functions).
- 5+ years of experience leading complex data platform implementations and architecture decisions.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

📌 Data Engineer (India)
🏢 12542 Citicorp Services India Private
📍 India