Senior Data Engineer

Job Type: Full-Time

Experience: 7 Years

Job Location: India

Work Mode:

Job Overview

We are looking for an experienced Senior Data Engineer to join our Data Science and Engineering team. In this role, you will work closely with Data Scientists, ML Engineers, Data Platform, Analytics Engineering, and Business Insights teams to build reliable data infrastructure and production-ready datasets.

The ideal candidate should have strong experience in SQL, DBT, Databricks, Spark/PySpark, and Airflow, along with a good understanding of modern data engineering and lakehouse architectures.

Key Responsibilities

- Design, develop, and maintain DBT models for trusted datasets, features, metrics, analytics, and ML use cases.
- Build and operate scalable data pipelines using Databricks and PySpark.
- Work with Delta Lake/Iceberg tables and transform raw operational data into analysis-ready datasets.
- Develop and maintain end-to-end workflows using Apache Airflow and Prefect where required.
- Ensure data pipelines meet required standards for reliability, performance, quality, and SLAs.
- Partner with Data Scientists and ML Engineers to build and productionize feature pipelines.
- Understand business and operational processes to ensure data models accurately represent real-world requirements.
- Optimize DBT and Spark workloads for cost, performance, scalability, and reliability.
- Participate in code reviews and contribute to improving data quality, testing, documentation, and engineering standards.
- Troubleshoot pipeline and data-related issues and implement long-term solutions.
- Learn and adopt new technologies, tools,



and best practices as the data platform evolves.

Required Skills & Qualifications
- 7 years of skilled experience in Data Engineering.
- Strong proficiency in SQL.
- Production experience with at least one of the following:
- PySpark / Spark
- DBT
- Airflow
- Experience working with distributed data processing systems.
- Strong understanding of data consistency, latency, throughput, scalability, and fault tolerance.
- Experience with Infrastructure-as-Code tools such as Terraform, AWS CDK, or Pulumi.
- Experience working with modern data platforms and data pipelines.
- Strong problem-solving and analytical skills.
- Excellent written and verbal communication skills in English.
- Ability to work independently and collaborate effectively with cross-functional teams.

Technical Skills

Must Have:

- SQL
- DBT
- Databricks
- PySpark / Spark
- Airflow
- Delta Lake or Iceberg
- Data Pipeline Development

Good to Have:

- Prefect
- Kinesis or other streaming technologies
- EMR
- Sigma
- Pulumi
- Terraform
- MLOps
- Experience supporting Data Science / ML teams
- Lakehouse architecture

AI & Contemporary Engineering Skills
- Comfortable using modern AI coding assistants such as Claude Code, Cursor, GitHub Copilot, or similar tools.




- Familiarity with AI-assisted and AI-native engineering workflows.
- Understanding of prompting, agentic tools, evaluations, retrieval, or similar AI development practices.
- Experience integrating AI/LLM capabilities into data pipelines, engineering workflows, or internal tools will be an advantage.

Preferred Experience
- Experience with Data Lakehouse architectures using Iceberg or Delta.
- Knowledge of streaming systems such as Kinesis.
- Exposure to MLOps or ML/AI data workflows.
- Experience working with international engineering teams across different time zones.
- Understanding of supply chain, logistics, e-commerce, or operational data is an advantage.

What We Offer
- Opportunity to work on large-scale data engineering and analytics projects.
- Exposure to modern technologies including Databricks, DBT, Spark, Airflow, and lakehouse platforms.
- Opportunity to work closely with Data Science and Machine Learning teams.
- Professional growth and continuous learning opportunities.
- Collaborative and high-impact engineering environment.

Ideal Candidate The ideal candidate is a self-driven and technically strong Senior Data Engineer who takes ownership, enjoys solving complex data problems, and can build scalable, reliable data solutions. You should be comfortable working in a fast-paced environment and collaborating with Data Scientists, ML Engineers, and other technical teams. Pay: ₹2,000,000.00 - ₹2,500,000.00 per year

Benefits

- Paid sick time
- Provident Fund

Work Location: In person

📌 Senior Data Engineer (Hyderabad)
🏢 Gigatorb software
📍 Hyderabad