Location & Work Mode: Hyderabad (In office) · Open to Relocation
Employment Type: Full-time
Experience Level: 2–3 years
About the Role: As a foundational member of the Statistical Experiments and Machine Learning Lab at the Department of Data Science and AI, IIT Madras, you will take full ownership of data reliability and pipeline scalability for NIRDPR (National Institute of Rural Development and Panchayati Raj). Your goal is to ensure engineering integrity across all scientific datasets on AWS, serving as a dependable guardian of data correctness and experimental freshness for NIRDPR rural policy projects.
Key Responsibilities
Reliability Engineering: Build and maintain highly dependable pipelines that guarantee data accuracy and availability for downstream analytics. Pipeline Scalability: Develop modular and efficient ETL processes capable of scaling alongside increasing data volumes without compromising performance. Data Integrity Audits:
Enforce strict data quality tests and monitoring scripts to catch anomalies early and maintain absolute trust in the data. Foundational Support: Maintain the core Lab engineering standards on AWS that allow for consistent, predictable data flows across all NIRDPR public policy projects. SLA Adherence: Take personal accountability for meeting data delivery timelines, ensuring stakeholders have the fresh datasets they need. Must-Have Requirements
Expert-level SQL and production-grade Python/Scala proficiency. Solid understanding of distributed computing (Apache Spark) and how to debug a slow, resource-heavy job. Strong grasp of data modeling (Dimensional modeling, OLTP vs OLAP). Deep commitment to system reliability, data integrity, and high-performance engineering standards in large-scale data environments. Strong problem-solving mindset with the ability to translate complex technical constraints into clear, non-technical business outcomes for stakeholders. Proficiency with AI coding assistants (e.g.,
📌 Data Engineer | Iit Madras (Chennai)
🏢 Department of Data Science & AI, IIT Madras
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.