We are looking for an experienced Data Engineer to build and operate reliable, scalable data pipelines and curated datasets supporting enterprise applications, analytics, and AI use cases.
Key Responsibilities
Design, develop, and maintain robust ETL/ELT data pipelines .
Build ingestion and transformation workflows using Python and SQL .
Develop and maintain curated datasets for applications, analytics, and AI retrieval .
Implement data validation, reconciliation, and data quality checks .
Build reliable pipelines with safe retry, rerun, and error-handling mechanisms .
Manage metadata, data lineage, and traceability across data pipelines.
Work with AWS S3 and cloud-based data processing solutions.
Use Amazon Athena for querying and analyzing data where applicable.
Perform SQL/query optimization for performance and scalability.
Leverage AI-assisted development practices to improve engineering productivity and quality. Mandatory Skills
Solid hands-on experience in Python .
Strong proficiency in SQL and PostgreSQL .
Solid experience in ETL/ELT and Data Pipeline development .
Hands-on experience with AWS S3 .
Experience in Cloud Data Engineering .
Robust understanding of Data Quality, Validation & Reconciliation .
Experience with Metadata Management and Data Lineage .
Experience with AI-assisted Development .
📌 Data Engineer Hyderabad
🏢 UST
📍 Hyderabad