We are looking for an experienced Data Engineer to build and operate reliable, scalable data pipelines and curated datasets supporting enterprise applications, analytics, and AI use cases.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT data pipelines .
- Build ingestion and transformation workflows using Python and SQL .
- Develop and maintain curated datasets for applications, analytics, and AI retrieval .
- Implement data validation, reconciliation, and data quality checks .
- Build reliable pipelines with safe retry, rerun, and error-handling mechanisms .
- Manage metadata, data lineage, and traceability across data pipelines.
- Work with AWS S3 and cloud-based data processing solutions.
- Use Amazon Athena for querying and analyzing data where applicable.
- Perform SQL/query optimization for performance and scalability.
- Leverage AI-assisted development practices to improve engineering productivity and quality. Mandatory Skills
- Strong hands-on experience in Python .
- Strong proficiency in SQL and PostgreSQL .
- Solid experience in ETL/ELT and Data Pipeline development .
- Hands-on experience with AWS S3 .
- Experience in Cloud Data Engineering .
- Strong understanding of Data Quality, Validation & Reconciliation .
- Experience with Metadata Management and Data Lineage .
- Experience with AI-assisted Development .
📌 Data Engineer (Hyderabad)
🏢 UST
📍 Hyderabad