We are looking for an experienced Data Engineer to build and operate reliable, scalable data pipelines and curated datasets supporting enterprise applications, analytics, and AI use cases.
Key Responsibilities
- Design, develop, and maintain robust ETL/ELT data pipelines.
- Build ingestion and transformation workflows using Python and SQL.
- Develop and maintain curated datasets for applications, analytics, and AI retrieval.
- Implement data validation, reconciliation, and data quality checks.
- Build reliable pipelines with safe retry, rerun, and error-handling mechanisms.
- Manage metadata, data lineage, and traceability across data pipelines.
- Work with AWS S3 and cloud-based data processing solutions.
- Use Amazon Athena for querying and analyzing data where applicable.
- Perform SQL/query optimization for performance and scalability.
- Leverage AI-assisted development practices to improve engineering productivity and quality.
Mandatory Skills
- Strong hands-on experience in Python.
- Strong proficiency in SQL and PostgreSQL.
- Strong experience in ETL/ELT and Data Pipeline development.
- Hands-on experience with AWS S3.
- Experience in Cloud Data Engineering.
- Solid understanding of Data Quality, Validation & Reconciliation.
- Experience with Metadata Management and Data Lineage.
- Experience with AI-assisted Development.
📌 Data Engineer (Hyderabad)
🏢 UST
📍 Hyderabad