We are looking for an experienced Data Engineer to build and operate reliable, scalable data pipelines and curated datasets supporting enterprise applications, analytics, and AI use cases.
Key Responsibilities
• Design, develop, and maintain robust ETL/ELT data pipelines.
• Build ingestion and transformation workflows using Python and SQL.
• Develop and maintain curated datasets for applications, analytics, and AI retrieval.
• Implement data validation, reconciliation, and data quality checks.
• Build reliable pipelines with safe retry, rerun, and error-handling mechanisms.
• Manage metadata, data lineage, and traceability across data pipelines.
• Work with AWS S3 and cloud-based data processing solutions.
• Use Amazon Athena for querying and analyzing data where applicable.
• Perform SQL/query optimization for performance and scalability.
• Leverage AI-assisted development practices to improve engineering productivity and quality. Mandatory Skills
• Strong hands-on experience in Python.
• Robust proficiency in SQL and PostgreSQL.
• Strong experience in ETL/ELT and Data Pipeline development.
• Hands-on experience with AWS S3.
• Experience in Cloud Data Engineering.
• Strong understanding of Data Quality, Validation & Reconciliation.
• Experience with Metadata Management and Data Lineage.
• Experience with AI-assisted Development.
📌 Data Engineer (Hyderabad)
🏢 UST
📍 Hyderabad