We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining up-to-date data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes.
- Built and maintained scalable ELT pipelines using Databricks
- Developed robust data models with advanced SQL (CTEs, window functions, joins)
- Implemented CI/CD pipelines for dbt projects using Git
- Automated data validation using Python and Q-Test
- Managed version control, code reviews, and pull requests
- Migrated data across diverse sources (Excel, XML, JSON, SQL Server)
- Resolved production issues and ensured data reliability
- Collaborated with stakeholders to deliver data-driven solutions
- Created technical documentation and knowledge base artifacts
- Integrated Databricks APIs with React applications on AWS
- Implemented IAM security, CI/CD, and CloudWatch monitoring
- Optimized system performance for scalability and availability
- Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Financial Systems professional (Hyderabad)
🏢 ADP Private
📍 Hyderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.