08 Aug
|
ADP Private
|
Hyderabad
08 Aug
ADP Private
Hyderabad
We are seeking a skilled Data Engineer to join our team, specializing in building and maintaining up-to-date data pipelines using ETL/ELT methodologies. The ideal candidate will have extensive experience in transforming unstructured data into structured datasets, creating CI/CD automation, and ensuring high-quality, validated data for analytical purposes.
Built and maintained scalable ELT pipelines using Databricks
Developed robust data models with advanced SQL (CTEs, window functions, joins)
Implemented CI/CD pipelines for dbt projects using Git
Automated data validation using Python and Q-Test
Managed version control, code reviews, and pull requests
Migrated data across diverse sources (Excel, XML, JSON, SQL Server)
Resolved production issues and ensured data reliability
Collaborated with stakeholders to deliver data-driven solutions
Created technical documentation and knowledge base artifacts
Integrated Databricks APIs with React applications on AWS
Implemented IAM security, CI/CD, and CloudWatch monitoring
Optimized system performance for scalability and availability
Configured end-to-end integration between Databricks APIs and React frontend applications on AWS, implementing CI/CD pipelines, IAM-based security, monitoring with CloudWatch, and optimized compute/storage setup for high availability and performance.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Financial Systems Professional Hyderabad
🏢 ADP Private
📍 Hyderabad