Provides advanced data solutions by using software to process, store, and serve data to others. Tests data quality and optimizes data availability. Ensures that data pipelines are scalable, repeatable, and secure. Utilizes a deep dive analytical skillset on a variety of internal and external data.

Role Summary

The Data Engineer, Specialist is responsible for building and maintaining scalable data solutions using Databricks, Python, SQL, and cloud technologies. The role focuses on designing and optimizing data pipelines, implementing end-to-end data models in collaboration with business stakeholders, and deploying reliable data solutions that enable analytics, reporting, and business decision-making.

Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Python, and SQL to support enterprise data needs.
- Manage end-to-end data modeling in collaboration with business stakeholders, translating business requirements into scalable and productive data models.
- Build and optimize data ingestion, transformation,



and processing workflows across multiple data sources and platforms.
- Develop reusable and maintainable solutions using Python (Functional Programming and Object-Oriented Programming principles).
- Deploy and manage data infrastructure and workflows using Terraform and cloud-native services.
- Work with AWS and/or GCP environments to build scalable and secure data solutions, with adherence to cloud security best practices.
- Partner with engineering teams and business stakeholders to deliver high-quality, trusted datasets that support reporting, analytics, and business initiatives.
- Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and data integrity.
- Contribute to the adoption of modern data engineering practices, automation, and platform enhancements within the organization.

Qualifications and Skills
- Minimum 5 years of relevant work experience, with at least 2 yea

📌 Data Engineer, Specialist (Hyderabad)
🏢 Vanguard Technologies
📍 Hyderabad