- Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory.
- Write effective Python and SQL code with a focus on scalability, performance, and optimization.
- Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity).
- Implement CI/CD pipelines and follow Data Ops practices for automation and reliability.
- Optimize data partitioning, versioning, and storage/compute costs for large-scale workloads.
- Ensure high-quality solutions through unit testing frameworks and automated validation.
- Collaborate with business teams to support analytics, reporting, and data science initiatives.
- Mentor junior engineers, sharing knowledge and promoting engineering excellence.
- Bachelor s degree in computer science, IT, Data Engineering, or a related field.
- 5+ years of experience in data engineering roles with proven expertise in cloud data platforms.
- Expert in Python and SQL,



with strong performance optimization skills.
- Proficiency in Azure Synapse Analytics, Spark Pools, and Azure Data Factory (ADF).
- Hands-on experience with Azure Data Lake and structured ingestion at scale.
- Experience in CI/CD pipelines and applying Data Ops principles.
- Ability to manage large datasets with diverse structures, velocity, and volume.

Good to Have Skills

- Experience with Delta Lake, versioned data, and advanced partitioning strategies.
- Knowledge of data governance and security implementations across platforms.
- Strong understanding of advanced data modelling (e.g., slowly changing dimensions).
- Exposure to cost optimization strategies for cloud storage and compute.
- Experience mentoring or providing technical leadership to junior engineers.

📌 Azure Data Engineer (Secunderabad)
🏢 ProArch Technology Services
📍 Secunderabad