13 Sep
|
Persistent Systems
|
Pune
13 Sep
Persistent Systems
Pune
About Position:
As a Senior Azure Data Engineer, you will have the opportunity to be part of a high-performing data engineering team focused on transforming healthcare data into actionable insights that improve outcomes and business decisions. We are looking for a highly skilled qualified with expertise in Databricks, PySpark, SQL, and Production Support to design, develop, and maintain enterprise-scale data platforms and pipelines.
- Role: Sr. Azure Data engineer
- Location: Pune
- Experience: Between 8 to 10 Years
- Job Type: Full Time Employment
What You‘ll Do:
- Design, develop, and maintain scalable data pipelines using Databricks and PySpark.
- Build and optimize enterprise-grade ETL and ELT frameworks for large-scale data processing.
- Investigate and resolve data quality issues, pipeline failures, and production incidents.
- Perform root cause analysis for framework failures, processing issues, and application defects.
- Monitor, tune, and optimize Spark workloads for performance, scalability, and reliability.
- Develop and optimize SQL queries for data extraction,
transformation, validation, and reporting.
- Collaborate with business users, architects, and engineering teams to implement robust data solutions.
- Support production deployments and provide L2/L3 support for critical data platforms and applications.
- Troubleshoot complex data processing, workflow, and platform-related issues.
- Implement monitoring, alerting, and operational support processes to improve platform stability.
- Ensure data quality, accuracy, consistency, and availability across systems.
- Drive adoption of engineering best practices, coding standards, and operational governance.
- Participate in code reviews and contribute to continuous improvement initiatives.
- Support cloud-native data solutions using Azure and AWS platforms.
- Create and maintain technical documentation, operational runbooks, and support procedures.
- Contribute to Agile ceremonies including sprint plann
📌 Senior Azure Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune