14 Oct
|
Persistent Systems
|
Pune
14 Oct
Persistent Systems
Pune
About Position:
We are seeking an experienced Azure Data Engineer to join our growing data engineering team. The ideal candidate will have strong expertise in Azure Cloud, Databricks, PySpark, Python, and Kafka, along with hands-on experience building scalable and reliable data platforms. This role requires a combination of technical expertise, problem-solving ability, and collaboration skills to design, develop, and maintain enterprise-grade data solutions that support business intelligence, analytics, and digital transformation initiatives.
• Role: Azure Data Engineer
• Location: Pune
• Experience: 8 to 12 Years
• Job Type: Full Time Employment
What You'll Do:
• Design, develop, test, and maintain scalable data engineering solutions on Azure Cloud.
• Build and optimize batch and real-time data processing pipelines using Databricks and PySpark.
• Develop robust data ingestion, transformation, and integration frameworks for structured and unstructured data.
• Translate business and technical requirements into scalable, maintainable, and secure data solutions.
• Develop and support data processing workflows using Python and cloud-native services.
• Implement streaming data solutions using Kafka and up-to-date event-driven architectures.
• Perform code reviews, unit testing, integration testing, debugging, and production support activities.
• Optimize data pipelines and processing frameworks for performance, reliability, and scalability.
• Collaborate with architects, product owners, business analysts, QA teams, DevOps teams, and data governance stakeholders.
• Ensure data quality, consistency, governance, and compliance throughout the data lifecycle.
• Support CI/CD implementation and automation for data engineering workloads.
• Create and maintain technical documentation, reusable assets, and operational procedures.
• Contribute to engineering best practices, innovation initiatives, and continuous improvement efforts.
Expertise You'll Bring:
• 8-12 years of experi
📌 Azure Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune