02 Oct
|
Persistent Systems
|
Pune
02 Oct
Persistent Systems
Pune
About Position:
We are looking for an experienced Azure Data Engineer with robust expertise in Azure Databricks, Snowflake, PySpark, and SQL to design, develop, and optimize modern cloud-based data platforms. The ideal candidate will play a critical role in building scalable data pipelines, implementing enterprise data warehousing solutions, and enabling advanced analytics and business intelligence initiatives across Azure and Snowflake ecosystems.
• Role: Azure Data Engineer - Databricks & Snowflake
• Location: Pune, Bengaluru, Chennai
• Experience: 3 to 8 Years
• Job Type: Full-Time Employment
What You'll Do:
• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Build, optimize, and support ETL/ELT workflows for processing large volumes of structured and unstructured data.
• Develop and manage Snowflake data warehouse solutions, including data modeling, transformation, and performance optimization.
• Create reusable frameworks for data ingestion, data transformation, orchestration, and data validation.
• Integrate data from various enterprise systems, databases, APIs, and cloud platforms into Azure Data Lake and Snowflake environments.
• Implement and maintain Delta Lake architectures to support scalable and reliable data processing.
• Optimize data processing workloads for performance, scalability, reliability, and cost efficiency.
• Collaborate with business stakeholders, architects, analysts, and data science teams to deliver business-driven data solutions.
• Implement data governance, data quality, security, and monitoring best practices.
• Troubleshoot production issues related to data pipelines, Snowflake environments, and cloud data platforms.
• Participate in code reviews, automation initiatives, CI/CD implementations, and deployment activities.
• Support data platform modernization initiatives and continuous improvement programs.
Expertise You'll Bring:
• 8-12 years of experience in Data Engineering and Cloud
📌 Azure Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune