30 Sep
|
Persistent Systems
|
Pune
30 Sep
Persistent Systems
Pune
About Position:
We are looking for an experienced Azure Data Engineer with strong expertise in Azure Databricks, Snowflake, PySpark, and SQL to design, develop, and optimize modern cloud-based data platforms. The ideal candidate will play a critical role in building scalable data pipelines, implementing enterprise data warehousing solutions, and enabling advanced analytics and business intelligence initiatives across Azure and Snowflake ecosystems.
- Role: Azure Data Engineer - Databricks & Snowflake
- Location: Pune, Bengaluru, Chennai
- Experience: 3 to 8 Years
- Job Type: Full-Time Employment
What You'll Do:
- Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
- Build, optimize, and support ETL/ELT workflows for processing large volumes of structured and unstructured data.
- Develop and manage Snowflake data warehouse solutions, including data modeling, transformation, and performance optimization.
- Create reusable frameworks for data ingestion, data transformation, orchestration, and data validation.
- Integrate data from various enterprise systems, databases, APIs, and cloud platforms into Azure Data Lake and Snowflake environments.
- Implement and maintain Delta Lake architectures to support scalable and reliable data processing.
- Optimize data processing workloads for performance, scalability, reliability, and cost efficiency.
- Collaborate with business stakeholders, architects, analysts, and data science teams to deliver business-driven data solutions.
- Implement data governance, data quality, security, and monitoring best practices.
- Troubleshoot production issues related to data pipelines,
Snowflake environments, and cloud data platforms.
- Participate in code reviews, automation initiatives, CI/CD implementations, and deployment activities.
- Support data platform modernization initiatives and continuous improvement programs.
Expertise You'll Bring:
- 8-12 years of experience in Data Engineering and Cloud Data Platform development.
- Strong hands-on expertise in Azure Databricks, PySpark, Spark SQL, and Delta Lake.
- Proven experience with Snowflake including data loading, transformations, data sharing, and performance optimization.
- Strong proficiency in SQL for complex query development, troubleshooting, and performance tuning.
- Experience with Azure services such as Azure Data Factory (ADF), Azure Data Lake Storage (ADLS Gen2), Azure Key Vault, and Azure DevOps.
- Strong understanding of data warehousing concepts, dimensional modeling, ETL/ELT architecture, and Lakehouse architecture.
- Experience developing and supporting enterprise-scale data pipelines and analytics platforms.
- Knowledge of data governance, data quality management, and cloud security best practices.
- Experience with Git, CI/CD pipelines, DevOps practices, and Agile delivery methodologies.
- Strong analytical, debugging, troubleshooting,
and problem-solving skills.
- Ability to work independently and collaborate effectively across distributed teams.
- Excellent communication and stakeholder management skills.
Advantages:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
📌 Azure Data Engineer - Databricks & Snowflake (Pune)
🏢 Persistent Systems
📍 Pune