13 Aug
|
Persistent Systems
|
Pune
13 Aug
Persistent Systems
Pune
About Position:
Lead Data Engineer role driving end-to-end Azure and Snowflake data solutions, ensuring scalable pipelines, strong governance, and technical leadership across data engineering teams.
Role: Lead Data Engineer
Location: Pune
Experience: 8 to 12 years
Job Type: Full-Time Employment
What You'll Do:
Design and implement end-to-end data engineering solutions using Snowflake, Python, and Azure.
Build, optimize, and maintain scalable ETL/ELT pipelines using Snowflake, Python, ADF, ADLS Gen2, and Synapse.
Develop data ingestion, transformation, and orchestration frameworks to support analytics and business intelligence needs.
Provide technical leadership, conduct code reviews, and drive engineering best practices across the team.
Ensure high performance, scalability, security, and cost optimization of Snowflake-based data platforms.
Collaborate with business stakeholders, architects, and engineering teams to deliver robust data solutions.
Drive data modeling, governance, data quality, and metadata management initiatives.
Troubleshoot production issues and support delivery planning and execution.
Expertise You'll Bring:
8 to 12 years of experience in Data Engineering, including team handling/technical leadership experience.
Robust hands-on experience with Snowflake (Data Warehousing, Performance Tuning, SnowSQL, Tasks, Streams, Stored Procedures).
Advanced proficiency in Python for data processing, automation, and pipeline development.
Strong experience with Azure Data Factory (ADF), ADLS Gen2, and Synapse Analytics.
Expertise in designing and developing complex ETL/ELT pipelines.
Strong knowledge of SQL, Database Design, and Data Modeling.
Experience with data transformation frameworks and large-scale data processing.
Experience with Kafka, Event Hub, or other streaming technologies.
Knowledge of Databricks/Lakehouse architecture.
Exposure to CI/CD, DevOps, and Data Governance frameworks.
Experience working with Agile delivery methodologies.
Benefits:
📌 Lead Data Engineer (Pune)
🏢 Persistent Systems
📍 Pune