17 Sep
|
ParentPay Group - India
|
Pune
17 Sep
ParentPay Group - India
Pune
Department: Development
Location: Pune, India
Description We are seeking a highly skilled Data Engineer *to design, develop, and optimize enterprise-scale data solutions on Azure. The ideal candidate will have strong expertise in ETL development, real-time data processing, Azure data services, advanced SQL, and data modeling.
This role will be responsible for building scalable, high-performance data pipelines, driving best practices, and supporting business-critical analytics and reporting initiatives.* Key Responsibilities · Design, develop, and maintain scalable batch and real-time data pipelines.
· Architect and implement data integration solutions using Azure Data Factory, Azure Storage Accounts, and Azure Event Hub .
·Develop and optimize complex SQL queries, stored procedures, and database workloads to ensure performance and scalability.
· Build and support real-time/streaming data processing solutions leveraging Event Hub architecture .
· Design and implement robust data models to support analytics, reporting, and data warehousing requirements.
· Establish and maintain data quality, monitoring, performance tuning, and operational best practices.
Drive CI/CD implementation and automate deployment processes for data engineering solutions.
· Collaborate with business stakeholders, architects, and development teams to deliver reliable and scalable data platforms.
· Mentor junior engineers and contribute to technical design reviews and solution architecture discussions.
Skills, Knowledge and Expertise · 5+ years of experience in Data Engineering, ETL Development, or related roles.
· Strong hands-on experience in designing and developing ETL/ELT pipelines.
Proven experience with
- Azure Data Factory (ADF)
- Azure Storage Accounts (Blob Storage/Data Lake Storage)
- Azure Event Hub
· Strong experience in real-time/streaming data processing using Event Hub architecture. Advanced SQL expertise, including:
- Complex Joins
- CTEs & Window Functions
- Query Optimization
- Performance Tuning
- Stored Procedures & Database Design
· Solid understanding of data modeling concepts , including dimensional modeling, star schema, and enterprise data warehouse design. · Experience with CI/CD practices , Git, and Azure DevOps.
· Robust troubleshooting, analytical, and problem-solving skills.
· Experience working in Agile delivery environments.
Preferred Skills
- Experience with Azure Databricks, Spark, or Python.
- Knowledge of Data Lake, Lakehouse, and modern cloud-based data architectures.
- Exposure to data governance, monitoring, and security best practices.
- Experience in designing scalable enterprise data platforms.
📌 Data Engineer (Pune)
🏢 ParentPay Group - India
📍 Pune