15 Sep
|
ParentPay Group
|
Pune
15 Sep
ParentPay Group
Pune
Department: Development
Employment Type: Permanent - Full Time
Location: Pune, India
Reporting To: Prashanth Mavungal
Description
We are seeking a highly skilled Data Engineer to design, develop, and optimize enterprise-scale data solutions on Azure. The ideal candidate will have strong expertise in ETL development, real-time data processing, Azure data services, advanced SQL, and data modeling.
This role will be responsible for building scalable, high-performance data pipelines, driving best practices, and supporting business-critical analytics and reporting initiatives.
Key Responsibilities
- Design, develop, and maintain scalable batch and real-time data pipelines.
- Architect and implement data integration solutions using Azure Data Factory, Azure Storage Accounts, and Azure Event Hub.
- Develop and optimize complex SQL queries, stored procedures, and database workloads to ensure performance and scalability.
- Build and support real-time/streaming data processing solutions leveraging Event Hub architecture.
- Design and implement robust data models to support analytics, reporting, and data warehousing requirements.
- Establish and maintain data quality, monitoring, performance tuning, and operational best practices.
Drive CI/CD implementation and automate deployment processes for data engineering solutions.
- Collaborate with business stakeholders, architects,
and development teams to deliver reliable and scalable data platforms.
- Mentor junior engineers and contribute to technical design reviews and solution architecture discussions.
Skills, Knowledge and Expertise
- 5+ years of experience in Data Engineering, ETL Development, or related roles.
- Solid hands-on experience in designing and developing ETL/ELT pipelines.
Proven Experience With
- Azure Data Factory (ADF)
- Azure Storage Accounts (Blob Storage/Data Lake Storage)
- Azure Event Hub
- Strong experience in real-time/streaming data processing using Event Hub architecture.
Advanced SQL Expertise, Including
- Complex Joins
- CTEs & Window Functions
- Query Optimization
- Performance Tuning
- Stored Procedures & Database Design
- Solid understanding of data modeling concepts, including dimensional modeling, star schema, and enterprise data warehouse design.
- Experience with CI/CD practices, Git, and Azure DevOps.
- Strong troubleshooting, analytical, and problem-solving skills.
- Experience working in Agile delivery environments.
Preferred Skills
- Experience with Azure Databricks, Spark, or Python.
- Knowledge of Data Lake, Lakehouse, and modern cloud-based data architectures.
- Exposure to data governance, monitoring, and security best practices.
- Experience in designing scalable enterprise data platforms.
📌 Data Engineer (Pune)
🏢 ParentPay Group
📍 Pune