Company: BayGrape Technology Solutions

Location: Bangalore

Website: https://baygrape.com

LinkedIn: https://www.linkedin.com/company/baygrape-technology

Experience: 7 - 10 Years

We are looking for a Senior Azure Data Engineer with 6+ years of experience in designing and developing scalable data engineering and ETL solutions using Microsoft Azure and Microsoft Fabric. The ideal candidate should have strong hands-on experience with Fabric Data Pipelines, Dataflows, Notebooks, PySpark, SQL Server, database design, and complex SQL development.

Key Responsibilities :

- Design, develop, and maintain end-to-end ETL/ELT pipelines using Microsoft Fabric.
- Build and manage Fabric Data Pipelines, Dataflows Gen2, and Notebooks for data ingestion and transformation.
- Develop scalable data transformation solutions using PySpark and Python. Design and implement data processing workflows across Fabric Lakehouse, Warehouse, and SQL databases.
- Develop complex and optimized SQL queries, stored procedures, views, functions, and data transformation logic.
- Design relational database schemas, tables, keys, indexes, constraints, and relationships.
- Perform data modeling and implement efficient SQL database designs for analytical and transactional workloads.
- Integrate data from multiple sources including SQL databases, files, APIs, and enterprise applications.
- Implement data cleansing, validation, transformation, deduplication, and reconciliation processes.
- Optimize ETL pipelines, Spark jobs, and SQL queries for performance and scalability.
- Implement incremental data loads, error handling, logging, and pipeline monitoring.
- Work with Microsoft Fabric Lakehouse and Warehouse architecture and medallion-style data engineering patterns.
- Collaborate with BI developers and business teams to deliver reliable, analytics-ready datasets.
- Troubleshoot data pipeline, SQL, Spark,



and data integration issues in production environments.
- Follow data engineering best practices for security, performance, maintainability, and scalability.

Required Skills :

- 6+ years of experience in Data Engineering / ETL development. Strong hands-on experience with Microsoft Fabric.
- Experience developing Fabric Data Pipelines. Experience with Dataflows Gen2.
- Strong experience developing Fabric Notebooks using PySpark.
- Advanced SQL skills, including complex joins, CTEs, subqueries, window functions, aggregations, and performance optimization.
- Strong knowledge of SQL Server / relational databases.
- Experience in database design and data modeling.
- Solid understanding of ETL/ELT concepts and data integration patterns.
- Experience with large-volume data processing using PySpark/Spark.
- Knowledge of Lakehouse, Data Warehouse, Delta Lake, and medallion architecture.
- Experience with data quality, validation, error handling, and pipeline monitoring. Strong analytical and problem-solving skills.

Preferred Skills:

- Experience with Azure Data Factory, Azure SQL Database.
- Experience with Microsoft Power BI and semantic models.
- Knowledge of DAX and Power BI data modeling.
- Experience with REST APIs and external data sources.
- Knowledge of Git/version control and CI/CD. Experience with Azure DevOps.
- Familiarity with Fabric security, workspace management, and deployment pipelines.

Pay: ₹1,500,000.00 - ₹2,200,000.00 per year

Application Question(s):

- How many years of experience with Pyspark and Python?
- How soon can you join?

Experience:

- microsoft azure and fabric: 6 years (Preferred)
- Database Design and data modelling: 6 years (Preferred)
- Microsoft SQL Server: 7 years (Preferred)

License/Certification:

- Microsoft Certified: Fabric Data Engineer Associate – DP-700 (Preferred)

Location:

- Bangalore City, Bengaluru, Karnataka (Preferred)

Work Location: In person

📌 Senior Azure Data Engineer (Bengaluru)
🏢 Baygrape Technology Solutions
📍 Bengaluru