Desired Competencies (Technical/Behavioral Competency)

Must-Have
Deep hands-on experience with Python,Pyspark,Spark batch,notebook in Azure
Experience in Cosmos DB including data modeling, indexing, partitioning, consistency levels, and performance tuning.
Solid understanding of Cosmos DB APIs (Core SQL API, MongoDB API, etc.) and integration patterns.
Proficiency in query optimization and troubleshooting Cosmos DB performance issues.
Experience in data processing using PySpark and Python.
Familiarity with Microsoft Fabric for data engineering and analytics workflows.
Proficient using source code management tools such as Git or GitHub
Experience with Test Driven Development and / or Behavior Driven Development.

Valuable-to-Have
Exposure to data governance tools like Azure Purview.
Familiar with various design patterns
Familiar with Azure: SQL Managed Instance, Cosmos DB, Storage Services, Azure Functions




Global project experience, and excellent communication skills, verbal and written, and soft skills in agile projects

SN Responsibility of / Expectations from the Role 1 Design and implement scalable and high-performance solutions using Azure Cosmos DB.

2 Develop data ingestion and transformation pipelines using PySpark and Azure Data Factory.

3 Optimize Cosmos DB performance through indexing, partitioning, and query tuning.

4 Collaborate with architects and data engineers to ensure best practices in data modeling and cloud architecture.

5 Implement and maintain CI/CD pipelines for automated deployments and testing.

6 Troubleshoot and resolve technical issues related to Cosmos DB and data pipelines.

📌 Senior Data Engineer Pune
🏢 ITMC SYSTEMS
📍 Pune