Job Type: Full time

Senior Data Engineer – Data Pipelines & Cloud DatabasesLocation: Pune | Experience: 4+ years | Type: Full-TimeRole OverviewDesign, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products.Key ResponsibilitiesData Pipeline DevelopmentImplement robust, scalable data pipelines using Microsoft Azure and Databricks stackBuild reusable data pipeline components and frameworksDesign and optimize data workflows for performance and reliabilityMonitor pipeline health and implement automated alertingDatabase ArchitectureDesign relational and non-relational database schemasMongoDB: schema design, aggregation pipelines, indexing, sharding, replica sets, performance tuningAzure Cosmos DB: multi-model access, partitioning, consistency levels, throughput management (RU/s), global distributionAzure Cosmos DB Gremlin API: graph data modeling, traversals, vertex/edge design, relationship analyticsAPI DevelopmentBuild RESTful APIs using FastAPI with async endpoint designImplement Pydantic models, middleware, dependency injection, background tasksGenerate and maintain auto-generated OpenAPI/Swagger documentationConfigure Azure API Management (APIM) for API gateway and securityProject & Stakeholder ManagementCollect progress updates from squads regularlyConsolidate updates into weekly project status reportsDevelop L3-level project plans with task details, milestones,



dependenciesParticipate in early-stage design and feature definitionCommunicate complex data insights to non-technical stakeholdersCollaboration & IntegrationWork across multiple engineering teams on prototype integrationSupport integration of proven prototypes into core intelligence productsStrong team collaboration and cross-functional communicationKnowledge sharing and documentationRequired Experience: Data Engineering & Databases4+ years data engineering or data platform experienceRelational and non-relational database expertiseMongoDB: advanced schema design, aggregation, indexing, sharding, performance optimizationAzure Cosmos DB: multi-model APIs, partitioning, consistency, throughput managementGraph databases: Cosmos DB Gremlin API, graph modeling, traversals, relationship analyticsAPI & Backend DevelopmentFastAPI proficiency: async endpoints, Pydantic models, middleware, dependency injectionBackground tasks and job schedulingRESTful API design and best practicesOpenAPI/Swagger documentationCloud PlatformAzure fundamentals and hands-on experienceAzure Data Factory or Databricks for ETL/ELTAzure Cosmos DB multi-region setupAzure API Management (APIM) configurationData Pipeline SkillsETL/ELT pipeline design and developmentData quality validation and monitoringSchema design for analytics and reportingPerformance optimization and scalabilityPreferred ExperienceDatabricks Delta Lake experienceAzure Synapse AnalyticsPython for data engineeringSpark SQL optimizationReal-time data streamingData governance and metadata managementAgile/Scrum development modelCI/CD pipeline experience

📌 Data Engineer (India)
🏢 InfoVision
📍 India