08 Sep
|
InfoVision
|
Pune
Job Description
Senior Data Engineer – Data Pipelines & Cloud Databases
n Location: Pune | Experience: 4+ years | Type: Full-Time
nRole Overview
nDesign, build, manage enterprise data pipelines on Azure and Databricks. Own schema design, API development, and data infrastructure for analytics and intelligence products.
nKey Responsibilities
n
n Data Pipeline Development
n
- n
- Implement robust, scalable data pipelines using Microsoft Azure and Databricks stackn
- Build reusable data pipeline components and frameworksn
- Design and optimize data workflows for performance and reliabilityn
- Monitor pipeline health and implement automated alertingn
n Database Architecture
n
- n
- Design relational and non-relational database schemasn
- MongoDB: schema design, aggregation pipelines, indexing, sharding, replica sets, performance tuningn
- Azure Cosmos DB: multi-model access, partitioning, consistency levels, throughput management (RU/s), global distributionn
- Azure Cosmos DB Gremlin API: graph data modeling, traversals, vertex/edge design,
relationship analyticsn
n API Development
n
- n
- Build RESTful APIs using FastAPI with async endpoint designn
- Implement Pydantic models, middleware, dependency injection, background tasksn
- Generate and maintain auto-generated OpenAPI/Swagger documentationn
- Configure Azure API Management (APIM) for API gateway and securityn
n Project & Stakeholder Management
n
- n
- Collect progress updates from squads regularlyn
- Consolidate updates into weekly project status reportsn
- Develop L3-level project plans with task details, milestones, dependenciesn
- Participate in early-stage design and feature definitionn
- Communicate complex data insights to non-technical stakeholdersn
n Collaboration & Integration
n
- n
- Work across multiple engineering teams on prototype integrationn
- Support integration of proven prototypes into core intelligence productsn
- Solid team collaboration and cross-fu
📌 Data Engineer (Pune)
🏢 InfoVision
📍 Pune