Senior Data Engineer (AWS | Python | Data Platform)
Location: Pune (5 Days / Week)
Role Summary:
We are looking for a Senior Data Engineer to design, develop, and optimize scalable cloud-based data platforms that power analytics, operational intelligence, and enterprise applications. The ideal candidate is passionate about building reliable data pipelines, designing modern data architectures, and enabling data-driven decision making through high-quality, secure, and scalable solutions.
Key Responsibilities:
- Data Engineering & Platform Development Design, develop, and maintain scalable batch and streaming data pipelines on AWS.
- Build robust ETL/ELT frameworks for ingesting data from multiple internal and external sources.
- Develop reusable data services that support analytics, reporting, machine learning, and operational workloads.
- Design productive data models optimized for both analytical and operational use cases. Ensure data quality, consistency, lineage, and governance across the data platform.
- Cloud & Infrastructure Build and optimize cloud-native data infrastructure using AWS services.
- Design highly available, fault-tolerant, and scalable data processing architectures.
- Automate deployment, monitoring, and operational workflows using Infrastructure as Code and CI/CD practices.
- Optimize storage, compute utilization, and overall cloud costs.
- Performance & Reliability Improve pipeline performance, scalability, and reliability.
- Monitor production workloads and proactively resolve bottlenecks.
- Optimize SQL queries, data partitioning, indexing strategies, and processing performance.
- Troubleshoot production issues and implement preventive improvements.
- Collaboration Work closely with Data Scientists, Software Engineers, Product Owners, and Architects to understand business requirements.
- Support downstream analytics, dashboards, and reporting solutions.
- Participate in architecture discussions, code reviews, and technical design sessions.
📌 Data Engineer (Pune)
🏢 Calsoft
📍 Pune