Summary
The Backend Software Engineer will join the Company’s Data Engineering Platform team and play a key role in building and evolving large-scale backend data systems, real-time and batch processing pipelines, and AI-enabled services. This position focuses on backend engineering using Scala, Python, and Java, distributed data platforms including Cloudera and Spark, and cloud-based architectures. The role also contributes to AI-powered automation initiatives that support analytics, decision-making, and operational efficiency across the organization. The ideal candidate will have experience working with large-scale datasets, contemporary data platforms, and cloud technologies while collaborating with cross-functional teams to deliver reliable and scalable backend solutions.

Responsibilities
- Design, develop, and maintain backend services and data pipelines using Scala, Python, and Java.
- Build, optimize, and support batch and streaming workloads on Cloudera Data Platform (CDP) using Spark.
- Configure, monitor, troubleshoot, and improve platform performance using Cloudera Manager.




- Design and implement high-quality DataMart’s and curated datasets with a focus on data integrity, reliability, and performance.
- Develop and integrate AI-powered agents that support intelligent automation, operational efficiency, and scalable workflows.
- Contribute to anomaly detection, operational intelligence, and workflow automation initiatives.
- Support cloud-based data and compute workloads within AWS environments.
- Utilize Databricks for large-scale data processing and advanced analytics workloads.
- Contribute to cloud-native and hybrid architectures that integrate on-premises and cloud-based platforms.
- Enable downstream consumers, including analytics, reporting, and visualization tools, through reliable and scalable backend data interfaces.
- Collaborate with analytics, business, and technical teams to understand requirements and deliver backend solutions that support evolvi

📌 Software Engineer II (Pune Division)
🏢 Aditi Consulting
📍 Pune Division