Position: Java & Python AI/ML Engineer

Experience: 6+ Years

Domain: Banking

Work Location: Pune

Key Responsibilities

- Develop AI/ML solutions using Python, LLMs, and Generative AI technologies.
- Design and implement enterprise-grade RAG (Retrieval-Augmented Generation) pipelines.
- Develop Agentic AI workflows and orchestration solutions using LangGraph and/or LangChain.
- Integrate and consume LLM APIs for enterprise AI applications.
- Implement prompt engineering, prompt management, streaming responses, model integration, and LLM cost optimization.
- Design and develop scalable distributed systems and microservices.
- Build secure and reliable REST APIs and backend components.
- Design, develop, and maintain scalable backend services using Java, Spring Boot, and Microservices.
- Integrate AI capabilities with existing enterprise applications and services.
- Work with AWS and/or Azure cloud platforms and AI/ML services.
- Implement CI/CD pipelines and follow modern DevOps and engineering practices.
- Develop unit and integration tests to ensure application reliability and quality.
- Implement application monitoring, logging, metrics, tracing, and observability.
- Troubleshoot production issues and perform root-cause analysis.
- Optimize application performance, scalability, reliability, and resource utilization.
- Participate in system design, architecture reviews, and technical discussions.
- Follow secure coding standards, design patterns, and software engineering best practices.
- Mentor junior engineers and contribute to technical knowledge sharing.

Mandatory Skills





- 6+ years of relevant software development experience.
- Strong hands-on experience with Java.
- Strong experience with Spring Boot and Microservices.
- Good hands-on experience with Python.
- Practical experience with LLMs / Generative AI.
- Hands-on experience developing RAG pipelines.
- Knowledge or practical experience with Agentic AI.
- Experience with LangChain and/or LangGraph.
- Experience integrating LLM APIs.
- Solid understanding of Distributed Systems and System Design.
- Experience with AWS and/or Azure.
- Knowledge of CI/CD and automated testing.
- Understanding of application monitoring and observability.
- Strong analytical, troubleshooting, and problem-solving skills.
- Good communication and collaboration skills.

Positive-to-Have Skills

- Experience with Vector Databases and Embeddings.
- Knowledge of Kafka or event-driven architecture.
- Experience with Docker and Kubernetes.
- Experience with API Gateway and distributed messaging.
- Knowledge of AI evaluation, guardrails, and responsible AI practices.
- Experience with LLM performance, latency, and cost optimization.
- Previous experience in Banking, Payments, FinTech, or Financial Services.

Technical Environment

- Languages: Java, Python
- Backend: Spring Boot, Microservices, REST APIs
- AI/ML: LLMs, Generative AI, RAG, Agentic AI
- Frameworks: LangChain, LangGraph
- Cloud: AWS, Azure
- Architecture: Distributed Systems, Microservices, Event-Driven Architecture
- DevOps: CI/CD, Docker, Kubernetes
- Testing: Unit Testing, Integration Testing
- Observability: Logging, Monitoring, Metrics, Tracing

📌 Senior Python + Ai Engineer - 6 years (Pune) (India)
🏢 Rosemallow Technologies
📍 India