: Data Scientist

Job Title: Data Scientist

Locations: Bangalore / Pune

Experience: 5-12 Years

Employment Type: Full-Time

Job Summary

We are looking for an experienced Data Scientist with strong expertise in classical Machine Learning, AI/ML evaluation, and Large Language Models (LLMs). The ideal candidate should be skilled in problem framing, defining evaluation metrics, conducting experiments, and developing AI/ML solutions, with foundational knowledge of prompt engineering and Retrieval-Augmented Generation (RAG).

Key Responsibilities

- Translate business requirements into data science problems and define measurable success criteria.
- Develop, train, evaluate, and optimize classical machine learning models.
- Define and track AI/ML performance metrics, including accuracy, precision, recall, F1-score, and business-specific KPIs.
- Contribute to LLM development and evaluation, including response quality, relevance, groundedness, and hallucination assessment.
- Apply prompt engineering techniques and understand basic RAG architectures and workflows.
- Design and execute experiments, including hypothesis testing, A/B testing, and model comparisons.
- Perform feature engineering, data preprocessing, model validation, and error analysis.
- Document model assumptions,



limitations, evaluation results, risks, and intended use through model cards.
- Collaborate with data engineers, ML engineers, product teams, and business stakeholders to deliver scalable AI solutions.

Required Skills

- Robust understanding of problem framing and analytical thinking.
- Hands-on experience with classical ML algorithms and model development.
- Knowledge of AI/ML evaluation metrics and model validation techniques.
- Experience with LLM development and evaluation.
- Basic understanding of prompt engineering and RAG.
- Experience in experiment design, hypothesis testing, and statistical analysis.
- Familiarity with model documentation, model cards, and responsible AI principles.
- Strong Python and SQL programming skills.
- Experience with libraries such as Pandas, NumPy, Scikit-learn, and relevant ML/LLM frameworks.

Preferred Qualifications

- Experience evaluating generative AI applications and LLM outputs.
- Familiarity with frameworks such as LangChain or LlamaIndex.
- Exposure to ML experiment tracking and model lifecycle tools.
- Understanding of bias, explainability, reproducibility, and responsible AI practices.

📌 Data Scientist (Karnataka)
🏢 SWITS DIGITAL Private
📍 Karnataka