Job Description – Azure Databricks & GenAI DeveloperPosition: Azure Databricks & GenAI Developer

Experience: 3–6 Years

About the Role

We are looking for an experienced Azure Databricks & GenAI Developer with strong hands-on expertise in Azure Databricks, Generative AI, AIDLC (AI Development Life Cycle), and SQL.

The ideal candidate will be responsible for developing scalable data and AI solutions using Azure Databricks, building and integrating Generative AI applications, and following AIDLC practices from experimentation and development through deployment and monitoring.

Key Responsibilities

- Design, develop, and maintain scalable data and AI solutions using Azure Databricks.
- Develop and optimize data processing workflows using Databricks, Spark, and SQL.
- Work with structured and unstructured data to support AI/ML and GenAI use cases.
- Design and implement Generative AI solutions for enterprise business requirements.
- Apply AIDLC (AI Development Life Cycle) principles across AI solution development.
- Develop, test, deploy, and maintain GenAI applications and AI-powered services.
- Build data pipelines and transformation workflows within Azure Databricks.
- Write complex and optimized SQL queries for data extraction, transformation, analysis, and reporting.
- Work with data scientists, data engineers, software developers, and business stakeholders to deliver AI solutions.
- Perform data preparation, cleansing, transformation, and validation for GenAI and AI/ML applications.
- Optimize Databricks jobs, notebooks, queries, and data processing workloads for performance and scalability.
- Integrate GenAI capabilities into existing enterprise applications and workflows.
- Implement appropriate testing, monitoring, documentation, and deployment practices throughout the AIDLC.
- Troubleshoot data, Databricks,



and GenAI application issues.
- Ensure solutions follow security, scalability, reliability, and maintainability standards.
- Stay updated with emerging Generative AI, Azure, Databricks, and AI engineering technologies.

Required Technical SkillsAzure Databricks

- Strong hands-on experience with Azure Databricks.
- Experience developing Databricks notebooks and workflows.
- Good understanding of Apache Spark and distributed data processing.
- Experience with data transformation and processing using Databricks.
- Knowledge of Databricks performance optimization.
- Understanding of Delta Lake and lakehouse concepts is preferred.

Generative AI

- Hands-on experience developing or implementing Generative AI solutions.
- Understanding of LLM-based applications and AI-powered workflows.
- Experience with prompt engineering and LLM integration.
- Knowledge of RAG (Retrieval-Augmented Generation) is preferred.
- Understanding of embeddings and vector databases is an advantage.
- Experience integrating GenAI APIs/models into enterprise applications is a plus.

AIDLC – AI Development Life Cycle

- Understanding of the AI Development Life Cycle (AIDLC).
- Experience across AI solution development stages including:
- Requirement analysis
- Data preparation
- AI/ML/GenAI development
- Testing and validation
- Deployment
- Monitoring and optimization
- Continuous improvement
- Ability to follow structured development and deployment practices for AI solutions.





SQL

- Strong proficiency in SQL.
- Experience writing complex queries, joins, subqueries, CTEs, and aggregations.
- Data extraction, transformation, validation, and analysis.
- Query performance optimization.
- Experience working with large datasets.

Preferred Skills

- Azure Cloud experience.
- Python programming.
- PySpark / Apache Spark.
- Delta Lake.
- Azure Data Lake Storage (ADLS).
- Azure OpenAI / LLM platforms.
- RAG architecture.
- LangChain, LlamaIndex, or similar GenAI frameworks.
- Vector databases.
- REST APIs and microservices.
- Git/GitHub/Azure DevOps.
- CI/CD pipelines.
- Databricks Workflows.
- Data engineering and lakehouse architecture.

Educational Qualifications

- Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, Artificial Intelligence, Engineering, or a related field.
- Relevant certifications in Azure, Databricks, AI/ML, or Generative AI will be an advantage.

Experience

- 3–6 years of experience in Data Engineering, AI/ML, Software Engineering, or a related field.
- Strong hands-on experience with Azure Databricks.
- Practical experience with Generative AI solutions.
- Strong SQL and data processing experience.
- Experience working in AI development and production environments.

Key Competencies

- Strong analytical and problem-solving skills.
- Good understanding of data and AI engineering concepts.
- Ability to design scalable Databricks solutions.
- Strong interest and hands-on capability in Generative AI.
- Understanding of the complete AI development lifecycle.
- Solid SQL and data analysis skills.
- Good communication and collaboration skills.
- Ability to work independently and take ownership of AI/data initiatives.

Work Location: Remote

📌 Azure Databricks, Gen AI, AIDLC, SQL (India)
🏢 WebSenor InfoTech
📍 India