20 Aug
|
Arrow Point Management Services
|
Bengaluru
20 Aug
Arrow Point Management Services
Bengaluru
We are looking for an experienced Databricks Developer with strong hands-on expertise in Databricks and Databricks Genie. The ideal candidate should have experience building AI-powered data applications, creating conversational analytics solutions using Genie, and developing scalable data engineering solutions within the Databricks ecosystem.
Key Responsibilities
- Design, develop, and maintain data solutions using Databricks.
- Build applications leveraging Databricks Genie for conversational analytics and business user interaction.
- Create AI-enabled apps using Genie integrated with enterprise datasets.
- Develop and optimize notebooks using PySpark and SQL.
- Design scalable ETL/ELT pipelines within the Databricks Lakehouse platform.
- Collaborate with Data Engineers, Data Scientists, and Business stakeholders to deliver analytics solutions.
- Implement data models, transformations, and data quality validations.
- Integrate Databricks workflows with cloud storage and external data sources.
- Optimize performance of Spark jobs and Databricks workloads.
- Support deployment, testing, and maintenance of Databricks-based applications.
- Ensure best practices for security, governance, and scalable data architecture.
Mandatory Skills
- Strong hands-on experience with Databricks.
- Experience working with Databricks Genie.
- Experience creating applications using Genie.
- Proficiency in PySpark and Spark SQL.
- Strong SQL development skills.
- Experience with Databricks notebooks, workflows, and job scheduling.
- Understanding of Delta Lake and Lakehouse architecture.
- Experience building ETL/ELT pipelines.
- Knowledge of data modeling and performance optimization.
- Good understanding of REST APIs and application integration is preferred.
Preferred Skills
- Experience with Azure Databricks or AWS Databricks.
- Knowledge of Unity Catalog and Databricks governance.
- Exposure to Generative AI and LLM-based enterprise applications.
- Experience developing data visualization or analytics applications.
- Python programming beyond PySpark.
- CI/CD knowledge for Databricks deployment.
Experience
3–8+ years of relevant experience in Data Engineering / Databricks Development.
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
Keywords for sourcing
Databricks Developer, Databricks Engineer, Azure Databricks, Databricks Genie, Genie Apps, PySpark Developer, Spark SQL, Delta Lake, Lakehouse, Data Engineer, Generative AI Databricks, Databricks AI Applications, Unity Catalog.
ChatGPT
Option 2
Job Description: Databricks Genie / AI Application Developer
Job Title: Databricks Genie / AI Application Developer
Experience: 3–8 Years
Location: [Location]
Employment Type: Full-time
Job Overview
We are looking for a skilled Databricks Developer with hands-on experience in Databricks Genie and building AI-powered data applications. The ideal candidate should have strong expertise in the Databricks ecosystem, data engineering, SQL, Python, and the ability to create user-friendly applications leveraging Databricks Genie.
Key Responsibilities
- Develop and implement data and AI solutions using the Databricks platform.
- Work hands-on with Databricks Genie to create and configure intelligent data experiences.
- Build applications and conversational interfaces using Genie capabilities.
- Enable users to interact with enterprise data using natural language queries.
- Create and optimize data pipelines using PySpark, Python, and SQL.
- Develop and manage Databricks notebooks, workflows, and jobs.
- Work with Delta Lake and Databricks SQL for data transformation and analytics.
- Design semantic layers and prepare datasets to support Genie-based applications.
- Integrate Databricks applications with enterprise data sources and downstream systems.
- Ensure data quality, performance, security, and scalability.
- Collaborate with Data Engineers, Data Scientists, AI/ML teams, and business stakeholders.
- Troubleshoot and optimize Databricks workloads and applications.
- Participate in solution design, development, testing, deployment, and production support.
Mandatory Skills
- Strong hands-on experience with Databricks.
- Experience working with Databricks Genie.
- Experience creating applications or solutions using Databricks Genie.
- Solid knowledge of SQL and Python/PySpark.
- Experience with Databricks SQL and Delta Lake.
- Understanding of data engineering and ETL/ELT processes.
- Experience developing and optimizing Spark jobs.
- Knowledge of Databricks notebooks, workflows, and job scheduling.
- Understanding of cloud platforms such as Azure, AWS, or GCP.
- Experience working with REST APIs and application integrations.
- Strong problem-solving and analytical skills.
Preferred Skills
- Experience with Generative AI and LLM-based applications.
- Knowledge of Databricks AI/BI capabilities.
- Experience with Unity Catalog and Databricks security/governance.
- Experience with MLflow.
- Knowledge of RAG, Vector Search, or AI agent-based applications.
- Experience developing web applications using Streamlit or similar frameworks.
- Databricks certification will be an added advantage.
Experience
- Overall Experience: 5–8 years
- Relevant Databricks Experience: Minimum 2+ years
- Databricks Genie Experience: Hands-on experience is mandatory
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
Key Requirement: The candidate must have practical experience working with Databricks Genie and creating business applications or AI-powered solutions using Genie, along with strong Databricks, SQL, Python, and PySpark expertise.
📌 Databricks (Bengaluru)
🏢 Arrow Point Management Services
📍 Bengaluru