01 Sep
|
Kani Solutions
|
Bengaluru
01 Sep
Kani Solutions
Bengaluru
Job Title: Sr Databricks Engineer
Location: Bengaluru, Karnataka (Onsite)
Hire Type: Permanent
Summary:
We are looking for a seasoned Senior Data Engineer with strong Databricks expertise to contribute to the expansion of our enterprise Databricks data platform. The selected candidate will focus on integrating additional datasets, engineering scalable data pipelines, and building new business dimensions and measures within the existing Databricks ecosystem.
Key Responsibilities:
Data Engineering & Development
- Architect and build scalable data pipelines leveraging Databricks and PySpark
- Connect and incorporate additional data sources into the existing Databricks Lakehouse environment
- Create and refine dimensional models, business dimensions, measures, and curated datasets for analytical use
- Prepare, transform, and optimize data to support reporting, analytics, and downstream applications
- Contribute to data quality initiatives, validation activities, monitoring, and performance tuning
- Investigate and resolve platform-related issues throughout the project.
Platform & Data Management
- Apply Databricks development, deployment, security, and governance best practices across solutions
- Use Unity Catalog to address data governance and access control requirements
- Build, package, and deploy solutions through Databricks Asset Bundles
- Work closely with the project team to convert business and technical requirements into scalable data solutions.
DevOps & Automation
- Establish and manage CI/CD workflows for data engineering components
- Use GitHub and/or GitLab to manage source code, branching approaches, and peer code reviews
- Contribute to automated deployment workflows and release management activities.
Required Skills:
- 8+ years of skilled experience in Data Engineering
- 4+ years of practical, hands-on experience with Databricks (required)
- Strong proficiency with:
- Databricks
- PySpark
- Python
- SQL
- Delta Lake
- Unity Catalog
- Databricks
📌 Sr Databricks Engineer (Bengaluru)
🏢 Kani Solutions
📍 Bengaluru