19 Nov
|
Trigent Software
|
Bengaluru
19 Nov
Trigent Software
Bengaluru
We are seeking a skilled Databricks Developer with strong expertise in designing, developing, and optimizing modern data solutions on the Databricks platform. The ideal candidate will have hands-on experience across data engineering, pipeline development, data modeling, visualization, governance, and DevOps practices.
Key Responsibilities
• Design, build, and maintain scalable data solutions using the Databricks platform.
• Develop and optimize batch and streaming data pipelines using Apache Spark, Python, and SQL.
• Implement modern data pipelines using Spark Declarative Pipelines (SDP), including streaming tables, materialized views, and embedded data quality rules.
• Apply ETL design patterns and best practices for robust and efficient data processing.
• Design and manage data models using medallion architecture, dimensional modeling, and Delta Lake optimization techniques.
• Create and maintain dashboards and visualizations using Databricks SQL, Lakeview dashboards, notebook charting libraries, and BI tools such as Power BI and Tableau.
• Manage Databricks workspaces, cluster configurations, notebooks, and Unity Catalog for secure and governed data access.
• Implement CI/CD pipelines, job orchestration using Lakeflow Jobs,
and deployment automation with Asset Bundles.
• Ensure compliance with governance and security standards through Unity Catalog permissions, row/column-level security, and audit logging.
• Collaborate with cross-functional teams to deliver high-quality, scalable, and secure data solutions.
Required Skills &
Qualifications:
• Strong knowledge of Databricks platform fundamentals, including workspaces, clusters, notebooks, and Unity Catalog.
• Proficiency in Python, SQL, and Apache Spark (batch and streaming).
• Hands-on experience with Delta Lake and contemporary ETL/data engineering design patterns.
• Experience with Spark Declarative Pipelines (SDP).
• Good understanding of data modeling techniques, including medallion architecture and dimensional modeling.
• Experience in developing dashboards and reports using Databricks SQL, Lakeview, Power BI, or Tableau.
• Familiarity with DevOps practices, including CI/CD and deployment automation.
• Knowledge of data governance and security concepts within Databricks.
Preferred
Skills:
• Experience with MLflow, Terraform, and REST APIs.
• Exposure to cloud platforms such as AWS, Azure, or GCP.
📌 Databricks Developer (Bengaluru)
🏢 Trigent Software
📍 Bengaluru