JOB SUMMARY

We are seeking an experienced Data Engineer with robust hands-on Databricks expertise to support the design, development, and optimization of enterprise data solutions. The successful candidate will have deep experience building and maintaining ELT pipelines using native Databricks orchestration, working with large-scale data platforms, and applying contemporary data architecture principles.

JOB RESPONSIBILITIES
Design, develop, and maintain ELT pipelines using Databricks and related technologies.
Build and optimize large-scale data processing workflows using PySpark and SQL.
Orchestrate multi-stage data pipelines using Databricks Workflows and Jobs, and develop Delta Live Tables (DLT) pipelines with built-in data quality enforcement.
Develop and manage data models to support analytics, reporting, and business intelligence requirements.
Implement and support data Lakehouse architectures and data warehousing solutions.
Collaborate with data analysts, architects, and business stakeholders to understand and deliver on data requirements.
Ensure data quality,



integrity, and governance across all data platforms.
Monitor and troubleshoot data workflows, pipeline performance, and platform issues.
Contribute to continuous improvement of data engineering standards and practices.

REQUIRED TECHNICAL SKILLSET
Strong hands-on experience with Databricks (Delta Lake, Databricks Workflows, Unity Catalog)
Robust hands-on experience with Databricks-native orchestration (Databricks Workflows, Jobs) as the primary mechanism for multi-stage pipeline orchestration and scheduling
Experience with Delta Live Tables (DLT) for pipeline development and expectation-based data quality enforcement
Proven experience building and supporting ELT pipelines at scale
Solid proficiency in PySpark and SQL
Experience with data modeling techniques and best practices
Good understanding of data Lakehouse architecture and data warehousing concepts
Experience with ver

📌 Data Engineer Karnataka
🏢 DysrupIT
📍 Karnataka