23 Aug
|
SourceFuse
|
Noida
We are looking for an experienced Databricks Lead Developer / Architect with 7+ years of experience in data engineering, cloud data platforms, and distributed data processing. The ideal
candidate will have strong hands-on expertise with Databricks, Apache Spark, Python, SQL, and contemporary data lake/lakehouse architectures, with the ability to lead technical design and
development initiatives.
Experience working with AWS cloud services and a Databricks certification will be an added advantage.
Preferred Location: Mohali/Noida
Key Responsibilities:
● Design and architect scalable, secure, and high-performance Databricks/Lakehouse solutions.
● Lead the development of enterprise-grade data engineering pipelines using Databricks, Apache Spark, Python, and SQL.
● Define technical architecture, development standards, best practices, and reusable frameworks.
● Design and implement data ingestion, transformation, integration, and processing pipelines.
● Work extensively with Delta Lake and develop optimized data models and lakehouse architectures.
● Optimize Spark and Databricks workloads for performance, scalability, reliability, and cost.
● Provide technical leadership and mentoring to data engineers and development teams.
● Collaborate with business stakeholders, data architects, analysts, and engineering teams to translate requirements into technical solutions.
● Implement data quality, validation, monitoring, logging, and error-handling frameworks.
● Design solutions for batch and, where applicable, streaming data processing.
● Establish CI/CD and deployment practices for Databricks workloads.
● Ensure solutions follow enterprise standards for security, governance, access control, and data management.
● Troubleshoot complex production issues and provide technical guidance to development teams.
● Evaluate new Databricks and cloud capabilities and recommend improvements to the data platform.
Skills & Experience:
● 7+ years of overall experience in data e
📌 Databricks Lead Developer (Noida)
🏢 SourceFuse
📍 Noida