19 Sep
|
GyanSys
|
Bengaluru
- Lead Databricks Development:
Lead the design, development, and implementation of scalable data engineering solutions using
Databricks
, ensuring high-quality and reliable data pipelines for enterprise and semiconductor/manufacturing use cases.
- Technical Leadership:
Provide technical leadership to a team of data engineers, guide day-to-day development activities, conduct code/design reviews, resolve technical challenges, and ensure adherence to engineering best practices.
- Strong SQL Expertise:
Demonstrate strong hands-on expertise in
SQL
, including complex joins, CTEs, subqueries, window functions, aggregations, data transformation, performance tuning, and troubleshooting of complex queries.
- Databricks &
- Data Engineering:
Strong working knowledge of
Databricks, PySpark, Delta Lake, notebooks, workflows/jobs, data transformation, and ETL/ELT concepts
. Should be comfortable remaining hands-on while leading the team.
- Client &
- Stakeholder Management:
Act as a key technical point of contact for client stakeholders. Independently participate in discussions with business and technical teams, understand their requirements, ask the right questions, and provide clear technical perspectives and solutions.
- Requirement Gathering &
- Translation:
Work closely with business stakeholders to understand data requirements and translate business problems into technical requirements, data models, transformation logic, and actionable development tasks for the engineering team.
- Communication &
- Confidence:
Excellent verbal and written communication skills with the confidence to lead discussions with senior client stakeholders. Should be able to explain complex technical concepts in a easy and business-friendly manner and confidently challenge or clarify requirements when required.
- Semiconductor / Manufacturing Data:
Experience working with semiconductor, manufacturing, supply chain, equipment, production, quality, or other industrial data is preferred. Exposure to high-volume, complex, and time-series manufacturing datasets will be an advantage.
- Data Quality &
- Performance:
Ensure data quality, reliability, scalability, and performance across pipelines. Troubleshoot data issues, identify root causes, and work with relevant teams to implement sustainable solutions.
- Ownership &
- Delivery:
Take end-to-end ownership of assigned data engineering initiatives, including requirement clarification, technical design, task allocation, development oversight, stakeholder communication, delivery tracking, and production support. Should be capable of managing multiple priorities and coordinating a sizeable engineering team
.
📌 Lead Databricks Developer (Bengaluru)
🏢 GyanSys
📍 Bengaluru