13 Oct
|
Blue Cloud Softech Solutions
|
India
13 Oct
Blue Cloud Softech Solutions
India
Job Title: Lead Data Engineer (DBT & Databricks)
Experience Required:5-7 Years
Location: Mumbai(Remote)
Job Summary
We are seeking an experienced and highly motivated Lead Data Engineer with strong expertise in Databricks, DBT (Data Build Tool), and modern cloud-based data platforms. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, leading data engineering initiatives, mentoring team members, and collaborating with business stakeholders to deliver reliable and high-quality data solutions.
Key Responsibilities
· Lead the design and development of scalable data engineering solutions using Databricks and DBT.
· Build and maintain robust ETL/ELT pipelines for data ingestion, transformation, and integration.
· Develop reusable and efficient DBT models, tests, and documentation.
· Optimize Databricks workloads for performance, scalability, and cost efficiency.
· Collaborate with business analysts, architects, and product owners to understand data requirements.
· Establish data quality, governance, and monitoring frameworks.
· Perform code reviews and enforce data engineering best practices.
· Mentor and guide junior data engineers and promote knowledge sharing across the team.
· Troubleshoot production issues and drive root-cause analysis.
· Participate in architecture discussions and contribute to long-term data strategy.
Required Skills
Technical Skills
· Strong hands-on experience with Databricks.
· Experience with DBT (Data Build Tool) for data transformation.
· Advanced SQL development and query optimization.
· Solid Python programming skills.
· Experience with Spark SQL, PySpark,.
· Knowledge of Data Warehousing concepts and dimensional modeling.
· Experience working with cloud platforms such as:
o Azure (Preferred)
o AWS
· Experience with Delta Lake, Data Lake, and Lakehouse architecture.
· Knowledge of CI/CD processes and DevOps practices.
· Experience with Git and version control tools.
Preferred Skills
· Experience with Azure Data Factory (ADF).
· Knowledge of DevOps and Agile methodologies.
· Understanding of data governance and data quality frameworks.
Leadership Responsibilities
· Lead a small to medium-sized data engineering team.
· Drive technical design discussions and architectural decisions.
· Ensure timely delivery of project milestones.
· Coordinate with stakeholders and client teams.
· Support project planning, estimation, and resource allocation.
· Promote coding standards, documentation, and operational excellence.
Qualifications
· 5-7 years of experience in Data Engineering.
· Minimum 2+ years of hands-on experience with Databricks.
· Minimum 4+ years of experience with DBT implementation and deployment.
Nice to Have
· Databricks Certification.
· Azure Data Engineer Associate Certification.
· Experience working in large-scale enterprise data modernization projects.
· Experience migrating legacy ETL solutions to modern cloud platforms.
📌 Lead Data Engineer (DBT & Databricks) (India)
🏢 Blue Cloud Softech Solutions
📍 India