13 Nov
|
Kk group
|
Bengaluru
13 Nov
Kk group
Bengaluru
Job Description
Lead-Data Engineer.
•
Experience:
3-4 Years.
• Educational Qualification: Bachelors of Engineering/Computer Science/Data Analytics
• Certification & Licenses : Microsoft Data Engineer, Data Bricks
• Type: Full-time.
• Breadth of the Role – Global.
• Stakeholder Complexity – Discussing Requirements
• Role Type – Technical.
• Mode of Work: Hybrid (3 Days from office + 2 Days from Home). Job overview/Purpose of the Position: We are seeking a highly skilled and experienced Azure Data Engineer with deep expertise in Azure Databricks, Delta Lake, and the broader Azure data ecosystem. As a key member of our data engineering team, you will design, develop, and optimize scalable data pipelines, implement best-in-class data lakehouse architecture, and enable data-driven decision-making across the organization. You’ll be instrumental in transforming raw data into actionable insights and building the data infrastructure that powers advanced analytics, data science, and reporting use cases. Area of
responsibilities:
• Design, implement, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Develop and optimize data workflows using Delta Lake following the Medallion architecture (Bronze, Silver, Gold layers).
• Build and manage Databricks notebooks, clusters, and job workflows for data ingestion, transformation, and analytics.
• Integrate data from diverse sources (structured/unstructured) into the data lake and ensure data quality and consistency across layers.
• Implement data governance, quality checks, and lineage tracking using Databricks features and other Azure services.
• Collaborate with data Architects, Business Super Users, and BI Developers to support analytics and reporting requirements.
• Apply performance tuning, partitioning strategies, and caching for optimized query performance.
• Work with CI/CD pipelines using Azure DevOps or equivalent tools to ensure seamless deployment of data solutions.
• Ensure data security and compliance with company and regulatory standards. Competencies:
•
Experience:
Minimum of 3-4 years of experience in data engineering, with at least 3 years of hands-on experience with Azure Databricks and Delta Lake.
• Technical
Skills:
Proficiency in SQL, Python, and Spark.
• Strong understanding of Azure services, including Azure Data Factory, Azure Synapse Analytics, and Azure Storage.
• Problem-Solving: Excellent analytical and problem-solving skills.
• Ability to troubleshoot complex data issues. About KK Group : Building on more than 40 years of experience, KK Group is a leading systems supplier to the renewable energy industry. Our capabilities span developing state-of-the-art technologies, high-quality lean manufacturing, and adaptable aftermarket services. KK Group is owned by A.
P. Moller Holding, the parent company of the A.
P. Moller Group, established in 1904 by Arnold Peter Moller. We are a global and diverse team of over 4,000 people, working towards delivering products and services that enable a future powered by renewable energy. At KK Group, our culture and DNA are built on a foundation of can-do attitude and innovation. We actively foster an inclusive work environment that embraces diversity, rejects any form of discrimination, and provides equal opportunities for all people. Our commitment lies in cultivating a strong culture centred around health, safety, wellbeing, and effective teamwork. Why Us ? No matter your role, you will find yourself immersed in our strategy. At KK, all employees are encouraged to contribute their ideas – we want everyone to feel involved and heard. Our flat hierarchies allow us to make swift decisions and exchange ideas in an open, honest atmosphere where we help each other succeed. What is more, you will be collaborating across several functions and you will experience a distinct team spirit as you work with international colleagues from all over the world.
📌 Lead- Data Engineer (Bengaluru)
🏢 Kk group
📍 Bengaluru