Job Title: Lead Data Engineer
Location: Marathahalli, Bangalore
Job Mode: Hybrid
Key Responsibilities:
· Create and maintain data sources inside our data lake on Azure
· Assemble and analyze large, complex data sets that meet both functional and non-functional business requirements
· Identify, design, and implement internal process improvements: automating manual processes; optimizing data delivery; re-designing infrastructure for greater scalability.
· Work with stakeholders including the Executive, Tech, Product, Data and Design teams to optimize data driven decisions
· Keep our data separated and secure by understanding and applying best practice access policies
· Create tools for analytics and data scientist team members that assist them in building and optimizing our product into an creative industry leader
· Ensure data integrity with thorough data quality test coverage and data validation
· Improve, create and implement CI/CD processes and tooling inside the data lake
Required Qualifications
Join immediately
Databricks
Databricks hands on experience (esp. Pipelines PySpark & SQL, Delta Lake, Unity Catalog, DLT*)
Ingesting & transforming data using Databricks - Min 3 years continuous hands-on
Advanced SQL and Python knowledge
Data Lake housing and Modelling experience (e.g. medallion architecture & query performance optimization)
Experience with backend systems ERP, CRM (e.g. SAP, Oracle, Salesforce)
Exposure of working with Azure (ADLS, ADF)
Valuable Communication skills
Skills:- Microsoft Azure, Azure Databricks, PySpark, Azure Data Factory and Data modeling
📌 Lead Azure Data Engineer Bengaluru
🏢 VDart Digital
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.