06 Aug
|
Weekday AI
|
Pune
This role is for one of the Weekday's clients
Salary range: Rs 1500000 - Rs 2700000 (ie INR 15- 27 LPA)
Min Experience: 5+ years
Location: Pune
JobType: full-time
We are looking for an experienced Data Bricks Engineer with 5–13 years of experience in designing, building, and optimizing scalable data engineering solutions. The ideal candidate will have solid expertise in Azure Databricks and ETL development, with hands-on experience in building high-performance data pipelines that enable advanced analytics and business intelligence.
In this role, you will collaborate closely with data architects, analysts, software engineers, and business stakeholders to develop robust data platforms capable of processing large-scale structured and unstructured datasets. You will be responsible for ensuring data quality, reliability, scalability, and performance while implementing modern cloud-based data engineering best practices.
Key Responsibilities
Design, develop, and maintain scalable data pipelines using Azure Databricks.
Build efficient ETL workflows for extracting, transforming,
and loading data from multiple enterprise data sources.
Develop batch and incremental data processing solutions to support reporting, analytics, and machine learning workloads.
Optimize Databricks jobs, notebooks, and Spark applications for maximum performance and cost efficiency.
Implement data validation, cleansing, and transformation processes to ensure high-quality datasets.
Work with business stakeholders to understand data requirements and translate them into technical solutions.
Integrate data from databases, APIs, cloud storage, and third-party applications into centralized data platforms.
Monitor data pipelines, troubleshoot failures, and proactively resolve performance bottlenecks.
Collaborate with cross-functional teams to implement secure, scalable, and reliable cloud data architectures.
Participate in code reviews, technical discussions, and knowledge-sharing sessions to promote enginee
📌 Data Bricks Engineer (Pune)
🏢 Weekday AI
📍 Pune