Job Purpose
Responsible for analyzing, transforming, and deriving insights from large-scale data using Databricks and up-to-date data stack technologies. Designs and executes data pipelines using SQL and PySpark on Databricks, leveraging Unity Catalog for data governance and management. Collaborates with cross-functional teams to build data models, perform exploratory analysis, and deliver actionable insights. Optimizes queries on SQL Warehouses, integrates external APIs where needed, and ensures data quality and reliability across workflows.Duties and Responsibilities
• Develop, maintain, and optimize scalable data pipelines using Databricks (PySpark and SQL).
• Perform data extraction, transformation, and loading (ETL/ELT) for large and complex datasets.
• Analyse data to generate actionable insights supporting business decision-making.
• Design and manage data models and curated datasets within Unity Catalog.
• Ensure data quality, consistency, and reliability through validation and monitoring frameworks.




• Optimize query performance on SQL Warehouses for faster analytics and reporting.
• Collaborate with business stakeholders to understand requirements and translate them into data solutions.
• Integrate and process data from multiple sources, including APIs and external systems.
• Create dashboards, reports, and visualizations to communicate insights effectively.
• Document data processes, workflows, and metadata to support governance and reproducibility.Key Decisions / Dimensions
• Selection of appropriate data models, pipeline design, and transformation logic to meet business requirements efficiently.
• Optimization strategies for query performance, compute usage, and cost on Databricks SQL Warehouses and Spark workloads.
• Choice of data sources, integration approaches, and data quality rules to ensure reliable and governed datasets.|Individual Contributor role. Scope includes multiple data sources and domains across environments (dev/qa/prod).Major Challenges
•

📌 Data Analyst (Pune)
🏢 Bajaj Finance
📍 Pune