About Position:

We are seeking a highly skilled Senior Databricks Data Engineer with solid expertise in Databricks, PySpark, Python, SQL, and AI-powered analytics solutions. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines, implementing up-to-date Lakehouse architectures, and leveraging Databricks AI capabilities such as Genie to enable intelligent data access and business insights.

• Role: Senior Databricks Data Engineer
• Location: All Persistent Locations
• Experience: 9 to 11 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain scalable data pipelines using Databricks, PySpark, and Python.
• Build and optimize batch and real-time data processing frameworks.
• Develop robust ETL/ELT solutions for ingesting, transforming, and processing structured and unstructured data.
• Implement data quality, validation, reconciliation, and monitoring frameworks.
• Develop reusable components, standards, and best practices for data engineering projects.
• Ensure scalability, reliability,



and performance across enterprise data platforms.
• Design and implement up-to-date Databricks Lakehouse architectures.
• Work with Delta Lake, Unity Catalog, Databricks Workflows, and Databricks SQL.
• Optimize Spark jobs and cluster performance for large-scale data workloads.
• Implement enterprise-grade security, governance, and access controls within the Databricks ecosystem.
• Support platform modernization and continuous optimization initiatives.
• Develop conversational analytics and AI-driven data solutions using Databricks Genie.
• Enable business users to interact with enterprise data using natural language queries.
• Integrate Databricks AI capabilities to enhance self-service analytics and business intelligence.
• Collaborate with business teams to identify and develop AI-driven use cases.
• Build AI-assisted reporting, analytics, and decision-support solutions.
• Support Generative AI and intell

📌 Senior Databricks Data Engineer Pune
🏢 Persistent Systems
📍 Pune