10 Aug
|
Persistent Systems
|
Pune
10 Aug
Persistent Systems
Pune
About Position:
We are looking for an experienced Databricks Architect who can build, optimize, and maintain scalable data pipelines on the Databricks platform.
Role: Databricks Architect
Location: Pune
Experience: 12+ years
Job Type: Full-Time Employment
What You'll Do:
Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).
Design end‑to‑end Lakehouse architecture including ingestion, transformation, modeling, and consumption.
Define and implement Medallion Architecture (Bronze/Silver/Gold) using Delta Lake.
Build high-performance ETL/ELT pipelines using PySpark, Spark SQL, Delta Lake.
Architect and optimize batch and streaming data pipelines.
Perform advanced Spark optimization, cluster sizing, and cost management.
Implement CI/CD, version control, and DevOps best practices within Databricks.
Expertise You'll Bring:
Advanced expertise in:
Strong understanding of:
Databricks Lakehouse Platform
PySpark & Spark SQL
Delta Lake, Structured Streaming
Unity Catalog & governance frameworks
Strong experience with a major cloud platform (Azure/AWS/GCP).
Distributed computing & Spark internals
Data warehousing concepts
Data modeling (dimensional, normalized, Lakehouse modeling)
ETL/ELT architecture
Experience in CI/CD pipelines, Git, orchestration tools.
Experience in leading large‑scale data platform implementations.
Benefits:
Competitive salary and benefits package
Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
Opportunity to work with cutting-edge technologies
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Setting:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We
📌 Databricks Architect (Pune)
🏢 Persistent Systems
📍 Pune