20 Aug
|
EXL
|
Pune Division
Job Description: Databricks Developer / Data Architect
Position Title
Databricks Developer / Data Architect
Location
Hybrid/ Remote
Employment Type
Full-Time / Contract
Job Summary
We are seeking an experienced Databricks Developer / Data Architect to design, implement, and optimize modern data platforms and ETL pipelines using Databricks and cloud-native technologies. The ideal candidate will have robust expertise in data architecture, Lakehouse implementation, Medallion Architecture, and scalable ETL development across Azure and AWS environments.
The role involves setting up Databricks workspaces, configuring data integrations and Lakehouse Federation, building enterprise-grade ETL workflows, and enabling high-performance analytics solutions.
Key Responsibilities
Data Architecture & Modeling
- Design and implement scalable enterprise data architectures using Databricks Lakehouse platform
- Configure and manage Databricks workspaces, clusters, access controls, and governance
- Implement Medallion Architecture (Bronze, Silver, Gold layers)
for data processing and analytics
- Set up and manage Lakehouse Federation and data connectors for multi-source integration
- Develop logical and physical data models for structured and semi-structured datasets
- Ensure data quality, security, scalability, and performance optimization
ETL Development
- Develop and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Databricks workflows
- Build reusable data ingestion frameworks for batch and streaming workloads
- Optimize Spark jobs for performance, cost efficiency, and reliability
- Integrate data from relational and NoSQL databases, cloud platforms, and external systems
- Automate deployment and monitoring of ETL workflows
Cloud & Platform Engineering
- Work with Azure and AWS cloud services to deploy and manage data solutions
- Configure integrations with Snowflake, Postgres, MongoDB, DynamoDB, Cloudera, and Domino Server
- Support CI/CD, infrastructur
📌 Databricks Developer (Pune Division)
🏢 EXL
📍 Pune Division