13 Aug
|
Persistent Systems
|
Pune City
13 Aug
Persistent Systems
Pune City
About Position:
We are looking for an experienced Databricks Developer who can build, optimize, and maintain scalable data pipelines on the Databricks platform.
- Role: Databricks Developer
- Location: Pune
- Experience: 5+ years
- Job Type: Full Time Employment
What You'll Do:
- Develop and maintain ETL/ELT pipelines using Databricks (PySpark, SQL, Notebooks).
- Implement data processing workflows across bronze, silver, and gold layers using Delta Lake.
- Build and optimize batch and streaming pipelines using Structured Streaming.
- Perform Spark performance tuning, job optimization, and cost optimization.
- Collaborate with data architects, analysts, and business teams to deliver scalable data solutions.
- Ensure data quality, data validation, and adherence to governance policies.
- Integrate Databricks with cloud-native services (Azure/AWS/GCP).
- Use Git and follow CI/CD best practices for code versioning and deployment.
- Troubleshoot issues in data jobs, environments, and clusters.
Expertise You'll Bring:
- Experience with cloud platforms (Azure/AWS/GCP — as per need).
- Solid understanding of data warehousing, ETL design patterns, and distributed systems.
- Hands‑on experience with cluster management and job scheduling.
- Solid debugging and performance optimization skills.
- Proficiency with Git, DevOps practices, and CI/CD pipelines.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the
📌 Databricks Developer (Pune City)
🏢 Persistent Systems
📍 Pune City