Roles and Responsibilities :

- Design, develop, test, deploy and maintain large-scale data pipelines using Data Bricks and PySpark.

- Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.

- Develop complex data models and ETL processes to extract insights from various sources into a centralized Data Lakehouse.

- Troubleshoot issues related to data quality, performance, and scalability in the pipeline.

- Design scalable Lakehouse solutions, optimize Spark workloads, build medallion architectures, mentor junior team members, and interact with customers.

Job Requirements :

- 3-8 years of experience in software development with expertise in Big Data technologies such as Data Bricks and PySpark.

- Strong understanding of data modeling concepts and ability to design effective ETL processes.

- Experience working with cloud-based platforms like AWS or Azure for deploying big data applications.

📌 Senior Developer (Pune)
🏢 R Systems International
📍 Pune