Role description

Job Summary

Seeking a Senior Specialist with 7 to 11 years of experience skilled in Python SparkSQL Apache Spark and Java to develop and optimize big data solutions within the DatabricksSparkSQLScalaPythonJava ecosystem

Develop and maintain scalable and productive big data applications using Python Java and Apache Spark Design and implement SparkSQL queries and data pipelines for largescale data processing Collaborate with data engineers and data scientists to integrate data processing workflows Write clean reusable and optimized code following best practices and coding standards Leverage the Databricks platform to deploy and manage Spark jobs and clusters Stay updated with emerging trends and advancements in big data technologies and the Hadoop ecosystem Participate in continuous improvement initiatives to enhance development processes and application performance Utilize knowledge of Angular and Big Data Hadoop Ecosystem as additional assets to support crossfunctional projects

Roles and Responsibilities

Design develop and deploy scalable SparkSQLbased data processing solutions aligned with business requirements

Optimize Spark jobs for performance tuning and resource efficiency

Collaborate with crossfunctional teams to gather and analyze requirements for big data applications

Mentor and provide technical guidance to junior developers on Python Java and Spark best practices

Participate actively in Agile ceremonies including sprint planning daily standups and retrospectives

Conduct unit testing and support integration testing to ensure software quality

Troubleshoot debug and resolve issues in existing Sparkbased applications

Assist in managing Databricks clusters and Spark job deployments

📌 Senior Specialist - Data Engineering (Pune)
🏢 LTM
📍 Pune