Seeking a Senior qualified with 3 to 5 years of experience in Apache Spark and SparkSQL to design develop and optimize scalable big data processing solutions within the Hadoop and Spark ecosystem
Develop and maintain scalable data processing pipelines using Apache Spark and SparkSQL Analyze large datasets to extract meaningful insights supporting datadriven decision making Collaborate with crossfunctional teams to integrate big data solutions into existing systems Optimize Spark jobs for performance and efficiency in distributed computing environments Ensure data quality and consistency across various data sources Utilize Java programming skills to enhance Spark applications and implement custom transformations Stay updated with the latest advancements in Hadoop Spark SparkSQL and related technologies to continuously improve data processing capabilities
Roles and Responsibilities
Design develop and deploy complex data processing workflows leveraging Apache Spark and SparkSQL Write efficient reusable and maintainable code for Spark applications using Java Troubleshoot and resolve performance bottlenecks in Spark jobs and data pipelines Collaborate with data engineers data scientists and stakeholders to translate business requirements into technical solutions Conduct code reviews and provide mentorship to junior team members on best practices and coding standards Participate in architectural discussions and contribute to the evolution of big data platforms Monitor and maintain the health availability and reliability of Spark clusters and data services
Karat interview Mandate
Job Location – Pune & Chennai
📌 Pyspark + SQL - Developer (Pune)
🏢 LTM
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.