Job DescriptionRole: Sr Cloudera Developer (Data Engineer)Exp: 6 to 10 Years Location: Pune

Job Description:

- Proficiency in working with Spark
- Understanding of Spark's architecture and fault tolerance mechanisms
- Proficiency in using Spark Data Frames and Spark SQL for querying structured data
- Experience in optimizing Spark execution plan is a plus
- Skills in performing Extract, Transform, and Load (ETL) processes using Spark
- Experience with integrating Spark Streaming with other technologies like Kafka is an advantage
- Familiarity with the Hadoop ecosystem, including tools such as HDFS, Hive, Cloudera stack can be of advantage
- Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc
- Strong knowledge of Python; experience with Java is beneficial as well
- Dev Ops tools and practices: CI/CD, Docker
- Hands-on experience in GCP services: Dataproc, Cloud Function, Cloud Run, Pub/Sub, Big Query

Responsibilities and Duties:

- Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive
- Collaborate with data engineers to optimize data pipelines and data processing workflows.
- Work closely with data analysts and data scientists to ensure data quality and integrity.
- Troubleshoot and resolve issues with data processing and data storage systems.
- Stay up-to-date on the latest trends and best practices in Cloudera development
- Participate in code reviews and provide feedback to team members.

Qualifications and Skills:

- Bachelor’s degree in computer science, Information Technology, or a related field
- Proven experience as a Cloudera Developer or similar role




- Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive
- Experience with data modeling, data warehousing, and data integration.
- Strong programming skills in Java, Scala, or Python
- Excellent problem-solving and communication skills
- Ability to work independently and as part of a team.

Qualifications

Your Task

We are seeking a Sr Cloudera Developer (Data Engineer) to design, develop, and implement data solutions using Cloudera technologies. This role requires 6 to 10 years of experience and this position is based in Pune.

Responsibilities

- Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive
- Collaborate with data engineers to optimize data pipelines and data processing workflows
- Work closely with data analysts and data scientists to ensure data quality and integrity
- Troubleshoot and resolve issues with data processing and data storage systems
- Stay up-to-date on the latest trends and best practices in Cloudera development
- Participate in code reviews and provide feedback to team members
- Perform Extract Transform and Load (ETL) processes using Spark
- Deploy and manage Spark applications on a Hadoop cluster or on GCP Dataproc

Your Profile





We are seeking a highly skilled Sr Cloudera Developer (Data Engineer) with 6 to 10 years of experience, possessing robust expertise in Spark, Hadoop ecosystem, cloud technologies, and data engineering practices.

Must Have Skills

- 6 to 10 years of experience
- Proficiency in working with Spark
- Understanding of Spark's architecture and fault tolerance mechanisms
- Proficiency in using Spark Data Frames and Spark SQL for querying structured data
- Skills in performing Extract, Transform, and Load (ETL) processes using Spark
- Strong knowledge of Python
- Knowledge of Dev Ops tools and practices including CI/CD and Docker
- Hands-on experience in GCP services including Dataproc, Cloud Function, Cloud Run, Pub/Sub, and Big Query
- Bachelor's degree in Computer Science, Information Technology, or a related field
- Proven experience as a Cloudera Developer or similar role
- Solid understanding of Cloudera technologies such as Hadoop, Spark, and Hive
- Experience with data modeling, data warehousing, and data integration
- Strong programming skills in Java, Scala, or Python
- Excellent problem-solving skills
- Excellent communication skills
- Ability to work independently and as part of a team

Nice to Have Skills

- Experience in optimizing Spark execution plan
- Experience with integrating Spark Streaming with other technologies like Kafka
- Familiarity with the Hadoop ecosystem including tools such as HDFS, Hive, and Cloudera stack
- Experience with deploying and managing Spark applications on a Hadoop cluster or on GCP Dataproc
- Experience with Java

📌 Cloudera Developer (m/f/d) (India)
🏢 T Systems
📍 India