HI,

Greetings for the day !!!

We at HCL are looking Data Engineers with exp Apache Spark Scala and Big Data

Location: Chennai

If interested reach us on [email protected]

Provide us the details below:

Total years of exp:

Exp in Apache:

Exp in Spark:

Exp in Scala/Python:

Current CTC:

Expected CTC:

Notice Period:

Current location:

Preferred location:

Detailed Responsibilities

- Lead technical teams in designing, developing, and implementing solutions using Apache Spark, Scala, and Python, ensuring robust, scalable, and optimized data pipelines.
- Provide technical expertise and guidance to resolve complex issues, optimize Spark applications, and enhance overall system performance.
- Collaborate with stakeholders to gather requirements, define project scope, and ensure alignment with business objectives, translating business needs into technical solutions.
- Oversee the adoption of best practices in coding, testing, and deployment for robust and maintainable solutions, including managing the full software development lifecycle in an Agile environment.
- Conduct code reviews, performance tuning, and optimization activities to maximize efficiency, reliability, and scalability of data processing jobs.
- Troubleshoot, debug, and resolve technical challenges related to Spark jobs, data pipelines, and big data infrastructure to ensure seamless operations and timely delivery.
- Stay abreast of industry trends, emerging technologies, and advancements in Apache Spark, Scala, Python, and big data ecosystems to continuously improve technical solutions.




- Mentor and facilitate knowledge sharing within the technical team, fostering growth, skill development, and best practices in big data engineering.
- Own end-to-end data pipeline development, including deep SQL, data modeling, and managing deployment in production environments, ensuring data quality and integrity.

Skill Requirements
- Solid proficiency and hands-on experience in developing, optimizing, and maintaining applications and data pipelines using Apache Spark.
- Deep understanding of Scala programming, with practical experience designing and implementing solutions in big data contexts.
- Expertise in building and deploying scalable data solutions using Python, including integration with Spark and other big data tools.
- Expertise in writing complex SQL queries, designing data models, and managing big data storage and retrieval efficiently.
- Proven track record of leading technical teams, managing projects, and providing guidance in a collaborative environment.
- Solid grasp of the software development lifecycle, Agile methodologies, and best practices in coding, testing, and deployment.
- Experience in performance tuning, optimization, and troubleshooting Spark jobs and data pipelines to resolve bottlenecks and improve efficiency.
- Excellent problem-solving, critical thinking, communication, and interpersonal skills.
- Bachelors or Master’s degree in Computer Science, Engineering, or related field.
- Relevant certifications in Apache Spark, Scala, or Python are preferred.

📌 Apache Spark Scala Engg_Chennai_10+ years -17 years_Early joiners (Chennai)
🏢 HCLTech
📍 Chennai