We use cookies for the best user experience on our website, including to personalize content & offerings, to provide social media features and to analyze traffic. By clicking “Accept All Cookies” you agree to our use of cookies. You can also manage your cookies by clicking on the "Cookie Preferences" and selecting the categories you would like to accept. For more information on how we use cookies please visit our and Modify Cookie Preferences

Reject All Cookies Accept All Cookies

Senior Apache Spark Technical Lead - Scala, Python

India

Job Description

Senior Apache Spark Technical Lead - Scala, Python

Chennai, Tamil Nadu

Job Summary

Responsibilities:Provide thought leadership, engineering expertise and direction to the engineering teams; be versatile and be able to collaborate with business stakeholders, product teams and cross functional technology groups to drive continuous delivery.Drive user story analysis and elaboration, design and develop software applications, and test and build automation tools.Own all technical aspects of software development (architecture, design, and development of systems) for assigned applications.Perform hands-on software development, writing code, API specs, doing proof of concepts, conducting code reviews, and testing in ongoing sprints.Drive consistent development practices - tools and common components.Develop deep understanding of tie-ins with other systems and platforms within the supported domains.Work with technical product managers contributing to blueprints and assisting with annual planning of feature sets.Identify opportunities for adopting new technology to solve existing needs and predicting future challenges.Effectively communicate to internal and external business partners on solution design.Functional SkillsStrong analytical & strategic thinking skillsAbility to interpret technical /business objectives and challenges.Porting/Software ConfigurationAgile MethodologiesSoftware development/ testingObject oriented analysis and design across multiple platforms.Designing High Availability applicationsPreferred:·Product Engineering KnowledgeMinimum QualificationsBachelor's Degree in Computer Science, Computer Science Engineering, or related field required; advanced degree is preferred.Preferred Qualifications4+ years of commercial software development experienceProficient in developing, hosting solutions on Google Cloud Platform- Google Cloud Storage and Big Query. ·Hands-on experience on Big Data platforms (Scala/Spark/Hive SQL) and Big Data Lake. ·Experience and proficiency in ETL (Extract, Transform, Load) processes and tools and data modelling in Big Data platform. ·Proficiency in Secure File Transfer (SFT) operations and its utilization in data management.Experience with Agile development, Continuous Integration, and Continuous Delivery, including working knowledge of various tools in the CI/CD pipeline.Experience with automated release management using Maven, Salt, Git, JenkinsExperience in Architecture design and modeling should possess strong skills in designing and modeling complex systems and architectures.Good understanding of web technologies (HTTP, Apache) and familiarity with Unix/LinuxGood understanding of data structures, algorithms,



and design patternsGreat written communication and documentation abilitiesLooks proactively beyond the obvious for continuous improvement opportunities.Leadership and communication: lead teams and collaborate with stakeholders, so strong leadership and communication skills are essential.Excellent communication skills, with the ability to influence at all levels across functions, from both technical and non-technical perspectives alike.Secondary Skills:·Design and develop end-to-end business intelligence solutions using the Power BI stack.·Define and implement robust data models, metrics, and KPIs to support reporting and advanced analytics.·Design, develop, and optimize scalable multidimensional and tabular data models to enable interactive analytics and reporting.·Demonstrate strong proficiency in DAX, Power Query, and SQL, along with expertise in designing intuitive and visually compelling Power BI dashboards and reports to drive data-driven decision-making.·

Key Responsibilities

1. Lead technical teams in the design and implementation of solutions using apache spark, scala, and python
2. Provide technical expertise and guidance to team members in resolving complex technical issues
3. Collaborate with stakeholders to gather requirements and define project scope
4. Ensure adherence to best practices in coding, testing, and deployment processes
5. Conduct code reviews and performance optimization activities
6. Troubleshoot and debug technical issues to ensure seamless project delivery
7. Stay updated with the latest trends and advancements in apache spark, scala, and python technologies
8. Mentor team members and facilitate knowledge sharing within the team

Skill Requirements

1. Strong proficiency in apache spark, scala, and python
2. Experience in leading technical teams and projects
3. Excellent problem-solving skills and ability to think critically
4. Solid understanding of software development life cycle
5. Good communication and interpersonal skills
6. Ability to work effectively in a cooperative team environment
7. Strong organizational and leadership abilities
8. Experience in performance tuning and optimization techniques
9. Knowledge of big data concepts and tools is a plus

Other Requirements

1.Relevant certifications in apache spark, scala, or python are a plus

Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG,



and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion.

Copyright © 2026 HCL Technologies Limited

×

Cookie Consent Manager

When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.

Required Cookies

These cookies are required to use this website and can't be turned off.

Required Cookies

Show More Details

Required Cookies Provider Description Enabled
SAP as service provider

We use the following session cookies, which are all required to enable the website to function:

- "route" is used for session stickiness
- "careerSiteCompanyId" is used to send the request to the correct data center
- "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor
- "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another

Cookies from provider SAPasserviceprovider are required and cannot be turned off

Functional Cookies

These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies.

Consent to all Functional Cookies

Show More Details

Functional Cookies Provider Description Enabled
Vimeo

Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos.

Consent to cookies from provider Vimeo

YouTube

YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos.

Consent to cookies from provider YouTube

Advertising Cookies

These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies.

Consent to all Advertising Cookies

Show More Details

Advertising Cookies Provider Description Enabled
Google Analytics

Google Analytics is a web analytics service offered by Google that tracks and reports website traffic.

Consent to cookies from provider GoogleAnalytics

Google Tag Manager

Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing, and more.

Consent to cookies from provider GoogleTagManager

LinkedIn

LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn.

📌 Senior Apache Spark Technical Lead - Scala, Python (India)
🏢 HCLTech
📍 India