- Design, develop, test, deploy and maintain large-scale Hadoop-based solutions using Python and PySpark.
- Collaborate with cross-functional teams to gather requirements and deliver high-quality software products on time.
- Troubleshoot complex issues related to big data processing pipelines and provide technical guidance to junior team members.
- Stay up-to-date with industry trends in big data technologies such as Hive, Spark, etc.
Job Requirements :
- 9-24 years of experience in Hadoop development using Python or similar languages.
- Robust expertise in developing scalable big data applications using Hive or other query engines like SQL.
- Proficiency in working with distributed computing frameworks like Apache Spark (PySpark) for data processing tasks.