15 Nov
|
Talent21
|
Bengaluru
15 Nov
Talent21
Bengaluru
Roles and
Responsibilities:
- Design, develop, test, deploy and maintain large-scale data pipelines using Airflow.
- Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
- Develop complex data workflows using Hadoop, Spark, Hive and Unix shell scripting languages.
- Troubleshoot issues related to pipeline failures and optimize performance for improved efficiency. Job
Requirements:
- 4-20 years of experience in Big Data engineering with expertise in Airflow, Hadoop, Spark, Hive.
- Solid understanding of Unix operating system and ability to write efficient shell scripts.
- Experience working on large-scale data processing projects involving multiple stakeholders.
📌 Big Data Engineer (Bengaluru)
🏢 Talent21
📍 Bengaluru