Experience: 512 Years
Location: Bangalore
Role: Big Data / Hadoop Developer
Job Summary
We are looking for an experienced Big Data Hadoop Developer with 5–12 years of experience in designing, developing, and optimizing large-scale data processing solutions. The candidate should have strong hands-on experience with the Hadoop ecosystem, data processing, ETL, SQL, and distributed computing.
Key Responsibilities
- Design, develop, and maintain scalable Big Data processing solutions.
- Work with Hadoop ecosystem technologies for processing and managing large datasets.
- Develop and optimize data pipelines for structured and unstructured data.
- Perform data extraction, transformation, cleansing, and loading.
- Develop complex SQL queries for data processing and validation.
- Work with distributed data processing frameworks and optimize jobs for performance.
- Troubleshoot data pipeline failures and production issues.
- Analyze data requirements and translate them into technical solutions.
- Collaborate with Data Engineers, Data Architects, Analysts, and business stakeholders.
- Ensure data pipelines are reliable, scalable, and maintainable.
- Perform data validation and reconciliation.
- Maintain technical documentation for data pipelines and processes.
Required Skills
- 5–12 years of experience in Big Data / Data Engineering.
- Strong hands-on experience with Hadoop.
- Good knowledge of HDFS, Hive, and MapReduce.
- Experience with Apache Spark / PySpark.
- Strong SQL skills.
- Experience with ETL/data pipeline development.
- Good understanding of distributed computing and Big Data architecture.
- Experience working with large datasets.
- Strong debugging and performance-tuning skills.
- Valuable analytical and problem-solving abilities.