We are looking for an experienced Big Data Hadoop Developer with 512 years of experience in designing, developing, and optimizing large-scale data processing solutions. The candidate should have strong hands-on experience with the Hadoop ecosystem, data processing, ETL, SQL, and distributed computing.
Key Responsibilities
- Design, develop, and maintain scalable Big Data processing solutions.
- Work with Hadoop ecosystem technologies for processing and managing large datasets.
- Develop and optimize data pipelines for structured and unstructured data.
- Perform data extraction, transformation, cleansing, and loading.
- Develop complex SQL queries for data processing and validation.
- Work with distributed data processing frameworks and optimize jobs for performance.
- Troubleshoot data pipeline failures and production issues.
- Analyze data requirements and translate them into technical solutions.
- Collaborate with Data Engineers, Data Architects, Analysts, and business stakeholders.
- Ensure data pipelines are reliable, scalable, and maintainable.
- Perform data validation and reconciliation.
- Maintain technical documentation for data pipelines and processes.
Required Skills
- 5–12 years of experience in Big Data / Data Engineering.
- Strong hands-on experience with Hadoop.
- Good knowledge of HDFS, Hive, and MapReduce.
- Experience with Apache Spark / PySpark.
- Strong SQL skills.
- Experience with ETL/data pipeline development.
- Good understanding of distributed computing and Big Data architecture.
- Experience working with large datasets.
- Strong debugging and performance-tuning skills.
- Positive analytical and problem-solving abilities.
Good to Have
- Kafka
- Scala / Python
- HBase
- Sqoop
- Oozie
- Databricks
- Airflow
- Cloud platforms – AWS / Azure / GCP
Key Skills Hadoop | HDFS | Hive | Spark | PySpark | Big Data | SQL | ETL | Data Engineering | Kafka | Data Processing
📌 Data Engineer - BigData Hadoop (Bengaluru)
🏢 Advance Career Solutions
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.