We are hiring a Big Data Engineer on behalf of our client. This role involves designing, building, and maintaining scalable data pipelines and infrastructure to process large volumes of structured and unstructured data. It's a outstanding opportunity for someone who enjoys solving complex data engineering challenges and building systems that power data-driven decision-making across the organization.

Role & responsibilities
Design, build, and maintain scalable ETL/ELT pipelines for large-scale data processing
Develop and optimize data lakes, data warehouses, and distributed systems
Work with big data frameworks (Hadoop, Spark, Hive) to process massive datasets
Build and manage real-time data streaming pipelines (Kafka, Flink, Spark Streaming)
Ensure data quality, integrity, and governance across all pipelines
Optimize data storage and retrieval for performance and cost efficiency
Collaborate with data scientists, analysts, and engineering teams to meet data requirements
Manage and monitor cloud-based big data infrastructure (AWS EMR, GCP Dataproc,



Azure Synapse)
Automate workflows using orchestration tools (Airflow, Luigi, Oozie)
Troubleshoot and resolve data pipeline issues and performance bottlenecks

Preferred candidate profile
0 to 2 years of experience in big data engineering or related role
Bachelor's/Master's degree in Computer Science, Engineering, or related field
Solid programming skills in Python, Java, or Scala
Hands-on experience with Hadoop ecosystem (HDFS, MapReduce, Hive, Pig)
Strong expertise in Apache Spark (batch and streaming)
Experience with SQL/NoSQL databases (MySQL, MongoDB, Cassandra, HBase)
Familiarity with data streaming tools (Kafka, Flink)
Experience with workflow orchestration (Airflow, Oozie, Luigi)
Knowledge of cloud platforms (AWS, GCP, Azure) and their big data services
Solid understanding of data modeling, data warehousing, and distributed computing concepts

📌 Big Data Engineer Pune
🏢 Jobaaj.com
📍 Pune