4- 8 years of experience as Data engineer in Big Data / Spark.
Spark, Python, Data Quality experience on any Cloud technology preferably AWS.
Experience in creating data pipelines, data streams etc with positive SQL Scripting experience.
Quick Learner, Open Minded, Adaptable, Team Player with a Positive Attitude.
Able to Develop ETL/ELT Strategy and implement it independently as per the design.
Writing high-performance, reliable, and maintainable code.
Good knowledge of database structures, theories, principles, and practices.
Positive understanding of Hadoop Architecture and Elastic Map Reduce (EMR)
Familiarity with Kafka, Nifi, AWS
Familiarity with data loading tools like Talend, Flume, Sqoop
Analytical and problem-solving skills, applied to Big Data domain
Proven understanding with Hadoop, HBase, Hive,



HDFS
Good aptitude in multi-threading and concurrency concepts
Will be responsible for writing high-performance, reliable, and maintainable code
Hadoop development, implementation, and support
Good communication skills and flexible on working hours (need some overlap with US team)
Designing, building, installing, configuring, and supporting Hadoop on Hortonworks and EMR
Translate complex functional and technical requirements into detailed design
Perform analysis of vast data stores and uncover insights
Maintain security and data privacy
Propose best practices/standards

📌 Big Data Engineer Bengaluru (India)
🏢 Digitide
📍 India