22 Oct
|
Digitide
|
Bengaluru
22 Oct
Digitide
Bengaluru
- 4- 8 years of experience as Data engineer in Big Data / Spark.
- Spark, Python, Data Quality experience on any Cloud technology preferably AWS.
- Experience in creating data pipelines, data streams etc with good SQL Scripting experience.
- Quick Learner, Open Minded, Adaptable, Team Player with a Positive Attitude.
- Able to Develop ETL/ELT Strategy and implement it independently as per the design.
- Writing high-performance, reliable, and maintainable code.
- Good knowledge of database structures, theories, principles, and practices.
- Good understanding of Hadoop Architecture and Elastic Map Reduce (EMR)
- Familiarity with Kafka, Nifi, AWS
- Familiarity with data loading tools like Talend, Flume, Sqoop
- Analytical and problem-solving skills, applied to Big Data domain
- Proven understanding with Hadoop, HBase, Hive, HDFS
- Good aptitude in multi-threading and concurrency concepts
- Will be responsible for writing high-performance, reliable, and maintainable code
- Hadoop development, implementation, and support
- Good communication skills and flexible on working hours (need some overlap with US team)
- Designing, building, installing, configuring, and supporting Hadoop on Hortonworks and EMR
- Translate complex functional and technical requirements into detailed design
- Perform analysis of vast data stores and uncover insights
- Maintain security and data privacy
- Propose best practices/standards
📌 Big Data Engineer (Bengaluru)
🏢 Digitide
📍 Bengaluru