(LS-79) Senior Software Engineer - Hadoop, Hive, Spark

(LS-79) Senior Software Engineer - Hadoop, Hive, Spark

22 Mar
|
CGI Information Systems and Management Consultants
|
Hyderābād

22 Mar

CGI Information Systems and Management Consultants

Hyderābād

Works independently under limited supervision and applies knowledge of subject matter in Applications Development. Possess sufficient knowledge and skills to effectively deal with issues, challenges within field of specialization to develop simple applications solutions. Second level professional with direct impact on results and outcome.



With 4 years of overall experience in data analysis, data modeling and implementation of enterprise class systems spanning Big Data, Data Integration, Object Oriented programming and Advanced Analytics.

Excellent understanding of Hadoop Architecture and Daemons such as HDFS, Name Node, Data Node, Job Tracker, Task Tracker.



Extracted files from Cassandra through Sqoop and placed in HDFS and processed.

Expertise in Big Data Technologies and Hadoop Ecosystem tools like Flume, Sqoop, Hbase, ZooKeeper, Oozie, MapReduce, Hive, PIG and YARN.

Extracted and updated the data into MONGOD using MONGO import and export command line utility interface.

In-depth understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming, Spark MLlib.

Expertise in developing Real-Time Streaming Solutions using Spark Streaming

Will be responsible for the development of technical solutions utilizing the big data platform.

Extracted and updated the data into MONGOD using MONGO import and export command line utility interface.

Importing and exporting data from RDBMS to HDFS . Hive tables and HBase by using Sqoop.

Knowledge in handling Kafka cluster and created several topologies to support real-time processing requirements.



Required qualifications to be successful in this role:



Primary Skill: Work experience: 4-8 years

Technology Stack: Hadoop Horton works, Hive, Spark,Informatica, Python, Bash (shell scripting), Language R (nice to have), Kafka (nice to have).

Experiences:4-8 yrs



Skills:



- Hadoop Hive

- ETL

- SQL/PL SQL

- Unix

- Python

- Scala



,

The original job offer can be found in Kit Job:
https://www.kitjob.in/job/16612992/ls-79-senior-software-engineer-hadoop-hive-spark-hyderabad/?utm_source=html

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: (ls-79) senior software engineer - hadoop, hive, spark
Publish a new Free Offer
Need to publish an offer? With more than 1 million unique users per month, you will find the ideal candidate for your company instantly, what are you waiting for!
Publish Now

Subscribe to this job alert