- 10+ years of total IT experience including 5+ years of Big Data(Spark) experience
- Experience in Spark Batch & Streaming, Kafka, Spark SQL, Hive, SQOOP, HBase and Java/Scala are must. PySpark preferred though a good Spark Scala talent can be considered.
- Experience in architecting and designing large scale ETL workload migration from traditional ETL (Ab Initio / Informatica) to Spark
- Sound concepts of Data warehousing and ETL. Ability to understand mapping document and translate the same to Spark SQL programs
- Hands on functional programming like Scala, Java 8 prior to Big Data projects, having python knowledge is an added advantage.
- Experience in designing and leading Big Data projects, designing data models on Hive and HBase for high-performance and storage.
- Executed multiple Hadoop data lake projects (batch & streaming real time data) and led the developers’ team.
- Proficient in Linux/Unix scripting.
- Experience in Agile methodology is a must.
- Knowledge of standard methodologies, concepts, best practices, and procedures within Amazon EMR Big Data environment is a plus.
- Self-starter and able to independently implement the solution.
- Positive problem-solving techniques and communication
- Knowledge on Informatica BDM is a plus
- Sound knowledge of SQL Programming (Good knowledge of Teradata or Db2 or Netezza or Oracle)
📌 Big Data Developer - Java & Spark Dev (Secunderabad)
🏢 Labq Global Technologies
📍 Secunderabad
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.