We are looking for a skilled Spark/Scala Data Engineer with robust experience in Scala/Java, Apache Spark, Hive, SQL, and Unix Shell Scripting. The candidate will be responsible for developing and maintaining big data solutions, building scalable data pipelines, and working with Hadoop ecosystem technologies.
Roles & Responsibilities
- Develop and maintain big data applications using Scala/Java, Apache Spark, and Hive.
- Design, build, and optimize data processing pipelines.
- Work with HDFS, Unix/Linux file systems, and Shell Scripting.
- Develop and execute queries using Oracle SQL, Hive SQL, Spark SQL, Impala, and HBase.
- Collaborate with business and technical teams to deliver data-driven solutions.
- Ensure code quality, performance optimization, and production support.
- Participate in troubleshooting and performance tuning of big data applications.
- Communicate effectively with customers and stakeholders.