- Design high-quality deliverables adhering to business requirements with defined standards and design principles, patterns
- Develop and maintain highly scalable, high-performance Data transformation applications using Apache Spark framework
- Develop/Integrate the code adhering to CI/CD, using Spark Framework in Scala/Java
- Provide solutions to big data problems dealing with huge volumes of data using Spark based data transformation solutions, Hive, MPP processes like IMPALA.
- Create Junit tests and ensure code coverage is met as per the agreed standards
- Should be able to work with a team who might be geographically distributed. Review the code modules developed by other juniors.
Must Have Skills:
- Hands on development experience in programming languages such as JAVA, SCALA using Maven, Apache Spark Frameworks and Unix Shell scripting.
- Should be comfortable with Unix File system as well as HDFS commands.
- Should have worked on query languages such as Oracle SQL, Hive SQL,
Spark SQL, Impala, HBase DB.
- Good communication and customer management skills
Good to have Skills
- Knowledge on Big data Data Ingestion tools such as SQOOP and KAFKA.
- Should be aware of the components in Big Data ecosystem.
- Should have worked on building projects using Eclipse IDE, Tectia Client, Oracle SQL Developer.
Location: PAN India (Tier 1 cities preferred)
Experience Range: 5-7 yrs
Qualifications: Any Technical Degree (BE/B,Tech/M.tech/MCA/BCA/BSC/Diploma/Masters)
Eligibility:
- 15 years of full-time education.
- Good communication and interpersonal skills
- Strong verbal and written communication skills
- Willingness to work in a collaborative and dynamic workplace
- Relevant experience as per the job requirements (if applicable)