Robust experience with one or more programming languages (Python/Spark).
• Demonstrated analytical and problem-solving skills. Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain.
• Comfortable working with large data volumes and be able to demonstrate a firm understanding of logical data structures and analysis techniques.
• Experience in Big data technologies like HDFS, Map Reduce, YARN, Apache Spark, Hive.
• Familiarity with data formats like Avro, Parquet, CSV, JSON.
• Strong systems analysis, design and architecture fundamentals, Unit Testing and other SDLC activities.
• Understanding fundamental design principles behind a scalable application.
• Experience in working with UNIX/LINUX and shell scripting.
• Good knowledge of database principles, practices with SQL.
• Application performance tuning, troubleshooting experience and the implementation of these skills in Big Data domain. Good to Have:
• Agile/Scrum methodology experience is required.
• Experience in SCMs like GIT and tools like JIRA.
• Experience in No SQL databases.
• Familiarity with build tools such as Maven and continuous integration like Jenkins/Team City.
• Familiarity with cloud and container technologies.
• Experience real time data processing - Kafka.
Responsibilities:
• Translate application storyboards and use cases into functional applications.
• Design, build, and maintain efficient, reusable, and reliable Python/Scala code.
• Ensure the best possible performance, quality, and responsiveness of the applications.
• Identify bottlenecks and bugs, and devise solutions to these problems.
• Develop high performance & low latency components to run Spark clusters.
• Interpreting functional requirements into design approaches those can be served through Big Data platform.
• Collaborate and partner with Global Teams based across different locations.
• Be able to propose best practices and standards.
• Perform the testing of software prototypes and transfer to the operational team.
• Processing of data using Hive, Impala & HBASE.
• Performing analysis of large data sets and derive insights.