Job Description:
Requirements: 12 to 15 years of experience in developing platforms in the Data engineering space. Minimum of 4-5 years of experience in managing Data Engineering teams. Hands-on experience with SQL, ETL pipelines, Make changes to our diagnosing any problems across the entire technical stack. Design and develop a real-time events pipeline for Data ingestion for real-time dash- boarding. Develop complex and efficient functions to transform raw data sources into powerful, reliable components of our data lake. Design & implement new components and various emerging technologies in Hadoop Eco- System, and successful execution of various projects. Developing career paths for team members and helping them grow with regular & deep mentoring. Performing regular performance evaluations and sharing and seeking feedback. Operating with scale and speed amidst flux. Expertise with the Agile development methodologies.





Skills that will help you succeed in this role: Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc. Excellent programming/debugging skills in Python/Java/Scala. Experience with any scripting language such as Python, Bash etc. Good to have experience of working with noSQL databases like Hbase, Cassandra. Hands-on programming experience with multithreaded applications. Good to have experience in Database, SQL, messaging queues like Kafka. Positive to have experience in developing streaming applications e.g. Spark Streaming, Flink, Storm, etc .Good to have experience with AWS and cloud technologies such as S3Experience with caching architectures like Redis etc.

📌 Data Engineering- Director Engineering (Lending) (Bengaluru)
🏢 Right Advisors
📍 Bengaluru