• Mandatory Skills Description:
•
• 10+ years of experience in data intensive Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning
•
• Must have experience in leading a Development Team
•
• Proven experience as a Core Python developer
•
• Good understanding of Gen AI
•
• Experience developing Classes, OOPS, exception handling, parallel processing.
•
• Solid knowledge of DB connectivity, data loading , transformation, calculation
•
• Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
•
• Lambda Functions, Decorators
•
• Vector operations on Pandas dataframes /series
•




• Application of apply map, apply, map functions
•
• Concurrency and error handling data pipeline batch of size [1-10 gb]
•
• Ability to understand business requirements and translate them into technical requirements
•
• Ability to design architecture of data pipeline for concurrent data processing
•
• Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services
•
• Debugging application

📌 Team Lead (Bengaluru)
🏢 Luxoft
📍 Bengaluru