- Mandatory Skills Description:
- • 10+ years of experience in data intensive Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning
- •
- Must have experience in leading a Development Team
- •
- Proven experience as a Core Python developer
- •
- Good understanding of Gen AI
- •

Experience developing Classes, OOPS, exception handling, parallel processing.

- •

- Robust knowledge of DB connectivity, data loading , transformation, calculation
- •
- Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
- •
- Lambda Functions, Decorators
- •
- Vector operations on Pandas dataframes /series
- •
- Application of apply map, apply, map functions
- •
- Concurrency and error handling data pipeline batch of size [1-10 gb]
- •
- Ability to understand business requirements and translate them into technical requirements
- •
- Ability to design architecture of data pipeline for concurrent data processing
- •
- Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services
- •
- Debugging application

📌 Team Lead (Bengaluru)
🏢 Luxoft
📍 Bengaluru