- Mandatory Skills Description:
- • 10+ years of experience in data intensive

Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning

- • Must have experience in leading a Development Team

- • Proven experience as a

Core Python developer

- • Good understanding of Gen AI

- • Experience developing

Classes, OOPS, exception handling, parallel processing.

- • Robust knowledge of DB connectivity, data loading , transformation, calculation

- • Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations

- • Lambda Functions, Decorators

- • Vector operations on Pandas dataframes /series

- • Application of apply map, apply, map functions

- • Concurrency and error handling data pipeline batch of size [1-10 gb]

- • Ability to understand business requirements and translate them into technical requirements

- • Ability to design architecture of data pipeline for concurrent data processing

- • Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services

- • Debugging application

📌 Team Lead (Bengaluru)
🏢 Luxoft
📍 Bengaluru