- PySpark and Spark SQL
- Working with Dataframes using different APIs
- Spark Functions
- Advanced Data transformations
- Valuable knowledge in SQL
- Applying UDFS
- Error handling, logging and monitoring
- Unix, Scheduling Tool
- Performance Tuning & Generic process development
- Banking Domain Knowledge
Desirable
- ETL Estimation
- Teradata BTEQ
Responsibility of / Expectations from the Role
1. ETL Technical Designing, Guiding Team for solving Technical Problems, Providing Technical Solution to Client
- Understanding Business Requirement and converting to Technical specification, Execution Planning
- Effort Estimation, Task assignment to the team and tracking of activities, Performance Tuning
- Hands on development for complex modules, ensuring coding standards, quality of delivery