JD:-
PySpark and Spark SQL
Working with Dataframes using different APIs
Spark Functions
Advanced Data transformations
Positive knowledge in SQL
Applying UDFS
Error handling, logging and monitoring
Unix, Scheduling Tool
Performance Tuning & Generic process development
Banking Domain Knowledge
Develop and maintain ETL pipelines using Azure Databricks (PySpark / Spark SQL)
Process and transform large financial datasets (transactions, customer data)
Implement data pipelines for AML, KYC, risk, and regulatory reporting
Ensure data quality, governance, and lineage tracking
Integrate data from banking systems (core banking, payments, trading)
Optimize Spark jobs for performance and cost
Collaborate with business and compliance teams
Support audit and regulatory requirements
📌 Azure Data Engineer (Chennai)
🏢 Tata Consultancy Services
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.