Senior Architect role in a multinational organization focused on building scalable data and analytics solutions using Python LakeHouse platforms Spark Job Definition OneLake SQL and PySpark. The role requires deep expertise in retail banking data and processes delivering secure and performant hybrid cloud data architectures that drive business value in a hybrid work model with day shift.
Responsibilities
Design robust LakeHouse based data architectures that integrate OneLake Spark Job Definition and PySpark components to support large scale retail banking analytics and reporting use cases
Develop end to end data pipelines using Python SQL and PySpark that efficiently ingest transform and curate transactional and customer data from multiple retail banking source systems
Optimize Spark Job Definition configurations and job orchestration to achieve predictable performance cost efficiency and high reliability for critical banking workloads
Implement secure data models and access patterns in LakeHouse and OneLake environments that align with retail banking regulatory requirements and internal risk policies
Collaborate with product owners and domain experts in retail banking to translate business goals into technical data architecture blueprints and implementation roadmaps
Guide engineering teams on best practices for coding standards performance tuning and reusable patterns in Python SQL and PySpark across hybrid environments
Review solution designs technical specifications and implementation plans to ensure alignment with enterprise architecture standards and long term data strategy
Coordinate with cloud infrastructure and security teams to ensure LakeHouse and OneLake solutions meet resilience observability and compliance expectations
Create detailed documentation for data models data flows pipeline configurations and operational runbooks to support sustainable day to day operations by delivery teams
Mentor less experienced team members by providing cons
📌 Sr. Architect (Chennai)
🏢 Cognizant
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.