We are looking for one of our requirements of Azure databricks, PySpark
Desired Experience Range 8-12yrs years
Location - Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar
JD-
Minimum 5 years of experience in Databricks and Pyspark in each skill.
Participates in ETL Design of recent or changing spark sql and pyspark code, data bricks & python with the team and prepares technical specifications.
Designs and builds integrations supporting FCRM ETL application.
Performs source system analysis as required.
Implements best practices and tunes Azure SQL code for optimization.
Develop and maintain complex ETL jobs and frameworks using the Bank's standard tools
-Provide support to the development and testing teams to resolve data issues, including escalation support on complex issues
ADF orchestration
-Production support experienced is plus .
-Solid programming skills in Python and SQL Hands-on experience with: Azure Databricks (Unity Catalog preferred)Apache Spark / PySpark Azure Data
-Orchestrate workflows using Azure Databricks Jobs / Azure Data Factory
Work with structured and semi-structured data formats such as JSON, CSV, Parquet, Delta tables
Clean Room (DaaS DEV Project) Locations: work 9 hours in ODC.