We are looking for one of our requirements of Azure databricks, PySpark
Desired Experience Range 8-12yrs years
Location - Kolkata, Pune, Mumbai, Bangalore, Bhubaneshwar
JD-
Minimum 5 years of experience in Databricks and Pyspark in each skill.
Participates in ETL Design of recent or changing spark sql and pyspark code, data bricks & python with the team and prepares technical specifications.
- Designs and builds integrations supporting FCRM ETL application.
- Performs source system analysis as required.
- Implements best practices and tunes Azure SQL code for optimization.
- Develop and maintain complex ETL jobs and frameworks using the Bank's standard tools
-Provide support to the development and testing teams to resolve data issues, including escalation support on complex issues
- ADF orchestration
-Production support experienced is plus .
-Strong programming skills in Python and SQL Hands-on experience with: Azure Databricks (Unity Catalog preferred)Apache Spark / PySpark Azure Data
-Orchestrate workflows using Azure Databricks Jobs / Azure Data Factory
- Work with structured and semi-structured data formats such as JSON, CSV, Parquet, Delta tables
Clean Room (DaaS DEV Project) Locations: work 9 hours in ODC.