IN_ Associate _Azure Databricks Pyspark Developer (Mumbai)

IN_ Associate _Azure Databricks Pyspark Developer (Mumbai)

02 Oct
|
PwC India
|
Mumbai

02 Oct

PwC India

Mumbai

Job Description & Summary: A career within Technology Consulting services, will provide you with the opportunity to bring our clients a competitive advantage through defining their technology objectives, assessing solution options, and devising architectural solutions that help them achieve both strategic goals and meet operational requirements. We help build software and design data platforms, manage large volumes of client data, develop compliance procedures for data management, and continually researching new technologies to drive innovation and sustainable change.

Job Position Title: IN_ Associate _Azure Databricks Pyspark Developer -_Data & Analytics _Advisory _Mumbai

Responsibilities:

Key Responsibilities:

• Data Lake and Lakehouse Implementation:
• Design, implement, and manage Data Lake and Lakehouse architectures. (Must have)
• Develop and maintain scalable data pipelines and workflows. (Must have)
• Utilize Azure Data Lake Services (ADLS) for data storage and management. (Must have)
• Knowledge on Medalion Architecture, Delta Format. (Must have)




• Data Processing and Transformation:
• Use PySpark for data processing and transformations. (Must have)
• Implement Delta Live Tables for real-time data processing and analytics. (Good to have)
• Ensure data quality and consistency across all stages of the data lifecycle. (Must have)
• Data Management and Governance:
• Employ Unity Catalog for data governance and metadata management. (Good to have)
• Ensure robust data security and compliance with industry standards. (Must have)
• Data Integration:
• Extract, transform, and load (ETL) data from multiple sources (Must have) including SAP (Good to have), Dynamics 365 (Positive to have), and other systems.
• Utilize Azure Data Factory (ADF) and Synapse Analytics for data integration and orchestration. (Must have)
• Performance Optimization of the Jobs. (Must have)
• Data Storage and Access:
• Implement and manage Azure Data Lake Storage (ADLS) for large-scale data st

📌 IN_ Associate _Azure Databricks Pyspark Developer (Mumbai)
🏢 PwC India
📍 Mumbai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: in_ associate _azure databricks pyspark developer (mumbai) / mumbai

Subscribe to this job alert:

Get the latest job offers by email for: in_ associate _azure databricks pyspark developer (mumbai) / mumbai