- Robust experience in Azure Big Data technologies including Azure Databricks, Azure Synapse Analytics, or Microsoft Fabric.
- Proficiency in PySpark or Scala for distributed data processing.
- Hands-on experience with Scope scripting for large-scale data workloads.
- Good working knowledge of Azure Cosmos DB, including data modeling and performance optimization.
- Experience working with Azure Data Factory (ADF) for orchestration and Azure Key Vault for secure secrets management.
Key Responsibilities*
- Design and develop scalable data pipelines and big data solutions using Azure services.
- Develop and orchestrate ETL/ELT workflows using ADF and implement secure configurations using Azure Key Vault.
- Build and optimize distributed data processing jobs using PySpark/Scala and Scope.
- Implement and manage data solutions leveraging Cosmos DB for high-performance workloads.
- Collaborate with cross-functional teams to ensure reliable, secure, and efficient data platforms.