Job Description
Azure Databricks, PySpark, Azure Data Factory
nResponsibilities
n
n
Design, develop, and maintain data pipelines using Azure Data Factory.n
Manage and optimize data storage using Azure Data Lake Gen 2.n
Build and process large-scale data solutions with Azure Databricks and Apache Spark.n
Create interactive reports and dashboards in Power BI for business insights.n
Collaborate with cross-functional IT and business teams to translate requirements into data solutions.n
Ensure data quality, security, and compliance in line with organizational standards.n
nCore Skills Required
n
n
Azure Data Factory: Experience in building and managing data pipelines.n
Azure Data Lake Gen 2: Proficient in data storage and management within Azure's data lake workplace.n
Azure Databricks / Apache Spark: Hands-on skill with distributed data processing, transformations, and analytics.n
Power BI: Expertise in data visualization and reporting.n