Job DescriptionAzure Databricks, PySpark, Azure Data Factory
NResponsibilities
n
N
- Design, develop, and maintain data pipelines using Azure Data Factory.
N
- Manage and optimize data storage using Azure Data Lake Gen 2.
N
- Build and process large-scale data solutions with Azure Databricks and Apache Spark.
N
- Create interactive reports and dashboards in Power BI for business insights.
N
- Collaborate with cross-functional IT and business teams to translate requirements into data solutions.
N
- Ensure data quality, security, and compliance in line with organizational standards.
N
nCore Skills Required
N
n
- Azure Data Factory: Experience in building and managing data pipelines.
N
- Azure Data Lake Gen 2: Proficient in data storage and management within Azure's data lake setting.
N
- Azure Databricks / Apache Spark: Hands-on skill with distributed data processing, transformations, and analytics.
N
- Power BI: Expertise in data visualization and reporting.
N