02 Oct
|
Black And White Business Solutions
|
Bengaluru
02 Oct
Black And White Business Solutions
Bengaluru
Hiring for One of the topmost MNC!!
ROLE: Azure Data Engineer
Exp: 5 to 8 YRS
Location: Bengaluru, Chennai
Work mode: 5 Days work from office
Job Summary:
We are looking for an experienced Azure Data Engineer with solid expertise in Azure Databricks to design, develop, and maintain scalable data pipelines and data solutions. The ideal candidate should have hands-on experience with Azure data services, Databricks, PySpark, SQL, and ETL/ELT processes
Key Responsibilities:
- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop data transformation and processing solutions using PySpark and SQL.
- Build and optimize ETL/ELT pipelines using Azure data services.
- Work with Azure Data Factory (ADF) for pipeline orchestration and data integration.
- Implement data ingestion from various sources including databases, APIs, files, and cloud storage.
- Work with Azure Data Lake Storage (ADLS Gen2)
for storing and managing large datasets.
- Develop and maintain Delta Lake tables and implement data lakehouse solutions.
- Optimize Databricks jobs, Spark workloads, SQL queries, and data pipelines for performance and cost.
- Implement data quality, validation, monitoring, and error-handling processes.
- Collaborate with data analysts, data scientists, architects, and application teams to understand data requirements.
- Follow data engineering best practices around security, governance, version control, and deployment.
- Troubleshoot production data pipeline issues and provide timely resolutions.
-- Thanks & Regards
Nikhil C
IT Staffing Analyst
Black and White Business Solutions Pvt.Ltd.
Bangalore,Karnataka,India.
[email protected]|www.blackwhite.in
📌 Azure Data Engineer (Bengaluru)
🏢 Black And White Business Solutions
📍 Bengaluru