Azure Data Engineer with extensive experience on solution designing - Domain Data sets, data products & hands on experience in Azure Databricks, Python, Pyspark & ETL Pipelines,
Should know & have working experience with Atlas framework. Should know and worked in medallion architecture.
1. Design, build, and maintain scalable and effective data pipelines using Databricks. Integrate data from various sources (for eg. Azure storage account, SFTP, Fabric) using Apache Spark within Databricks.
2. Implement processes and checks to ensure the accuracy and completeness of data.
3. Work closely with data owners, analysts, and other stakeholders to understand data requirements and deliver solutions.
4. Monitor data pipelines for issues and resolve them promptly to maintain data flow integrity.
Skills:
1. Experience with Databricks-specific tools and features.
2. Proficiency in programming languages such as Python or Scala for data processing on Databricks
3. Experience with Azure cloud platform.
4. Strong understanding of SQL.
5. Experience with ETL and processes, Unity Catalog.
6. Certifications in Databricks or related cloud technologies.
📌 Data Engineer (Bengaluru)
🏢 Tekskills
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.