- Detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness and business value.

- Design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.

- Participate in early state design and feature definition activities.

- Responsible for implementing robust data pipeline using Microsoft, Databricks Stack

- Responsible for creating reusable and scalable data pipelines

- You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.

Requirements

- Advanced working knowledge and experience with relational and non-relational databases





- Experience building and optimizing Azure Data data pipelines, architectures and data sets

- Strong analytic skills related to working with unstructured datasets

- Robust experience in Azure Data factory, Databricks, Eventhub, Python, PySpark , Azure Synapse and SQL, Azure DevOps

- Azure DevOps experience to deploy the ADF pipelines.

- Create end to end Azure databricks

- Minimum 4-6 years of experience

- Bachelor’s degree

- Knowledge/Experience with Azure cloud stack.

- Azure Data Platform & Databricks exp should be more than 4 years

📌 Data Engineer (Hyderabad)
🏢 Techcarrot Fz
📍 Hyderabad