- Detailed reviewing and analyzing structured, semi-structured and unstructured data sources for quality, completeness and business value.
- Design, architect, implement and test rapid prototypes that demonstrate value of the data and present them to diverse audiences.
- Participate in early state design and feature definition activities.
- Responsible for implementing robust data pipeline using Microsoft, Databricks Stack
- Responsible for creating reusable and scalable data pipelines
- You are a Team-Player, collaborating with team members across multiple engineering teams to support the integration of proven prototypes into core intelligence products.
Requirements
- Advanced working knowledge and experience with relational and non-relational databases
- Experience building and optimizing Azure Data data pipelines, architectures and data sets
- Robust analytic skills related to working with unstructured datasets
- Strong experience in Azure Data factory, Databricks, Eventhub, Python, PySpark , Azure Synapse and SQL, Azure DevOps
- Azure DevOps experience to deploy the ADF pipelines.
- Create end to end Azure databricks
- Minimum 4-6 years of experience
- Bachelorâs degree
- Knowledge/Experience with Azure cloud stack.
- Azure Data Platform & Databricks exp should be more than 4 years
📌 Data Engineer (Chennai)
🏢 techcarrot FZ
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.