08 Sep
|
IBM
|
Bangalore Rural
08 Sep
IBM
Bangalore Rural
Job Description:
- Mandate-Strong Azure Data Engineer with advanced skills in Python (coding/scripting), SQL, Azure data factory, Data Modelling(Master), and Databricks (PySpark, Delta Live Tables, structured/live streaming, Unity Catalog). Handson exp in performance optimisation of DLT pipelines,cost optimization for Databricks in live streaming (Photon, serverless/nonserverless)./ ELT /data bricks Asset Bundle , ADLS. Should have worked on huge volume unstructured data to streamline to structured.
- Role requires AI/GenAI-driven innovationleveraging LLMs/agents to accelerate automated pipeline development.(Gen AI: Genie, Mosaic AI, GitHub CoPilot - Knowledge), Azure Functions, Logic Apps. Data Integration & Ingestion – Skill/Data Manipulation and Processing – Skill/GITHUB, Action, Azure DevOps – Skill/
- Secondary: CI/CD, Power BI/Azure Synapse, PyTest,Stream analytics,Glue,air,Kinesis,Redshift,sonarqube, Running scrum team, MKDocs Documentation
- Requires strong ownership, analytical excellence, valuable communication,selfdrive, and professional conduct.Role & responsibilities
Preferred candidate profile
📌 Data Engineer-Data Platforms-Azure (Bangalore Rural)
🏢 IBM
📍 Bangalore Rural