Position:

Data Engineer

:

Key Responsibilities

Data Pipeline Support & Monitoring

- Monitor and support DataOps pipelines across Azure Data Factory, Azure Databricks, and related services.
- Identify pipeline failures, performance degradation, and data quality issues.
- Ensure SLA adherence and operational stability in a 24×7 production workplace.

Incident Management & Troubleshooting
- Perform troubleshooting of failed pipelines, Databricks jobs, and Python/PySpark scripts.
- Execute resolution (job restarts, pipeline re-runs, alert analysis) and escalate when needed.
- Perform deep-dive analysis, identify root causes, and implement permanent fixes.
- Conduct and document Root Cause Analysis (RCA) for recurring and high-severity incidents.

Development & Fix Implementation
- Analyze and fix issues in Python, PySpark, SQL, and pipeline configurations.
- Improve error handling, stability, and performance of data workflows.
- Follow change management and deployment processes for production fixes.

Power BI & Data Validation
- Support Power BI datasets and dashboards, including refresh failures and data inconsistencies.
- Validate data accuracy, completeness, and freshness across pipelines and reporting layers.




- Resolve advanced data/model issues and performance concerns.

Collaboration & Continuous Improvement
- Act as escalation support (L2) and guide L1 engineers during incidents.
- Maintain runbooks, incident records, and shift handover documentation.
- Identify automation and monitoring improvements to reduce operational overhead.

Required Skills & Qualifications

- 4-year bachelor’s degree or equivalent
- 1–2 years of work experience
- Hands-on experience with Azure Data Factory, Azure Databricks, or similar data pipelines technologies.
- Strong understanding of Python programming and OOP concepts.
- Working knowledge of PySpark and data processing frameworks.
- Familiarity with Power BI dataset refreshes and data troubleshooting.
- Basic understanding of statistics and data science concepts (descriptive statistics, regression, time series).
- Strong analytical, debugging, and communication skills.
- Willingness to work in a 24×7 rotational shift model.

Location:

IN-MH-Pune, India-Blue Ridge-Hinjewadi (eInfochips)

Time Type:

Full time

Job Category:

Engineering Services

📌 Data Engineer (Pune)
🏢 Arrow
📍 Pune