Data Engineer Job Description (5 Years Experience)
All bgv is required
No UAN

We are looking for a Data Engineer to design, build, and maintain scalable data pipelines that support analytics and data products. The role involves working closely with data scientists and engineering teams to ensure reliable and productive data infrastructure.

Key Responsibilities

Design and develop data pipelines (batch and streaming) using Databricks and PySpark.

Write optimized PySpark code to process large datasets.

Build and manage CI/CD pipelines for data workflows using GitHub / GitHub Actions / Azure DevOps.

Implement data validation and data quality checks.

Monitor pipelines using logging, alerting, and observability tools.

Collaborate with cross-functional teams and document data pipeline architecture.

Mandatory Skills
7+ years of Data Engineering experience

Databricks and Medallian Architecture

PySpark





End-to-end Data Pipeline Development (Batch / Streaming)

GitHub (branching, pull requests, code reviews)

CI/CD for Data Pipelines (GitHub Actions / Azure DevOps)

Data Validation / Data Quality Frameworks

Pipeline Monitoring (Logging, Alerting, SLA tracking)

Apache Kafka

Data Warehousing / Lakehouse Architecture concepts

MongoDB or other NoSQL databases, Data Governance, Data Modeling, Spark Streaming

Looking forward to your prompt response.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer (Faridabad)
🏢 Ekloud
📍 Faridabad