Data Engineer Pyspark Delhi

Data Engineer Pyspark Delhi

17 Nov
|
Tekskills
|
Delhi

17 Nov

Tekskills

Delhi

Job highlights
Expertise in Apache Spark (batch and streaming), Hive, Python/Scala/Java, orchestration tools (Airflow/Control-M), Kafka, object stores (S3, MinIO), Docker/Kubernetes, and data Lakehouse formats (Iceberg, Delta Lake, Hudi)
Develop and manage data pipelines using Spark and Hive; implement orchestration and SQL transformations; deploy solutions with Docker/Kubernetes; work with streaming platforms and object stores

Job Summary

Role &

responsibilities Robust expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO).



Exposure to Docker/Kubernetes for deployment. Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Responsibilities
Solid expertise in Apache Spark (batch + streaming) and Hive.
Proficiency in Python, Scala, or Java.
Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
Experience working with Kafka, Solace, and object stores (S3, MinIO).
Exposure to Docker/Kubernetes for deployment.
Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

📌 Data Engineer Pyspark Delhi
🏢 Tekskills
📍 Delhi

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer pyspark delhi / delhi

Subscribe to this job alert:

Get the latest job offers by email for: data engineer pyspark delhi / delhi