Data Engineer - PySpark (Delhi)

Data Engineer - PySpark (Delhi)

16 Nov
|
Tekskills
|
Delhi

16 Nov

Tekskills

Delhi

Job highlights

- Expertise in Apache Spark (batch and streaming), Hive, Python/Scala/Java, orchestration tools (Airflow/Control-M), Kafka, object stores (S3, MinIO), Docker/Kubernetes, and data Lakehouse formats (Iceberg, Delta Lake, Hudi)

- Develop and manage data pipelines using Spark and Hive; implement orchestration and SQL transformations; deploy solutions with Docker/Kubernetes; work with streaming platforms and object stores

Job Summary

Role &

responsibilities Strong expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO).



Exposure to Docker/Kubernetes for deployment. Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Responsibilities

- Solid expertise in Apache Spark (batch + streaming) and Hive.

- Proficiency in Python, Scala, or Java.

- Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

- Experience working with Kafka, Solace, and object stores (S3, MinIO).

- Exposure to Docker/Kubernetes for deployment.

- Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

📌 Data Engineer - PySpark (Delhi)
🏢 Tekskills
📍 Delhi

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (delhi) / delhi

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (delhi) / delhi