Data Engineer - PySpark (Noida)

Data Engineer - PySpark (Noida)

16 Nov
|
Tekskills
|
Noida

16 Nov

Tekskills

Noida

Job highlights

- Expertise in Apache Spark (batch + streaming), Hive, Python/Scala/Java, orchestration tools (Airflow/Control-M), Kafka, object stores (S3, MinIO), and data Lakehouse formats (Iceberg, Delta Lake, Hudi)

- Develop and manage data pipelines using Spark and Hive; implement orchestration with Airflow/Control-M; work with Kafka and object stores; deploy using Docker/Kubernetes

Job Summary

Role &

responsibilities Solid expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO). Exposure to Docker/Kubernetes for deployment.



Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Responsibilities

- Strong expertise in Apache Spark (batch + streaming) and Hive.

- Proficiency in Python, Scala, or Java.

- Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

- Experience working with Kafka, Solace, and object stores (S3, MinIO).

- Exposure to Docker/Kubernetes for deployment.

- Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

📌 Data Engineer - PySpark (Noida)
🏢 Tekskills
📍 Noida

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (noida) / noida

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (noida) / noida