Data Engineer Pyspark Noida

Data Engineer Pyspark Noida

17 Nov
|
Tekskills
|
Noida

17 Nov

Tekskills

Noida

Job highlights
Expertise in Apache Spark (batch + streaming), Hive, Python/Scala/Java, orchestration tools (Airflow/Control-M), Kafka, object stores (S3, MinIO), and data Lakehouse formats (Iceberg, Delta Lake, Hudi)
Develop and manage data pipelines using Spark and Hive; implement orchestration with Airflow/Control-M; work with Kafka and object stores; deploy using Docker/Kubernetes

Job Summary

Role &

responsibilities Solid expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO). Exposure to Docker/Kubernetes for deployment.



Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Responsibilities
Solid expertise in Apache Spark (batch + streaming) and Hive.
Proficiency in Python, Scala, or Java.
Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
Experience working with Kafka, Solace, and object stores (S3, MinIO).
Exposure to Docker/Kubernetes for deployment.
Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

📌 Data Engineer Pyspark Noida
🏢 Tekskills
📍 Noida

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer pyspark noida / noida

Subscribe to this job alert:

Get the latest job offers by email for: data engineer pyspark noida / noida