Data Engineer - PySpark (Chennai)

Data Engineer - PySpark (Chennai)

16 Nov
|
Tekskills
|
Chennai

16 Nov

Tekskills

Chennai

Job highlights

- Expertise in Apache Spark (batch + streaming), Hive, Python/Scala/Java, orchestration tools (Airflow/Control-M), Kafka, object stores (S3, MinIO), and data Lakehouse formats (Iceberg, Delta Lake, Hudi)

- Develop and manage data pipelines using Spark and Hive; implement orchestration and SQL transformations; deploy solutions with Docker/Kubernetes; handle streaming and batch data processing

Job Summary

Role &

responsibilities Robust expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

Experience working with Kafka, Solace, and object stores (S3, MinIO). Exposure to Docker/Kubernetes for deployment.



Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

Responsibilities

- Strong expertise in Apache Spark (batch + streaming) and Hive.

- Proficiency in Python, Scala, or Java.

- Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).

- Experience working with Kafka, Solace, and object stores (S3, MinIO).

- Exposure to Docker/Kubernetes for deployment.

- Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).

📌 Data Engineer - PySpark (Chennai)
🏢 Tekskills
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (chennai) / chennai

Subscribe to this job alert:

Get the latest job offers by email for: data engineer - pyspark (chennai) / chennai