22 Sep
|
Tekskills
|
Chennai
Job Summary
Role & responsibilities Solid expertise in Apache Spark (batch + streaming) and Hive. Proficiency in Python, Scala, or Java. Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred). Experience working with Kafka, Solace, and object stores (S3, MinIO). Exposure to Docker/Kubernetes for deployment. Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).
Responsibilities
Robust expertise in Apache Spark (batch + streaming) and Hive.
Proficiency in Python, Scala, or Java.
Knowledge of orchestration tools (Airflow / Control-M) and SQL transformation frameworks (DBT preferred).
Experience working with Kafka, Solace, and object stores (S3, MinIO).
Exposure to Docker/Kubernetes for deployment.
Hands on experience of data Lakehouse formats (Iceberg, Delta Lake, Hudi).
📌 Data Engineer Pyspark Chennai
🏢 Tekskills
📍 Chennai