We are looking for a skilled Data Engineer with experience in Python, PySpark, and Apache Iceberg or Airflow to develop, maintain, and optimize data pipelines.
Key Responsibilities:
Develop and maintain data pipelines using Python and PySpark.
Work with large datasets and distributed data processing.
Implement and manage data workflows using Apache Airflow.
Work with Apache Iceberg for data storage and table management.
Troubleshoot pipeline failures and optimize data processing performance.
Ensure data quality, reliability, and consistency.
Required Skills:
Robust experience in Python and PySpark.
Hands-on experience with Apache Iceberg and/or Apache Airflow.
Understanding of data engineering concepts and ETL/ELT pipelines.
Knowledge of SQL and data processing frameworks.
Robust problem-solving and debugging skills.
Job Locations: Bangalore / Chennai
📌 Data Engineer Python Pyspark Airflowf 4+ Years Only Immediate Joiners Bengaluru
🏢 Innova ESI
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.