We are looking for a skilled Data Engineer with experience in Python, PySpark, and Apache Iceberg or Airflow to develop, maintain, and optimize data pipelines.
Key Responsibilities:
- Develop and maintain data pipelines using Python and PySpark.
- Work with large datasets and distributed data processing.
- Implement and manage data workflows using Apache Airflow.
- Work with Apache Iceberg for data storage and table management.
- Troubleshoot pipeline failures and optimize data processing performance.
- Ensure data quality, reliability, and consistency.
Required Skills:
- Solid experience in Python and PySpark.
- Hands-on experience with Apache Iceberg and/or Apache Airflow.
- Understanding of data engineering concepts and ETL/ELT pipelines.
- Knowledge of SQL and data processing frameworks.
- Strong problem-solving and debugging skills.
Job Locations: Bangalore / Chennai
📌 Data Engineer | Python | Pyspark | AirflowF | 4+ Years | Only Immediate Joiners (Bengaluru)
🏢 Innova ESI
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.