Job highlights

- 2+ years of Data Engineering experience building and maintaining end-to-end ETL / ELT pipelines with large-scale datasets
- Strong hands-on Python and advanced SQL skills,with experience in Apache Airflow,Apache Spark / PySpark,and Apache Kafka

Responsibilities

- Migrate approximately 1,000 datasets to Snowflake, adapting existing data pipelines while ensuring data quality and reliability.
- Develop and maintain scalable ETL/ELT pipelines using Python, SQL, Apache Spark/PySpark, and Apache Airflow.
- Execute platform migrations, including Airflow 2 to 3, Confluent USE1 to USE2, and Hive to Iceberg using Snowpark Connect.
- Optimize data pipelines, queries, storage, and compute resources for performance, reliability, and cost efficiency.
- Implement data validation, testing, scheduling, and monitoring while collaborating with data platform, Engineering, and Finance teams.

Qualifications





- 2+ years of Data Engineering experience building and maintaining end-to-end ETL/ELT pipelines with large-scale datasets.
- Strong hands-on Python and advanced SQL skills, with experience in Apache Airflow, Apache Spark/PySpark, and Apache Kafka.
- Practical experience with Snowflake, data modeling, Iceberg/Parquet, and cloud data platforms, particularly AWS S3, Glue, and Athena.
- Experience in data pipeline migration, testing, troubleshooting, CI/CD, GitHub, and performance optimization; Snowflake and Airflow migration experience is an advantage.
- Independent problem-solver with solid analytical and communication skills, available to provide US timezone coverage

Disclaimer: This job posting and Location has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Data Engineer (Kanayannur)
🏢 Sinergia Media Labs
📍 Kanayannur