08 Nov
|
AgileEngine
|
Ahmedabad
08 Nov
AgileEngine
Ahmedabad
We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.
The mandatory requirements are 3+ years of Python, advanced SQL, Snowflake data modeling, and hands-on experience with Airflow, Spark/PySpark, and AWS S3.
Application — Share a few details about your experience and background.
Coding Challenge — If applicable, complete it in the coding language you are most comfortable with.
Video Interview — Record a short video introduction in English.
Technical Interview or Hiring Manager Interview — Discuss your experience and fit for the role.
Remote work — Work from where you feel most productive.
- Local presence in India — Work in a structured and compliant setting aligned with Indian regulations.
- Competitive compensation in INR — Receive compensation in INR, plus support for learning, education, and wellness.
- Exciting projects — Work with modern technologies for global clients and fast-growing companies.
Strong software engineering fundamentals.
- 3+ years of hands-on Python development experience.
- Advanced SQL , including complex joins, CTEs, window functions, and performance tuning.
- Snowflake data modeling.
- Apache Airflow — developing and testing pipelines in Airflow and Python.
- Apache Spark , including hands-on PySpark experience.
- Iceberg and Parquet data formats.
- AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
- Testing strategy experience, with the ability to hands-on debug and test code.
- At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
- Upper-intermediate English level.
Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization).
- Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations).
- Experience using AI tools for development.
Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
- Execute the migration of approximately 1,000 datasets to Snowflake.
- Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
- Ensure data quality and reliability throughout the migration process.
- Help accelerate the migration initiatives targeted for completion by the end of March 2027.
📌 Data Engineer SQL - Remote (m/w/d) (Ahmedabad)
🏢 AgileEngine
📍 Ahmedabad