Position: Data Engineer (Platform Modernization & Migration)
Location: Fully Remote (EMEA & APAC Preferred)
Contract Type: Full time, Permanent
Time Zone Alignment: Requires overlap until at least 12:00 PM Pacific Time (PT)

? About Inallmedia.com
Inallmedia.com is a global technology and design firm focused on building impactful digital solutions through remote, distributed teams. We partner with international clients across industries, providing long-term technical expertise, product innovation, and team augmentation.

? Project Overview
You will join a core Data Engineering organization, working in close partnership with the Data Platform team to drive a major data platform modernization initiative. The primary focus of this project is executing pre-designed migration blueprints for approximately 1,000 datasets to Snowflake with Airflow 3 orchestration. You will play a crucial role in accelerating time-sensitive infrastructure goals by evolving legacy Lakehouse formats to Apache Iceberg, modernizing streaming infrastructure across cloud regions,



and adapting existing pipelines to uphold strict data quality and performance standards.

? Key Responsibilities

• Pipeline Migration & Upgrades: Execute the end-to-end migration of approximately 1,000 datasets to Snowflake, including upgrading orchestration workflows from Apache Airflow 2 to Airflow 3.
• Storage & Data Lake Modernization: Migrate legacy Hive data structures and datasets to Apache Iceberg format using the Snowpark Connect framework/connectors.
• Streaming Infrastructure & Region Migration: Reconfigure, update, and migrate Confluent/Apache Kafka streaming connections across cloud regions (e.g., migrating from US East 1 to US East 2).
• Pipeline Adaptation & Performance Tuning: Adapt existing data pipelines to target Snowflake environments while optimizing SQL queries (utilizing CTEs, window functions, and complex joins) to ensure high performance and data reliability.
• Workflow Scheduling & Monitoring: M

📌 2128 Data Engineer (Bengaluru)
🏢 In All Media
📍 Bengaluru