Data Platform Engineer (Pipeline) 4–8 years | AWS · Snowflake · Python · Airflow

Responsibilities

● Build and maintain ELT pipelines on Snowflake and AWS (S3, Lambda, Glue) following a medallion lakehouse architecture (Bronze → Silver → Gold)

● Write and manage Apache Airflow DAGs on AWS MWAA for ingestion workflows covering SFTP/FTP, S3, database, and API-based sources

● Work within a Spec-Driven Development (SDD) approach — translating data requirements and mapping documents into pipeline specs with AI-assisted tooling

● Monitor pipeline health, respond to incidents on rotation, and document findings clearly

● Follow GitLab CI/CD and Terraform standards for code deployment and infrastructure changes

Skills





● Solid Python skills: data pipelines, scripting, and basic Lambda handlers

● Hands-on Snowflake: Streams, Tasks, Stored Procedures, and query writing

● Working knowledge of AWS: S3, Lambda, Glue, MWAA, and IAM basics

● Valuable SQL: comfortable with complex queries and transformation logic

● Familiarity with Terraform and GitLab CI/CD workflows

● Exposure to dbt or similar tools is a plus

● Willingness to work with AI-assisted development tools like Cursor AI

📌 Data Platform Eng_4yrs+_Kol (Kolkata)
🏢 Arminus
📍 Kolkata