Airflow Infrastructure Engineer (Haryana)

Airflow Infrastructure Engineer (Haryana)

01 Aug
|
SSD Shared Services
|
Haryana

01 Aug

SSD Shared Services

Haryana

We are currently seeking a Airflow Infrastructure Engineer to join our team in Bangalore OR Gurgaon, Karn taka (IN-KA), India (IN).

Job Duties: Key Responsibilities
Docker & Environment Ownership
Own the Docker image and Docker Compose configuration across all environments (Development, QA, PreProd, and Production) including image selection, versioning, and Compose service definitions ensuring consistency and reproducibility across our VM-based deployment architecture.
Validate, troubleshoot, and resolve compatibility issues with infrastructure-provided Docker images for Airflow, ensuring they function correctly with our dbt, Python EL, and supporting service configurations.
Manage container networking, volume mounts, and environment variable configurations across deployment tiers.
Define and enforce a structured environment promotion process ensuring changes are validated in lower environments before being promoted to QA, PreProd and Production.
Establish and document rollback procedures for failed deployments.

Airflow Platform Administration
Administer and maintain the Airflow environment across all deployment tiers, including scheduler, webserver, worker, and metadata database components.
Manage Airflow configuration (airflow.cfg, environment variables, connections, variables, and pools) in alignment with the program s pipeline requirements across both migration workstreams.
Manage Python library dependencies within the Airflow environment installing, upgrading, and validating packages required by DAGs that invoke dbt and Python EL scripts.




Troubleshoot and resolve database connectivity issues arising from DAG execution, including connection pool configuration, driver compatibility, and credential management.
Monitor Airflow scheduler health, task execution, and log output; proactively identify and resolve platform-level issues before they impact delivery.
Support DAG deployment workflows in coordination with the CI/CD pipeline, ensuring DAG files are correctly promoted to the shared NAS and picked up by the Airflow scheduler.
Establish and maintain baseline alerting for Airflow scheduler failures, task SLA breaches, and workplace health thresholds.

Airflow Integration with Control-M
Configure and maintain the Airflow REST API endpoint used by Control-M to trigger DAG runs including authentication setup, access controls, and endpoint validation across environments.
Validate end-to-end job triggering: confirm that Control-M REST API calls are correctly received, authenticated, and processed by Airflow, and that DAG execution initiates as expected.
Troubleshoot failures at the Control-M-to-Airflow boundary, distinguishing between orchestration-layer issues and Airflow platform issues, and coordinating resolution with the relevant teams.




Coordinate with the scheduling team on Control-M job definitions, environment cutovers, scheduling changes, and production deployment windows.
Maintain documentation of the Control-M integration configuration, including API endpoint details, authentication patterns, and known failure modes.

Infrastructure Collaboration & Image Integration
Serve as the primary point of contact between the delivery team and infrastructure/platform teams for all environment-related requests, image issues, and dependency resolution.
Systematically diagnose and resolve compatibility issues between platform-provided Docker images and our specific Airflow + dbt + Python EL stack replacing trial-and-error with structured root cause analysis.
Communicate environment requirements, dependency constraints, and change requests to platform teams with sufficient technical precision to minimize iteration cycles.
Maintain a written log of image issues, resolutions, and configuration decisions to support knowledge transfer and reduce repeated effort.

Documentation & Operational Readiness
Produce and maintain infrastructure runbooks covering Docker image and Compose configurations, environment setup procedures, common failure scenarios, and recovery steps.

Disclaimer : This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.

📌 Airflow Infrastructure Engineer (Haryana)
🏢 SSD Shared Services
📍 Haryana

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: airflow infrastructure engineer (haryana) / haryana

Subscribe to this job alert:

Get the latest job offers by email for: airflow infrastructure engineer (haryana) / haryana