This is primarily a Data Platform Support Engineer role that combines:
- Production support
- Cloud platform operations
- Data pipeline monitoring
- Incident management
- SQL and Python development
- Data quality assurance
The role is focused on ensuring that enterprise data platforms used by retail clients run reliably and efficiently. Core Technical Skills Required 1.
Workflow
Orchestration
Airflow
You Should Be Comfortable With:
- DAG creation and monitoring
- Task dependencies
- Scheduling and retries
- Airflow Operators
- Airflow logs troubleshooting
- Failure handling
Control-M
Expected Knowledge
- Job scheduling
- Monitoring batch processes
- s and notifications
- Job dependency management
- Restart and recovery procedures
2.
Cloud
Technologies
AWS
Focus Areas
- S3
- Glacier
- Storage lifecycle policies
- Permissions and IAM
- Data movement between buckets
Interview Questions
- Difference between S3 and Glacier?
- How do you recover archived data from Glacier?
- What causes S3 access issues?