- Design, build, and maintain robust CI/CD pipelines for automated deployment and management of data infrastructure and applications.
- Collaborate with data engineering teams to troubleshoot and resolve deployment and infrastructure-related issues.
Containerization & Orchestration
- Implement and manage containerized applications using Docker.
- Deploy and maintain orchestration solutions with Kubernetes for scalable infrastructure.
Infrastructure-as-Code (IaC) & Cloud Management
- Develop and maintain IaC using tools like Terraform for reproducible and version-controlled infrastructure.
- Manage cloud infrastructure (AWS, GCP, or Azure) ensuring security, compliance, and cost-efficiency.
Monitoring & Observability
- Establish monitoring, logging, and alerting solutions using tools such as Prometheus, Grafana, or Datadog.
- Ensure system reliability, performance, and operational excellence across the platform.
Optional / Advanced Responsibilities
- Manage infrastructure for data technologies like Apache Spark, Apache Airflow, or Kafka.
- Apply knowledge of customer analytics platforms such as RudderStack, Amplitude, Kochava, and Braze.
- Ensure cloud security best practices, IAM policies, and network security compliance.