Administer, configure, and maintain GCP Composer (Apache Airflow) environments.• Manage Airflow DAGs and troubleshoot Airflow-related issues.• Monitor and optimize Composer performance and scalability.• Maintain GCP infrastructure including services like:o Google Cloud Storage (GCS)o BigQuery (BQ)o Cloud Dataflowo Cloud Dataproco Cloud Functions• Have Good Understanding of:o Virtual Private Cloud (VPC)o IAM and service account permissions• Monitor GCP usage and quotas, and proactively prevent quota-related issues.• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.• Ensure security, compliance, and cost-efficiency across the cloud environment.• Document system configurations, procedures, and best practices.• Proficient in either Java or Python programming languages.• Excellent problem-solving and troubleshooting skills.
Key Responsibilities
Administer, configure, and maintain GCP Composer (Apache Airflow)
environments.• Manage Airflow DAGs and troubleshoot Airflow-related issues.• Monitor and optimize Composer performance and scalability.• Maintain GCP infrastructure including services like:o Google Cloud Storage (GCS)o BigQuery (BQ)o Cloud Dataflowo Cloud Dataproco Cloud Functions• Have Positive Understanding of:o Virtual Private Cloud (VPC)o IAM and service account permissions• Monitor GCP usage and quotas, and proactively prevent quota-related issues.• Set up and manage alerting, logging, and monitoring using tools like Stackdriver (Cloud Monitoring & Logging).• Design and implement infrastructure as code using Terraform for provisioning and managing GCP resources.• Collaborate with DevOps and development teams to manage CI/CD pipelines using Jenkins and other automation tools.• Ensure security, compliance, and cost-efficiency across the cloud environment.• Document system configurations, procedures, and best practices.• Proficient in either Java or Python programming languages.• Excellent problem-solving and troubleshooting skills.