Key Responsibilities

Infrastructure Design and Management:

- Design and provision scalable, secure, and cost-efficient infrastructure on AWS using Terraform (mandatory).
- Deploy and manage services such as Databricks (on AWS) , Amazon Redshift , EMR , and RDS using Infrastructure-as-Code.
- Maintain version-controlled, reusable infrastructure modules in alignment with IaC best practices.

DevOps and CI/CD Automation:

- Develop and maintain CI/CD pipelines using Jenkins (mandatory) integrated with Git-based workflows.
- Automate infrastructure provisioning, testing, and deployment processes.
- Support CI/CD for data orchestration tools such as Airflow , Databricks , and Redshift .

Data Pipeline Platform Management:

- Collaborate with data engineers to build and deploy pipelines using AWS Glue , Kinesis , Lambda , S3 , and Redshift .
- Implement orchestration using Apache Airflow (open-source and AWS MWAA).
- Ensure reliability, scalability, and security throughout the data lifecycle.

Monitoring, Logging Optimization:

- Set up monitoring, logging, and alerting tools using CloudWatch , Prometheus , Grafana , and CloudTrail .
- Perform root-cause analysis, troubleshoot issues, and optimize infrastructure and pipeline performance.

Security and Compliance:

- Apply AWS security best practices across environments, including IAM , VPC , KMS , encryption, and network segmentation.
- Conduct audits and implement governance policies.

Documentation Collaboration:

- Work cross-functionally with DevOps, data engineering,



and cloud security teams.
- Document architecture, configurations, workflows, and reusables to drive team efficiency and knowledge sharing.

Required Skills Qualifications

Cloud Infrastructure-as-Code (IaC):

- Strong hands-on experience with AWS (EC2, S3, Lambda, RDS, Glue, Redshift, IAM, VPC, Kinesis).
- Expertise in Terraform for multi-account, multi-service AWS infrastructure.

DevOps CI/CD:

- Proficiency with Jenkins (mandatory).
- Experience with GitLab CI/CD, GitHub Actions, or AWS CodePipeline is a plus.
- Familiarity with Docker and Amazon EKS is desirable.

Data Platform Experience:

- Experience provisioning and operating platforms like Databricks , Amazon Redshift , and optionally Snowflake .
- Experience building and managing data pipelines using Glue , Airflow , and Step Functions .

Monitoring Troubleshooting:

- Robust understanding of observability tools and frameworks (e.g., CloudWatch, Grafana, Prometheus).

Scripting Automation:

- Proficient in Python , Bash , or similar scripting languages.

Security Governance:

- Hands-on with IAM roles/policies, VPC security, KMS encryption , and compliance controls.

Preferred Qualifications

- Certifications: AWS Solutions Architect, DevOps Engineer, or Data Analytics Specialty.
- Databricks, Redshift, or Snowflake certifications are a plus.
- Experience with other IaC tools (Ansible, CloudFormation) and workflow engines (Apache Airflow, MWAA).
- Exposure to big data platforms like EMR, Spark, or Hadoop.

📌 AWS Infrastructure Consultant (India)
🏢 Brighttier
📍 India