Data Platform Engineer (Chennai)

Data Platform Engineer (Chennai)

01 Oct
|
EY
|
Chennai

01 Oct

EY

Chennai

Senior / Manager The opportunity

Your role will be a Technology Lead, or Senior Technology Lead in the Cloud Engineering team. You will be responsible to be a part of the delivery of IT projects for our customers across the globe.

Your key responsibilities

Architect and manage Databricks/Snowflake infrastructure on Azure and AWS, ensuring scalable, secure, and cost-effective deployments.

Establish and enforce data governance frameworks (including access controls, lineage, and compliance) across cloud and on-premises environments.

Design and implement DataOps and MLOps pipelines for automated data ingestion, transformation, model training, deployment, and monitoring.

Automate infrastructure provisioning using Terraform, ARM Templates, or Bicep for Databricks/Snowflake workspaces, clusters, and supporting resources.

Integrate Databricks/Snowflake with enterprise CI/CD pipelines (Azure DevOps, GitHub Actions, Jenkins, etc.) for code, data, and model lifecycle management.

Implement monitoring, logging, and alerting for Databricks workloads using native and third-party tools (e.g., Azure Monitor, AWS CloudWatch, Datadog).

Optimize Databricks cluster performance and cost, including autoscaling, spot instance usage, and job scheduling.

Ensure security best practices: manage secrets, network isolation, encryption, and compliance with organizational and regulatory standards.

Collaborate with data engineering, analytics, and ML teams to enable seamless integration and workflow automation.

Drive adoption of DevSecOps practices: integrate security scanning and compliance checks into DataOps/MLOps pipelines.

Lead incident response and root cause analysis for Databricks platform issues, ensuring high availability and reliability.

Document architecture, processes, and best practices for knowledge sharing and operational excellence.

Skills and attributes for success

Expertise in Databricks/Snowflake administration, including workspace, cluster, and job management.

Robust knowledge of cloud platforms (Azure, AWS), including networking, IAM, and cost management.

Proficiency in Infrastructure as Code (Terraform, ARM, Bicep) and automation scripting (Python, Bash, PowerShell).

Experience with CI/CD tools (Azure DevOps, GitHub Actions, Jenkins) and source control (Git).

Deep understanding of DataOps and MLOps concepts, including orchestration, versioning, and monitoring.

Familiarity with data governance tools and frameworks (Unity Catalog, Purview, AWS Lake Formation, etc.).

Ability to design secure, compliant, and scalable data architectures in multi-cloud environments.

Strong troubleshooting and performance optimization skills for distributed data and ML workloads.

Excellent communication and stakeholder management skills; ability to lead cross-functional teams and drive platform adoption.

Experience with monitoring and observability tools (Datadog, Prometheus, Grafana, Azure Monitor).

Knowledge of DevSecOps practices and integrating security tools into data pipelines.

Ability to mentor and upskill teams on Databricks, DataOps, and MLOps best practices.





Strong analytical and problem-solving skills; ability to assess risks and propose mitigation strategies.

Experience with regulatory compliance (GDPR, HIPAA, etc.) in cloud data environments is a plus.

Capability to identify software packages and solutions that could meet client solution requirements and develop requests for proposal (RFPs) from these vendors. Assist clients in the evaluation of the resulting proposals, including the package capabilities and fit to the requirements (business and technology), vendor proposals for pricing and support.

Capability to design and developed AI infused DevOps and Platform Engineering framework.

To qualify for the role, you must have

BE/B.Tech/MCA with a sound industry experience of 4 to 8 years

Cloud Computing knowledge in multi cloud environments (Azure, AWS)

Hands-on experience with Databricks administration on Azure and/or AWS, including workspace, cluster, and job management

DevOps – Setting up CI/CD pipeline using Azure DevOps, GitHub Actions, or GitLab CI

Strong understanding of DataOps and MLOps practices, including orchestration, monitoring, and governance

Hands-on experience with containerization, including Docker & Kubernetes (AKS/EKS/GKE)

Scripting Knowledge on PowerShell, python, Groovy, Shell Scripting and cloud native CLIs

Must be good in IAC tools such as Terraform or ARM or Bicep

Must be good in Config Management Tools such as Ansible or Chef or Puppet

Expertise in Golden Paths creation for end-to-end developer workflows.

Preferred Skills

Microsoft Certified: DevOps Engineer Expert (AZ-400)

Microsoft Certified: Designing Microsoft Azure Infrastructure Solutions (AZ-305)

Microsoft Certified: Azure Solutions Architect Expert

AWS Certified DevOps Engineer – Professional

AWS Certified Solutions Architect – Associate

Hashicorp Certified: Terraform Associates

Certified Kubernetes Administrator (CKA)

GitHub Actions

Github Copilot

Good to have knowledge in Terraform Cloud, Ansible Tower

Your people responsibilities

Foster teamwork and lead by example

Participating in the organization-wide people initiatives

Ability to travel in accordance with client and other job requirements

Excellent written and oral communication skills; writing, publishing, and conference-level presentation skills a plus

Technologies and Tools

Cloud platform – Azure, AWS

SDLC Methodologies: Agile /Scrum

Version Control Tools – GitHub/ Bitbucket/GitLab

CI/CD Automation Tools – Azure DevOps/ Bamboo/ Team City/ Harness/ Octopus

Container Management Tools – Docker/Kubernetes/Docker Swarm

Application Performance Management Tools – Prometheus/ Dynatrace/ AppDynamics





Monitoring Tools – Splunk/ Datadog/ Grafana

IAC Tools – Terraform/ARM Templates/ Bicep

Config Management Tools – Chef/ puppet/ Ansible

Test Automation Tools – Selenium/Cucumber

Artifact Management Tools – Jfrog Artifactory/Nexus/CloudRepo/Azure Artifactory

Scripting - Python/Groovy/PowerShell/Shell Scripting

SAST/ DAST: SonarQube / Veracode/ Fortify

GitOps Tool – Argo CD/ Flux CD

GenAI Technology – Chat GPT, OpenAI

What we look for

Has successfully demonstrated CI/CD Automation skills and technologies during many relevant projects

Strong experience in the use of DevOps Tools and technologies, including container technologies.

Proven experience in Infrastructure Automation (IAC Tools + Config Mgmt. Tool) and experience in Application Automation using Azure DevOps

Working experience in Azure and strong knowledge in cloud Architecture strategy.

Good Exposure in Cloud and Container Monitoring and logging and troubleshooting.

Strong understanding of Cloud related concepts and technologies, and maintains an in-depth knowledge of the area

Experience designing and conducting research and experiments with recently developed technologies

What we offer

EY Global Delivery Services (GDS) is a dynamic and truly global delivery network. We work across six locations – Argentina, China, India, the Philippines, Poland, and the UK – and with teams from all EY service lines, geographies, and sectors, playing a vital role in the delivery of the EY growth strategy. From accountants to coders to advisory consultants, we offer a wide variety of fulfilling career opportunities that span all business disciplines.

In GDS, you will collaborate with EY teams on exciting projects and work with well-known brands from across the globe. We’ll introduce you to an ever-expanding ecosystem of people, learning, skills, and insights that will stay with you throughout your career.

- Continuous learning: You’ll develop the mindset and skills to navigate whatever comes next.
- Success as defined by you: We’ll provide the tools and flexibility, so you can make a meaningful impact, your way.
- Transformative leadership: We’ll give you the insights, coaching and confidence to be the leader the world needs.
- Diverse and inclusive culture: You’ll be embraced for who you are and empowered to use your voice to help others find theirs.

About EY EY | Building a better working world

EY exists to build a better working world, helping to create long-term value for clients, people and society and build trust in the capital markets.

Enabled by data and technology, diverse EY teams in over 150 countries provide trust through assurance and help clients grow, transform, and operate.

Working across assurance, consulting, law, strategy, tax, and transactions, EY teams ask better questions to find current answers for the complex issues facing our world today.

If you can demonstrate that you meet the criteria above, please contact us as soon as possible.

The exceptional EY experience. It’s yours to build.

📌 Data Platform Engineer (Chennai)
🏢 EY
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data platform engineer (chennai) / chennai

Subscribe to this job alert:

Get the latest job offers by email for: data platform engineer (chennai) / chennai