Job Description
Key Responsibilities:
n
- n
- Design, build, and maintain CI/CD pipelines using Azure DevOps for automated testing, container image builds, and deploymentn
- Containerise the data quality platform using Docker and manage deployment of container images across Business environments using Kubernetesn
- Spin up and configure new container instances when onboarding current Business areas onto the platformn
- Develop and maintain automated testing frameworks covering unit, integration, and end-to-end testingn
- Design, build, and expose RESTful APIs to integrate the platform with upstream and downstream systemsn
- Collaborate with the Data Architecture team to ensure platform components are modular, platform-agnostic, and deployable across cloud and on-premise environmentsn
- Work with Azure services including Azure Container Registry, Azure Kubernetes Service, Azure Key Vault, Azure Blob Storage, and Azure DevOpsn
- Develop and optimise data pipelines using PySpark and SQL Servern
- Support the integration of Databricks workloads into the platform architecturen




- Ensure platform security standards are met including secret management, image vulnerability scanning, and access controlsn
- Contribute to technical documentation, runbooks, and onboarding guides for Business teamsn

nRequired Skills & Experience:
n
- n
- 8–12 years of experience in data engineering or platform engineering rolesn
- Strong hands-on experience with Azure services — AKS, ACR, Key Vault, Blob Storage, Azure DevOpsn
- Proven experience containerising applications using Docker and orchestrating with Kubernetesn
- Solid experience building and maintaining CI/CD pipelines in Azure DevOpsn
- Experience designing and building RESTful APIsn
- Proficiency in PySpark and SQL Servern
- Experience with Databricks — job orchestration, cluster management, notebook developmentn
- Strong understanding of software testing practices — unit testing, integration testing, end-to-end t

📌 Senior Data Engineer (Bengaluru)
🏢 TEKsystems
📍 Bengaluru