Job DescriptionKey Responsibilities:
N
- n
- Design, build, and maintain CI/CD pipelines using Azure DevOps for automated testing, container image builds, and deployment N
- Containerise the data quality platform using Docker and manage deployment of container images across Business environments using Kubernetes N
- Spin up and configure recent container instances when onboarding new Business areas onto the platform N
- Develop and maintain automated testing frameworks covering unit, integration, and end-to-end testing N
- Design, build, and expose RESTful APIs to integrate the platform with upstream and downstream systems N
- Collaborate with the Data Architecture team to ensure platform components are modular, platform-agnostic, and deployable across cloud and on-premise environments N
- Work with Azure services including Azure Container Registry, Azure Kubernetes Service, Azure Key Vault, Azure Blob Storage, and Azure DevOps N
- Develop and optimise data pipelines using PySpark and SQL Server N




- Support the integrationof Databricks workloads into the platform architecture N
- Ensure platform security standards are met including secret management, image vulnerability scanning, and access controls N
- Contribute to technicaldocumentation, runbooks, and onboarding guides for Business teams N

nRequired Skills & Experience:
N
- n
- 8–12 years of experience in data engineering or platform engineering roles N
- Strong hands-on experience with Azure services — AKS, ACR, Key Vault, Blob Storage, Azure DevOps N
- Proven experience containerising applications using Docker and orchestrating with Kubernetes N
- Solid experience building and maintaining CI/CD pipelines in Azure DevOps N
- Experience designing and building RESTful APIs N
- Proficiency in PySpark and SQL Server N
- Experience with Databricks — job orchestration, cluster management, notebook development N
- Strong understanding ofsoftware testing practices — unit testing, integration testi

📌 Hiring: Senior Data Engineer (Karnataka)
🏢 TEKsystems
📍 Karnataka