Role: Senior Data EngineerLocation: Bangalore

Experience: 5+ Years

Employment Type: Full-Time

About the Role

We are looking for a Senior Data Engineer to join our team and work across the complete data engineering lifecycle—from concept and development through deployment and operations.

The role involves designing, building, and optimizing cloud-native data pipelines, real-time data processing solutions, APIs, microservices, and modern data platforms using Microsoft Azure, Kubernetes, Docker, Dagster, Apache Iceberg, Python, Java, SQL, and Golang.

This is a hands-on engineering role requiring strong expertise in data engineering, cloud platforms, containerization, DevOps, data architecture, and modern application development.

Key Responsibilities

- Data Integration & Engineering

- Design, develop, and maintain scalable and resilient real-time and batch data pipelines.
- Build data ingestion and processing workflows using:
- Azure App Service
- Azure Functions
- Azure Event Hub
- Azure Service Bus
- Azure Logic Apps
- Azure Cosmos DB
- Azure SQL
- ADLS Gen2
- Apache Iceberg
- Dagster
- Develop APIs and asynchronous data services.
- Optimize pipelines, storage, processing performance, scalability, and cloud costs.
- Work with diverse data sources and implement reliable data integration solutions.

2. Platform Engineering
- Containerize applications and workloads using Docker.
- Deploy and manage workloads using Kubernetes / AKS.
- Create and manage Helm charts.
- Implement Infrastructure-as-Code using Terraform.
- Implement platform observability through:
- Logs
- Metrics
- Distributed traces
- Alerts
- Work with monitoring and observability tools such as Grafana, Prometheus, ELK Stack, and Filebeat.
- Optimize platform scalability, failover, availability, and resource utilization.
- Troubleshoot and resolve production/platform issues to maintain continuous availability.

3. Data Modelling & Governance
- Design and maintain canonical schemas and dimensional data models.
- Manage schema evolution across data producers and consumers.
- Implement data lineage, quality checks, SLAs, and data versioning.
- Develop automated data validation and reconciliation frameworks.
- Ensure data governance and quality across the data platform.
- Work with metadata and governance tooling.

4. DevOps, CI/CD & Security
- Design and manage CI/CD pipelines using:
- GitHub Actions
- Azure DevOps
- Automate application deployment, testing, and operational workflows.
- Implement Infrastructure-as-Code using Terraform.
- Apply security-by-design principles.
- Work with:
- Azure Key Vault
- OAuth 2.0




- API authentication
- Encryption at rest and in transit
- RBAC / ABAC
- Data masking
- Secrets management
- Ensure compliance with relevant data protection regulations such as GDPR and PDPA.

5. Full-Stack Application Development
- Develop data-driven web applications, dashboards, and internal platform tools using:
- Next.js
- React
- TypeScript
- Build high-performance backend services and APIs using Golang (Go).
- Develop RESTful and event-driven microservices.
- Implement concurrency patterns and event-driven architectures.
- Deploy backend services on Kubernetes.
- Implement distributed tracing and telemetry using OpenTelemetry.

6. Collaboration & Technical Leadership
- Collaborate with Data Engineering, Analytics, Cybersecurity, Product, and ML/AI teams.
- Participate in architecture and design reviews.
- Conduct code reviews and maintain engineering best practices.
- Mentor junior engineers.
- Work as a bridge between Data Engineering and ML/AI initiatives.
- Communicate effectively with both technical and business stakeholders.

Required Skills & Experience
- 5+ years of professional Data Engineering experience.
- Strong proficiency in:
- Python
- Java
- SQL
- Strong experience in:
- Data architecture
- Data lakes
- Data pipelines
- Data collection
- Data warehousing
- Data processing
- Data analysis
- Data monitoring
- Data governance
- Hands-on experience with Microsoft Azure, particularly:
- Azure App Service
- Azure Functions
- Azure Event Hub
- Azure Service Bus
- Azure Logic Apps
- Azure Cosmos DB
- Azure SQL
- ADLS Gen2
- Strong experience with:
- Docker
- Kubernetes / AKS
- Helm
- Terraform
- CI/CD
- Knowledge of observability and monitoring tools:
- Grafana
- Prometheus
- Elasticsearch
- Logstash
- Kibana
- Filebeat
- Familiarity with Dagster orchestration.
- Experience with Apache Iceberg is highly relevant.
- Knowledge of data governance, metadata management, data lineage, and data quality frameworks.
- Exposure to security practices including:
- OAuth 2.0
- API authentication
- RBAC / ABAC
- Secrets management
- Encryption
- Data masking
- Knowledge of GDPR / PDPA or similar data protection regulations.
- Hands-on experience with Next.js / React / TypeScript.




- Experience developing backend services and APIs using Golang (Go).
- Experience with microservices, concurrency, REST APIs, and event-driven architectures.
- Experience with OpenTelemetry / distributed tracing is preferred.
- Strong communication and stakeholder-management skills.

Educational Qualifications

- Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related discipline.
- Cloud and/or Data Engineering certifications are preferred.

Domain Experience – Preferred Experience in large-scale operational environments such as:
- Aviation
- Cargo Handling
- Ground Handling
- Food Solutions
- Logistics
- Transportation
- Supply Chain
- Large-scale enterprise operations

Preferred Candidate Profile

We are looking for a hands-on Senior Data Engineer who can work across Data Engineering + Azure Cloud + Kubernetes + DevOps + Backend Engineering + up-to-date data applications.

The ideal candidate should be comfortable working in an environment involving real-time data, cloud-native architectures, APIs, microservices, data platforms, observability, and ML/AI integration.

Personal Characteristics

- Strong analytical and problem-solving skills
- Engineering and solution-oriented mindset
- Comfortable working in ambiguous and fast-changing environments
- Strong ownership and accountability
- Excellent communication skills
- Ability to collaborate across technical and business teams
- Strong learning and mentoring mindset

#Hiring #NowHiring #SeniorDataEngineer #DataEngineer #DataEngineering #AzureDataEngineer #Azure #MicrosoftAzure #AzureCloud #AzureData #AzureFunctions #AzureAppService #AzureEventHub #AzureServiceBus #AzureCosmosDB #AzureSQL #ADLS #ADLSGen2 #ApacheIceberg #Dagster #Python #Java #SQL #DataArchitecture #DataPipelines #DataLake #DataEngineeringJobs #CloudDataEngineering #CloudNative #Docker #Kubernetes #KubernetesJobs #AKS #Helm #Terraform #InfrastructureAsCode #IaC #DevOps #DevOpsJobs #CICD #GitHubActions #AzureDevOps #Grafana #Prometheus #ELK #Elasticsearch #Logstash #Kibana #Filebeat #Observability #DataGovernance #DataQuality #DataLineage #MetadataManagement #DataSecurity #AzureKeyVault #OAuth2 #RBAC #ABAC #GDPR #PDPA #NextJS #ReactJS #TypeScript #Golang #GoLang #GoDeveloper #BackendEngineering #Microservices #RESTAPI #EventDrivenArchitecture #OpenTelemetry #DistributedTracing #MLOps #AIEngineering #MLAI #DataPlatform #SoftwareEngineering #TechHiring #ITJobs #TechJobs #BangaloreJobs #BangaloreHiring #BengaluruJobs #BengaluruHiring #IndiaJobs #HiringInBangalore #JobsInBangalore

📌 Sr Data Engineer (Bengaluru)
🏢 NAZZTEC
📍 Bengaluru