Role & responsibilities

Key Responsibilities
Design, develop, and maintain end-to-end data pipelines and ETL/ELT processes using Databricks and other data engineering tools to support analytics and BI use cases.
Build and deploy cloud-native data and analytics solutions on AWS, leveraging services such as EKS, S3, and other relevant components for scalable and resilient architectures.
Develop backend services and APIs using Python and Flask to enable data access, automation workflows, and integration with downstream applications and dashboards.
Implement containerization and orchestration using Docker and Kubernetes (EKS preferred) to ensure reliable, portable, and scalable deployment of data and analytics workloads.
Set up and maintain CI/CD pipelines using Jenkins/Jenkins Core to automate build, test, and deployment processes for data engineering and analytics solutions.
Collaborate with data scientists, analysts, and BI developers to enable AI, machine learning, and advanced analytics use cases through well-structured, high-quality data.




Optimize data models, queries, and pipelines for performance, cost efficiency, and reliability across large-scale datasets and complex analytics workloads.
Implement data quality checks, monitoring, logging, and alerting to ensure data reliability, integrity, and timely availability for business stakeholders.
Contribute to data automation initiatives by identifying prospects to streamline manual processes and implementing robust automation solutions.
Ensure adherence to best practices in cloud security, data governance, and compliance for all data engineering and analytics solutions.
Support troubleshooting, root cause analysis, and performance tuning for data pipelines, cloud infrastructure, and analytics platforms.
Mentor junior team members and contribute to knowledge sharing, coding standards, and best practices within the data engineering and analytics team.

📌 Software Development Engineer Bengaluru
🏢 Mastek
📍 Bengaluru