We are looking for a skilled Data Engineer with strong hands-on experience in building and maintaining data pipelines and data engineering solutions. The candidate should have good working knowledge of Kubernetes and Docker for deploying and managing data workloads. Experience with Apache Airflow is an added advantage.
Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL workflows.
Develop and optimize data processing solutions using Python, PySpark, and Apache Spark.
Containerize data engineering applications using Docker.
Deploy, manage, and troubleshoot data workloads on Kubernetes/K8s.
Build and maintain reliable data ingestion and transformation pipelines.
Monitor and troubleshoot data pipeline and application issues.
Work with cross-functional teams to understand data requirements and deliver scalable solutions.
Implement best practices for data quality, performance, reliability, and security.
Automate data workflows and deployments wherever required.
Must-Have Skills
Robust experience in Data Engineering.
Hands-on experience with Kubernetes / K8s.
Strong hands-on experience with Docker.
Good knowledge of Python.
Experience with Apache Spark / PySpark.
Strong understanding of ETL and data pipelines.
Good understanding of data processing and distributed systems.
Good to Have
Apache Airflow and DAG development.
Experience with AWS / Azure / GCP.
Kafka or other streaming technologies.
CI/CD and DevOps practices.
SQL and database technologies.
Experience working in Agile environments.
📌 Data Engineer (Bengaluru)
🏢 First Meridian Business Services
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.