Job Title: Data Engineer Scala | Spark | Kafka | GCP

Experience: 5 to 12 Years
Employment Type: Full-Time
Location: Bangalore (Onsite)

Immediate joiner prefer

Job Summary

We are looking for an experienced Data Engineer with strong expertise in Scala, Apache Spark, Apache Kafka, and GCP to design, build, and optimize scalable data platforms and high-performance data pipelines.

Key Responsibilities

- Design, develop, and maintain scalable, fault-tolerant data pipelines.
- Build real-time and batch data processing applications using Apache Spark, Scala, and Kafka.
- Develop and optimize enterprise-scale data engineering solutions.
- Work closely with data scientists, analysts, and business teams to deliver data-driven solutions.
- Optimize data processing workflows for performance, reliability, and scalability.
- Implement monitoring, logging, and alerting for production data pipelines.
- Follow best practices for coding, testing, deployment, and data quality.
- Support CI/CD implementation and automation for data engineering workflows.

Mandatory Skills

- Solid hands-on experience with Scala




- Expertise in Apache Spark (Batch & Structured Streaming)
- Strong experience with Apache Kafka
- Experience with Google Cloud Platform (GCP)
- Strong understanding of distributed systems and big data technologies.
- Experience designing and developing scalable data pipelines.
- Excellent analytical, problem-solving, and communication skills.
- Ability to work in a fast-paced Agile environment.

Good to Have

- Experience with AWS or Azure
- Knowledge of Delta Lake, Apache Iceberg, or Lakehouse architecture
- Experience with Docker and Kubernetes
- Hands-on experience with Apache Airflow or other workflow orchestration tools
- Exposure to DevOps practices and CI/CD pipelines

Preferred Qualifications

- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
- Experience working with enterprise-scale data engineering projects.
- Strong ownership mindset with the ability to deliver high-quality solutions.

📌 Data Engineer / GCP or Any cloud (Hyderabad)
🏢 3minds Esolutions
📍 Hyderabad