Job Title: Data Engineer+ Scala + Spark + SQL

Experience:
3–10 Years

Employment Type:
Full-Time

Location:
Bangalore

Job Summary

Notice Period: Immediate Joiners or candidates serving a short notice period will be preferred.

We are looking for an experienced
Data Engineer
with solid expertise in
Scala, Apache Spark, SQL, and GCP (or any cloud platform)
to build and scale enterprise-grade data platforms and pipelines.

Key Responsibilities
- Design, develop, and maintain scalable, fault-tolerant data pipelines and streaming architectures.
- Build and optimize real-time and batch data processing applications using
Apache Spark
,
Scala
, and
Apache Kafka
.
- Develop high-performance, cloud-based data engineering solutions on
GCP
or other cloud platforms (AWS/Azure).
- Write complex SQL queries and optimize data processing workflows.
- Design large-scale data architectures with a focus on performance, scalability, reliability, and security.
- Collaborate with Data Scientists, Business Analysts, and cross-functional teams to deliver data-driven solutions.




- Optimize existing ETL pipelines and improve system efficiency.
- Drive modern data engineering practices including CI/CD, automated testing, and data quality frameworks.

Mandatory Skills
- Strong hands-on experience with
Apache Spark
(Batch & Streaming)
- Strong programming expertise in
Scala
- Experience with
Apache Kafka
(Streaming, Producers/Consumers, Topic Management)
- Strong SQL development and query optimization skills
- Hands-on experience with
Google Cloud Platform (GCP)
or any major cloud platform (
AWS/Azure
)

Good to Have
- Experience with
Data Lakes
and
Lakehouse Architectures
(Delta Lake, Apache Iceberg, etc.)
- Knowledge of
Docker
and
Kubernetes
- Experience with workflow orchestration tools such as
Apache Airflow
- Understanding of DevOps practices and
CI/CD pipelines
- Exposure to monitoring and logging tools for distributed systems

Preferred Candidate Profile
- 3 + years of experience in Da

📌 Data engineer with Scala + spark + SQL (Bagalur)
🏢 HMG America
📍 Bagalur