01 Sep
|
HMG America
|
Bangalore Rural
01 Sep
HMG America
Bangalore Rural
Job Description
Job Title: Data Engineer+ Scala + Spark + SQL
nExperience: 3–10 Years
nEmployment Type: Full time
nLocation: Bangalore
nJob Summary
nNotice Period: Immediate Joiners or candidates serving a short notice period will be preferred.
n
nWe are looking for an experienced Data Engineer with strong expertise in Scala, Apache Spark, SQL, and GCP (or any cloud platform) to build and scale enterprise-grade data platforms and pipelines.
n
nKey Responsibilities
n
- n
- Design, develop, and maintain scalable, fault-tolerant data pipelines and streaming architectures.n
- Build and optimize real-time and batch data processing applications using Apache Spark, Scala, and Apache Kafka.n
- Develop high-performance, cloud-based data engineering solutions on GCP or other cloud platforms (AWS/Azure).n
- Write complex SQL queries and optimize data processing workflows.n
- Design large-scale data architectures with a focus on performance, scalability, reliability, and security.n
- Collaborate with Data Scientists, Business Analysts,
and cross-functional teams to deliver data-driven solutions.n
- Optimize existing ETL pipelines and improve system efficiency.n
- Drive modern data engineering practices including CI/CD, automated testing, and data quality frameworks.n
nMandatory Skills
n
- n
- Strong hands-on experience with Apache Spark (Batch & Streaming)n
- Strong programming expertise in Scalan
- Experience with Apache Kafka (Streaming, Producers/Consumers, Topic Management)n
- Strong SQL development and query optimization skillsn
- Hands-on experience with Google Cloud Platform (GCP) or any major cloud platform (AWS/Azure)n
nGood to Have
n
- n
- Experience with Data Lakes and Lakehouse Architectures (Delta Lake, Apache Iceberg, etc.)n
- Knowledge of Docker and Kubernetesn
- Experience with workflow orchestration tools such as Apache Airflown
- Understanding of DevOps practices and CI/CD pipelinesn
- Exposure to monitoring and logging to
📌 Data engineer with Scala + spark + SQL (Bangalore Rural)
🏢 HMG America
📍 Bangalore Rural