We are looking for an experienced Data Engineer with robust Scala expertise to design, develop, and maintain scalable data processing pipelines. The candidate should have hands-on experience with Scala, Apache Spark, SQL, and distributed data processing.
Key Responsibilities
Develop and maintain scalable data pipelines and ETL/ELT workflows using Scala and Spark.
Write effective and optimized Scala code for large-scale data processing.
Build batch and real-time data processing solutions using Apache Spark.
Work with SQL for data extraction, transformation, validation, and analysis.
Design and implement data ingestion pipelines from multiple sources.
Perform data cleansing,
transformation, aggregation, and validation.
Optimize Spark jobs for performance, memory utilization, and scalability.
Work with distributed systems and large datasets.
Collaborate with Data Architects, Data Scientists, Developers, and Business teams.
Troubleshoot data pipeline failures and production issues.
Implement data quality, monitoring, and error-handling mechanisms.
Follow coding standards, CI/CD practices, and Agile development methodologies.
Mandatory Skills
Scala
Apache Spark / Spark SQL
SQL
Data Engineering / ETL / ELT
Distributed Data Processing
Data Pipelines
📌 Data Engineer Bengaluru (India)
🏢 First Meridian Business Services
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.