Job Title: Data Engineer – Scala
Experience:* 6+ Years
Work Mode: Hybrid (Pan India)
Shift: 11:00 AM – 9:00 PM
Job Description
We are looking for an experienced Data Engineer with 6+ years of expertise in building scalable data platforms and enterprise-grade data pipelines. The ideal candidate should have solid hands-on experience with Scala, Apache Spark, Python, SQL, and Azure/AWS cloud technologies.
Must-Have Skills
6+ years of Data Engineering experience
Robust hands-on experience with Apache Spark and Scala
Valuable experience in Python and advanced SQL
Experience with Azure and/or AWS cloud platforms
Expertise in designing and developing ETL/ELT pipelines
Experience with Azure Data Factory (ADF), AWS Glue, or similar tools
Strong understanding of Data Warehousing and Big Data technologies
Experience with CI/CD and Agile methodologies
Good-to-Have Skills
Azure Synapse Analytics
Apache Kafka / Streaming technologies
Databricks, Delta Lake, or Lakehouse Architecture
Data Governance and Data Quality frameworks
Exposure to ML/GenAI data pipelines
Key Responsibilities
Design, build, and optimize scalable batch and real-time data pipelines.
Develop ETL/ELT workflows using Spark, Scala, Python, and cloud-native services.
Build high-performance SQL queries and optimize data models.
Work with Azure/AWS data services for ingestion, transformation, and analytics.
Monitor, troubleshoot, and improve pipeline performance and data quality.
Collaborate with business, analytics, and engineering teams to deliver end-to-end data solutions.
Participate in code reviews, architecture discussions, and CI/CD implementation.