Project description

Design and build a data engineering pipeline , validate data , unit testing, integration testing , integration testing and implement in the production. Expecting Engineers with hands on experience on Spark, Scala and Java

Data Engineering Specialist (Scala/Java)
Pipeline Architecture: Design and build end-to-end data engineering pipelines, ensuring high-throughput and low-latency processing.
Core Engineering: Leverage deep hands-on expertise in Spark, Scala, and Java to develop complex, distributed data transformations.
Rigorous Testing: Lead the full engineering lifecycle, including unit testing, integration testing, and comprehensive data validation to ensure 100% accuracy.
Production Implementation: Take full ownership of deploying and maintaining pipelines in a high-stakes production workplace, ensuring enterprise-grade stability and reliability.
Operational Excellence: Continuously optimize and monitor production jobs for performance and scalability.

📌 Big Data Developer Karnataka
🏢 Grid Dynamics
📍 Karnataka