Data Engineer with Scala , Kafka, GCP
Should know how to develop, deploy , monitor and optimize Etl workflows for both Batch and Streaming with Scala, Spark, Airflow, BQ , Kafka , Dataproc and GCP settings
Experience in Medallion architecture with proper Data quality checks and summarization activities
Experience in performance optimizations, Observability and runbook creations for continuous optimizations.
Valuable knowledge of Airflow orchestrations including dependency handing, idempotent execution etc.
Exposure to data governance and information security would be a plus
Through knowledge of handing streaming data including back pressure handling etc.
Minimum Experience 6+ years
📌 Data Engineer Scala Kafka Chennai (India)
🏢 Tata Consultancy Services
📍 India
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.