We are looking for a Senior Data Engineer with 5+ years of experience in designing and building scalable batch and streaming data platforms. The ideal candidate should possess strong expertise in Python, advanced SQL, and hands-on experience with Apache Spark and PySpark for distributed data processing. Experience with cloud platforms such as AWS, Azure, or GCP is essential. The role involves developing ETL/ELT pipelines, implementing data ingestion, transformation, validation, and publishing workflows, and designing data lake, lakehouse, and data warehouse solutions. Candidates should have expertise in data modelling, performance optimization, change data capture (CDC), schema evolution, orchestration, monitoring, and data quality frameworks. Solid experience in managing production-grade data pipelines, operational reliability, and collaboration with analytics, AI/ML, and application teams is required. Excellent problem-solving and communication skills are essential.
Skills: apache spark,python,aws,sql
📌 Senior Data Engineer (Bengaluru)
🏢 TechWise Digital
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.