15 Aug
|
Global Software Solutions Group
|
Chennai
15 Aug
Global Software Solutions Group
Chennai
We are looking for an experienced Senior Data Engineer with strong expertise in Real-Time Streaming, Java, Apache Kafka, Apache Flink, and PySpark to build and operate high-performance, scalable streaming data platforms supporting enterprise Business Platforms and Risk & Compliance initiatives.
The ideal candidate will have extensive experience designing and implementing real-time data pipelines, event-driven architectures, and distributed data processing systems capable of handling high-volume, low-latency data workloads. This role requires strong engineering expertise in modern data platforms, stream processing, and Big Data technologies while collaborating closely with architects, platform teams, and business stakeholders.
Requirements
Key Responsibilities
Design, develop, and maintain scalable real-time data pipelines using Apache Kafka, Apache Flink, Java, and PySpark
Build high-throughput, low-latency streaming applications supporting enterprise-scale business and regulatory workloads
Develop event-driven data processing solutions using Kafka and up-to-date streaming technologies
Design and implement distributed data processing pipelines for real-time analytics and operational reporting
Collaborate with Data Architects, Platform Engineering teams, Analytics teams, and Business stakeholders to understand requirements and deliver scalable data solutions
Develop reusable, secure, and maintainable data engineering components following enterprise engineering standards
Optimize streaming jobs for performance, scalability, fault tolerance, and reliability
Build and maintain batch and streaming ETL/ELT pipelines using PySpark
Monitor, troubleshoot, and resolve production issues within streaming data platforms
Participate in architecture discussions and contribute to the design of modern enterprise data platforms
Ensure data quality, governance, monitoring, logging, and operational excellence across streaming pipelines
Participate in Agile/Scrum ceremonies including sp
📌 Senior Data Engineer (Chennai)
🏢 Global Software Solutions Group
📍 Chennai