17 Nov
|
ValueLabs
|
Chennai
We are seeking a highly skilled Data Engineer with strong expertise in Real-Time Data Engineering to design, build, and operate scalable streaming data pipelines. The ideal candidate will play a key role in enabling event-driven architecture and real-time analytics for mission-critical banking and analytics workloads.
Key Responsibilities
- Design, develop, and maintain scalable real-time data pipelines.
- Build and manage streaming data solutions using Apache Kafka and related technologies.
- Develop event-driven architectures to support business-critical applications.
- Ensure high availability, reliability, and performance of streaming platforms.
- Collaborate with Data Architects, Platform Teams, and Business Stakeholders to deliver data solutions.
- Implement data quality, governance, security, and compliance standards.
- Monitor, troubleshoot, and optimize data pipelines for low-latency and high-throughput processing.
- Support real-time analytics and data integration requirements.
Required Skills
- Strong experience with Apache Kafka, Kafka Connect,
and Kafka Streams.
- Hands-on expertise in Real-Time Data Processing and Streaming Architectures.
- Experience in designing and developing ETL/ELT data pipelines.
- Strong understanding of Event-Driven Architecture.
- Proficiency in SQL and programming languages such as Python, Java, or Scala.
- Experience with Cloud Platforms (AWS, Azure, or GCP).
- Knowledge of Distributed Data Systems and Contemporary Data Platforms.
- Experience in performance tuning and scalability optimization.
- Understanding of Data Governance, Security, and Compliance practices.
Preferred Skills
- Experience with Docker and Kubernetes.
- Exposure to Banking, Financial Services, or Analytics domains.
- Strong analytical and problem-solving skills.
- Ability to work in a fast-paced and collaborative environment.
Education
- Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
📌 Data Engineer (Chennai)
🏢 ValueLabs
📍 Chennai