06 Aug
|
Randstad
|
Hyderabad
06 Aug
Randstad
Hyderabad
Job Description:
Skils: Confluent Kafka Admin, Confluent Cloud, GCP, flink, powerquery, confluence, concur, Data streaming
Responsibilities:
- Support the design, deployment, and maintenance of realtime data streaming pipelines using Kafka (Confluent), StreamSets, Datastream, and related tools.
- Build and maintain ingestion frameworks for HL7, FHIR, CCD, EDI, and other healthcare data formats.
- Develop and optimize streaming dataflows for lowlatency, highthroughput processing.
- Implement and manage Kafka clusters, topics, schemas, connectors, and security configurations.
- Configure and maintain StreamSets pipelines for batch and streaming ingestion.
- Use Datastream for change data capture (CDC) and realtime replication across systems.
- Build Looker dashboards and semantic models to support realtime analytics and operational insights.
- Collaborate with business stakeholders to understand requirements and translate them into scalable streaming solutions.
- Participate in CI/CD processes for deploying streaming pipelines and integration components.
- Support highavailability and disaster recovery strategies for streaming platforms.
- Monitor pipeline performance, troubleshoot issues, and implement tuning recommendations.
- Identify opportunities to automate manual tasks and streamline operational workflows.
- Ensure compliance with PHI/PII handling, HIPAA requirements, and enterprise data governance policies.
- Maintain documentation for streaming architectures, pipelines, and operational procedures.
- Stay current with streaming technologies and contribute to modernization initiatives.
📌 Lead Confluent Kafka with GCP | Hyderabad
🏢 Randstad
📍 Hyderabad