02 Sep
|
Tecnicas Reunidas
|
Bengaluru
02 Sep
Tecnicas Reunidas
Bengaluru
Técnicas Reunidas is a world-leading international general contractor engaged in the engineering and construction of industrial facilities in the fields of Oil & Gas, Petrochemicals, Power Generation, Energy Transition, Infrastructures and industries, etc. Tecnicas Reunidas has worked and built all over the world, in 60 countries of the 5 continents.
Professionals with relevant design experience in the industry sectors of Oil & Gas, Refinery, Power Plant, and Petrochemical and having positive knowledge in the following activities:
RESPONSIBILITIES
Define and govern canonical event contracts, schemas, source/asset identifiers, timestamps, quality indicators, traceability metadata and schema-versioning practices.
Design and implement reliable ingestion and event-streaming pipelines between the central Data Lake and SA platform services.
Design and configure Apache Kafka topics, partitions, replication, keys, consumer groups, retention, compaction, offset-management and replay strategies.
Develop and maintain Kafka Connect source/sink connectors and custom integration services where required.
Implement event normalization, enrichment, validation, idempotency, deduplication, late/out-of-order event handling, retries, dead-letter processing and recovery.
Manage event schemas and schema evolution using Schema Registry and Avro, Protobuf and/or JSON Schema.
Monitor throughput, consumer lag, latency, pipeline freshness, connector health, failed records and data quality and support burst, failover, replay and recovery testing.
Design PostgreSQL and short-term operational event/state storage without duplicating long-term data maintained in the enterprise Data Lake/historian.
Integrate event/data flows with Java/Spring Boot SA Core services and Python-based AI services.
Integrate AI outputs including detections, anomaly events, confidence values, predictions and model-version information into Kafka, SA and the Data Lake.
Develop representative data generators, event simulators a
📌 Data and Event Streaming Engineer (Bengaluru)
🏢 Tecnicas Reunidas
📍 Bengaluru