Data and Event Streaming Engineer (Bengaluru)

Data and Event Streaming Engineer (Bengaluru)

03 Sep
|
Tecnicas Reunidas
|
Bengaluru

03 Sep

Tecnicas Reunidas

Bengaluru

Técnicas Reunidas is a world-leading international general contractor engaged in the engineering and construction of industrial facilities in the fields of Oil & Gas, Petrochemicals, Power Generation, Energy Transition, Infrastructures and industries, etc. Tecnicas Reunidas has worked and built all over the world, in 60 countries of the 5 continents.

Professionals with relevant design experience in the industry sectors of Oil & Gas, Refinery, Power Plant, and Petrochemical and having good knowledge in the following activities:

RESPONSIBILITIES

- Define and govern canonical event contracts, schemas, source/asset identifiers, timestamps, quality indicators, traceability metadata and schema-versioning practices.
- Design and implement reliable ingestion and event-streaming pipelines between the central Data Lake and SA platform services.
- Design and configure Apache Kafka topics, partitions, replication, keys, consumer groups, retention, compaction, offset-management and replay strategies.
- Develop and maintain Kafka Connect source/sink connectors and custom integration services where required.
- Implement event normalization, enrichment, validation, idempotency, deduplication, late/out-of-order event handling, retries, dead-letter processing and recovery.
- Manage event schemas and schema evolution using Schema Registry and Avro, Protobuf and/or JSON Schema.
- Monitor throughput, consumer lag, latency, pipeline freshness, connector health, failed records and data quality and support burst, failover, replay and recovery testing.




- Design PostgreSQL and short-term operational event/state storage without duplicating long-term data maintained in the enterprise Data Lake/historian.
- Integrate event/data flows with Java/Spring Boot SA Core services and Python-based AI services.
- Integrate AI outputs including detections, anomaly events, confidence values, predictions and model-version information into Kafka, SA and the Data Lake.
- Develop representative data generators, event simulators and controlled plant scenarios for functional, load and recovery testing.
- Collaborate with backend, frontend/3D, Data Lake and AI engineers to define reliable and documented event/data interfaces.
- Deploy and troubleshoot containerized streaming services on Linux/Docker in restricted on-premises and air-gapped-capable environments.

Technical Skills Apache Kafka: Strong production experience with topics, partitions, replication, producers/consumers, consumer groups, offsets, retention, compaction, keys, ordering, replay and consumer lag.

Kafka Connect: Hands-on experience with source/sink connectors, connector configuration, troubleshooting and custom integrations.

Event Processing: Strong knowledge of idempotency, deduplication, retries, DLQ, replay, backpressure, delivery semantics and failure recovery.

Event Schemas: Experience with Schema Registry and Avro,



Protobuf and/or JSON Schema, including schema evolution and compatibility.

Programming: Strong Python and/or Java skills for connector development, streaming services, transformations, validation and test-data generation.

Data: Solid SQL/PostgreSQL skills, schema design, indexing, query optimization, metadata management and data-quality processing.

Data Lake: Understanding of Parquet, partitioning, metadata and Data Lake ingestion/retrieval patterns.

Industrial Data: Working knowledge of historian/time-series, telemetry, asset/tag and engineering data; OPC UA/MQTT familiarity preferred.

AI Integration: Understanding of AI inference data flows and integration of detections, confidence scores, anomaly events, predictions and model-version metadata.

Platform: Docker, Linux, networking fundamentals, secure service-to-service communication, monitoring/logging and CI/CD.

Observability: Consumer lag, throughput, end-to-end latency, connector health, pipeline freshness and data-quality monitoring.

Deployment: Experience with containerized on-premises/restricted-network environments; solutions must not depend on mandatory public-cloud services.

Benefits & Perks

- Exposure to work at International Assignments and Clients
- Adaptable work time
- Full time role
- Attractive Salary and Packages.

Diversity and equality At Técnicas Reunidas, we have a strong commitment to equal opportunities for women and men, as well as to diversity. To this end, we carry out rigorous recruitment processes that ensure these principles.

📌 Data and Event Streaming Engineer (Bengaluru)
🏢 Tecnicas Reunidas
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data and event streaming engineer (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data and event streaming engineer (bengaluru) / bengaluru