16 Sep
|
Tecnicas Reunidas
|
Bengaluru
16 Sep
Tecnicas Reunidas
Bengaluru
Job DescriptionTécnicas Reunidas is a world-leading international general contractor engaged in the engineering and construction of industrial facilities in the fields of Oil & Gas, Petrochemicals, Power Generation, Energy Transition, Infrastructures and industries, etc. Tecnicas Reunidas has worked and built all over the world, in 60 countries of the 5 continents.
NProfessionals with relevant design experience in the industry sectors of Oil & Gas, Refinery, Power Plant, and Petrochemical and having good knowledge in the following activities:
NRESPONSIBILITIES
n
N
- Define and govern canonical event contracts, schemas, source/asset identifiers, timestamps, quality indicators, traceability metadata and schema-versioning practices.
N
- Design and implement reliable ingestion and event-streaming pipelines between the central Data Lake and SA platform services.
N
- Design and configure Apache Kafka topics, partitions, replication, keys, consumer groups, retention, compaction, offset-management and replay strategies.
N
- Develop and maintain Kafka Connect source/sink connectors and custom integration services where required.
N
- Implement event normalization, enrichment, validation, idempotency, deduplication, late/out-of-order event handling, retries, dead-letter processing and recovery.
N
- Manage event schemas and schema evolution using Schema Registry and Avro, Protobuf and/or JSON Schema.
N
- Monitor throughput, consumer lag, latency, pipeline freshness, connector health, failed records and data quality and support burst, failover, replay and recovery testing.
N
- Design PostgreSQL and short-term operational event/state storage without duplicating long-term data maintained in the enterprise Data Lake/historian.
N
- Integrate event/data flows with Java/Spring Boot SA Core services and Python-based AI services.
N
- Integrate AI outputs including detections, anomaly events, confidence values, predictions and model-version information into Kafka, SA and the Data Lake.
N
- Develop representative data generators, event simulators and controlled plant scenarios for functional, load and recovery testing.
N
- Collaborate with backend, frontend/3D, Data Lake and AI engineers to define reliable and documented event/data interfaces.
N
- Deploy and troubleshootcontainerized streaming services on Linux/Docker in restricted on-premises and air-gapped-capable environments.
N
nTechnical Skills
NApache Kafka: Strong production experience with topics, partitions, replication, producers/consumers, consumer groups, offsets, retention, compaction, keys, ordering, replay and consumer lag.
NKafka Connect: Hands-on experience with source/sink connectors, connector configuration, troubleshooting and custom integrations.
NEvent Processing: Strong knowledge of idempotency, deduplication, retries, DLQ, replay, backpressure, delivery semantics and failure recovery.
NEvent Schemas: Experience with Schema Registry and Avro,
Protobuf and/or JSON Schema, including schema evolution and compatibility.
NProgramming: Strong Python and/or Java skills for connector development, streaming services, transformations, validation and test-data generation.
NData: Strong SQL/PostgreSQL skills, schema design, indexing, query optimization, metadata management and data-quality processing.
NData Lake: Understanding of Parquet, partitioning, metadata and Data Lake ingestion/retrieval patterns.
NIndustrial Data: Working knowledge of historian/time-series, telemetry, asset/tag and engineering data;
OPC UA/MQTT familiaritypreferred.
NAI Integration: Understanding of AI inference data flows and integration of detections, confidence scores, anomaly events, predictions and model-version metadata.
NPlatform: Docker, Linux, networking fundamentals, secure service-to-service communication, monitoring/logging and CI/CD.
NObservability: Consumer lag, throughput, end-to-end latency, connector health, pipeline freshness and data-quality monitoring.
NDeployment: Experience with containerized on-premises/restricted-network environments;
solutions must not depend on mandatory public-cloud services.
NBenefits & Perks
n
N
- Exposure to work at International Assignments and Clients
N
- Adaptable work time
n
- Full time role
N
- Attractive Salary and Packages.
N
nDiversity and equality
NAt Técnicas Reunidas, we have a strong commitment to equal opportunities for women and men, as well as to diversity. To this end, we carry out rigorous recruitment processes that ensure these principles.
📌 Data And Event Streaming Engineer (Bengaluru)
🏢 Tecnicas Reunidas
📍 Bengaluru