We are seeking a highly skilled Data Engineer to architect with 5-9 Years of experience who can build enterprise-scale data platforms for smart metering/utility systems and multi-tenant SaaS applications. The ideal candidate will have deep expertise in up-to-date data engineering patterns, real-time data ingestion, and experience with Databricks Lakehouse architecture.

Key Responsibilities:

● Data Platform Architecture:
○ Design and implement scalable, multi-tenant data platforms following medallion architecture (Bronze/Silver/Gold layers)
○ Build loosely coupled, API-driven microservices for data ingestion, transformation, and serving
○ Ensure platform agnostic design supporting both on-premises and public cloud deployments (AWS, Azure, GCP)
○ Implement zero-trust security with RBAC, encryption at rest and in transit, and tenant isolation

● Data Ingestion & Integration:
○ Build pluggable connector frameworks supporting REST, SOAP, GraphQL, file-based ingestion, database replication, and event-driven sources
○ Implement near real-time data pipelines for streaming meter data, events,



and alarms
○ Handle multiple data sources with different schemas and formats (flat files, JSON, XML, database dumps)
○ Design adapters for multiple Head End Systems (HES) or vendor systems with seamless integration

● Data Processing & Transformation:
○ Develop business rule engines for data validation using historical patterns (statistical analysis: deviation, average,
median, standard deviation)
○ Implement data estimation algorithms for handling missing/incomplete data (5-25% gaps)
○ Build aggregation and virtual metering pipelines with arithmetic operations on interval data
○ Create billing determinant calculations and prepay billing processing systems.

● Real-Time & Batch Processing:
○ Design event-driven architectures with messaging queues (Kafka, RabbitMQ, AWS SQS) for alarm/event handling
○ Implement job scheduling for batch processing with monitoring and alerting
○ Build streami

📌 Data Engineer/Architect (India)
🏢 SourceFuse
📍 India