Profile Summary: Experienced Data Engineer with a robust focus on real-time data ingestion and streaming solutions. Skilled in designing and implementing robust, scalable pipelines for high-velocity data using Apache Kafka, AWS Cloud streaming tools, and ETL frameworks. Proven expertise in handling semi-structured data formats such as JSON and XML, and integrating data across cloud platforms with a keen eye on performance and reliability.
Core Competencies
Real-time Data Ingestion & Stream Processing
Apache Kafka – Topic configuration, producers/consumers, stream integration
AWS Streaming Services – EventBridge, Lambda, (optionally Kinesis, SQS)
ETL Design and Implementation – Batch and real-time
Data Transformation – Working with Talend for orchestration and transformation
Semi-structured Data Handling – Proficient with JSON and XML parsing
SQL – Advanced queries, tuning, and data validation
Python – Scripting for automation, transformation, and data pipeline development