Profile Summary: Experienced Data Engineer with a robust focus on real-time data ingestion and streaming solutions. Skilled in designing and implementing robust, scalable pipelines for high-velocity data using Apache Kafka, AWS Cloud streaming tools, and ETL frameworks. Proven expertise in handling semi-structured data formats such as JSON and XML, and integrating data across cloud platforms with a keen eye on performance and reliability.
Core Competencies
- Real-time Data Ingestion & Stream Processing
- Apache Kafka – Topic configuration, producers/consumers, stream integration
- AWS Streaming Services – EventBridge, Lambda, (optionally Kinesis, SQS)
- ETL Design and Implementation – Batch and real-time
- Data Transformation – Working with Talend for orchestration and transformation
- Semi-structured Data Handling – Proficient with JSON and XML parsing
- SQL – Advanced queries, tuning, and data validation
- Python – Scripting for automation, transformation, and data pipeline development