- Design, develop, and maintain robust ETL pipelines using SSIS for batch data integration across enterprise systems.
- Build and manage real-time data streaming pipelines using Apache Kafka, including producers, consumers, topics, and Kafka Connect.
- Architect end-to-end data integration solutions that combine batch (SSIS) and streaming (Kafka) approaches.
- Collaborate with data architects, business analysts, and application teams to gather integration requirements and translate them into technical designs.
- Optimize existing ETL/ELT workflows for performance, scalability, and reliability.
- Implement data quality checks, error handling, logging, and monitoring across integration pipelines.
- Manage schema design, topic partitioning, and data serialization (Avro/JSON/Protobuf) within Kafka ecosystems.
- Work closely with DBAs and infrastructure teams to ensure integration solutions align with database and network architecture.
- Troubleshoot production issues related to data pipelines, latency, and throughput.
- Document technical designs, data flow diagrams, and integration standards.
- Mentor junior team members and enforce best practices in data integration development.
- Ensure compliance with data governance, security, and audit requirements.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Integration Engineer (Telangana)
🏢 NexTurn
📍 Telangana
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.