11 Nov
|
Algoworks
|
Itanagar
11 Nov
Algoworks
Itanagar
Job Description
We are looking for an experienced Senior Integration Data Engineer to design, develop and manage reliable data integrations between cloud-based data platforms and existing data-processing applications. The ideal candidate will have strong expertise in Python, SQL, APIs and data transformation, with the ability to build production-grade integration solutions that ensure data accuracy, consistency, compatibility and traceability across multiple systems. Total
Experience:
10+ years
Key Responsibilities
• Design and implement source-to-application integrations, integration adapters and data transformation workflows.
• Develop and maintain batch-processing and change-data-processing pipelines using Python and SQL.
• Work with REST APIs, XML, JSON and integration services to enable seamless data exchange.
• Ensure record identity, data consistency and compatibility across existing applications and systems.
• Implement robust logging, monitoring, retry, error-handling and replay mechanisms.
• Develop automated tests and validate integrations across multiple services.
• Troubleshoot end-to-end data flows and trace individual records across different systems and processing layers.
• Evaluate and recommend appropriate integration approaches, including application modifications, integration adapters and shared data models.
• Collaborate with cross-functional engineering teams to deliver reliable, scalable and maintainable integration solutions.
• Ensure production readiness,
system reliability and maintainability of integration workflows. Required Skills & Qualifications
• 9+ years of experience building and managing production-grade data integrations (overall role requirement : 10+ years).
• Robust hands-on experience with Python and SQL.
• Experience working with REST APIs and data formats such as XML and JSON.
• Solid understanding of batch processing and change-data processing.
• Experience developing integration adapters and data transformation workflows.
• Hands-on experience with automated testing, logging, retries and replay mechanisms.
• Ability to troubleshoot and trace data across multiple services and processing layers.
• Solid understanding of data consistency, record identity and end-to-end data traceability. Good To Have Skills
• Experience with AWS cloud services.
• Hands-on experience with RabbitMQ.
• Experience with MongoDB and Solr.
• Knowledge of cloud-based data platforms and distributed systems.
• Familiarity with CI/CD pipelines and DevOps practices. Desired Competencies
• Strong analytical, problem-solving and troubleshooting skills.
• Ability to make sound technical and architectural decisions.
• Focus on data accuracy, reliability and system compatibility.
• Strong communication and collaboration skills.
• Ability to work independently and take end-to-end ownership.
• Focus on maintainability, testability and production readiness. Interview Process
• 2 rounds of discussion (ref:hirist.tech)
📌 Algoworks - Senior Integration Data Engineer (Itanagar)
🏢 Algoworks
📍 Itanagar