24 Aug
|
Aventus Informatics
|
India
24 Aug
Aventus Informatics
India
About the Role
We are looking for a Data Engineer who can manage data pipelines, integrations, data workflows, and orchestration using tools such as Kestra. The ideal candidate will be responsible for ensuring that data moves reliably between different systems, is properly transformed and validated, and is available for analytics, reporting, AI applications, and business operations.
This role requires someone who is comfortable working with databases, APIs, ETL/ELT processes, workflow orchestration, and cloud-based data infrastructure.
Key Responsibilities
- Design, build, maintain, and monitor data pipelines using Kestra and other ETL/ELT tools.
- Create and manage scheduled, event-driven, and automated workflows.
- Integrate data from APIs, databases, SaaS platforms, files, and other external sources.
- Perform data extraction, transformation, validation, and loading.
- Manage data across different databases and systems.
- Monitor pipeline execution, identify failures, troubleshoot issues, and ensure timely resolution.
- Implement error handling, retries, logging, alerts,
and pipeline monitoring.
- Ensure data accuracy, consistency, completeness, and reliability.
- Develop SQL queries for data extraction, transformation, validation, and analysis.
- Work with relational and non-relational databases.
- Build reusable and scalable data workflows.
- Manage data ingestion from third-party APIs and external systems.
- Document pipelines, workflows, integrations, dependencies, and data sources.
- Optimize existing pipelines for performance, reliability, and cost.
- Collaborate with software developers, BI/analytics teams, product teams, and business stakeholders.
- Support data requirements for dashboards, reporting, automation, and AI/ML applications.
- Maintain appropriate data security, access controls, and governance practices.
Required Skills
- Solid knowledge of SQL and relational databases.
- Hands-on experience with Kestra or similar workflow orchestration p
📌 Data Engineer (India)
🏢 Aventus Informatics
📍 India