21 Aug
|
EVERSANA
|
India
We are seeking a highly skilled and motivated Data Ingestion Engineer to join our data platform team. This role involves building and maintaining scalable, reliable, and secure data pipelines that power analytics, reporting, and decision-making across the organization. You will work with tools like Azure Data Factory (ADF), dbt, PostgreSQL, Snowflake, SQL and Python to enable smooth data ingestion, transformation, and delivery across cloud and on-premise systems.
Key Responsibilities
Design, develop, and maintain data ingestion pipelines using ADF, dbt and Python
Ingest, transform, and load data from varon-premisesnal and external sources into Snowflake and PostgreSQL
Develop and manage modular SQL transformations using dbt
Build and automate scripts in Python for data parsing, validation, and integration when needed
Collaborate with data analysts, data scientists, and business teams to understand data requirements and deliver clean, usable datasets
Monitor and optimize performance of pipelines and troubleshoot ingestion issues
Implement data quality checks, logging, alerting, and governance processes
Maintain technical documentation of data pipelines and workflows
Required Skills & Experience:
4+ years of experience in data engineering, ETL development, or data integration
Experience with Azure Data Factory (ADF) for orchestration and pipeline automation
Proficiency with Python for scripting, automation, and data manipulation
Solid working knowledge of Snowflake and PostgreSQL
Experience using dbt for SQL-based transformation, version control, and documentation
Solid SQL skills and familiarity with data modeling concepts (e.g., star/snowflake schemas)
Familiarity with Git and version-controlled development settings Preferred Qualifications:
Experience with API integration and handling large data files (CSV, JSON, XML)
Familiarity with Azure Blob Storage, Azure Data Lake, or similar
📌 Data Ingestion Engineer Pune (India)
🏢 EVERSANA
📍 India