01 Sep
|
Sync Origins
|
India
01 Sep
Sync Origins
India
Role & responsibilities
Design, build and support batch and near-real-time data ingestion pipelines.
Ingest data from databases, APIs, SFTP, cloud storage and enterprise applications.
Work with formats such as CSV, JSON, XML, Parquet and Delta.
Build data pipelines using tools such as Airbyte, Azure Data Factory, Databricks, Snowflake and Microsoft Fabric.
Implement data validation, reconciliation, logging, monitoring and error handling.
Develop reusable and metadata-driven ingestion frameworks.
Apply CI/CD, version control and automated testing using Azure DevOps and Git.
Work with architects, analysts and data scientists to deliver enterprise data solutions.
Produce transparent technical documentation and support production pipelines.
Preferred candidate profile
34 years of hands-on data engineering experience.
Strong experience building data ingestion and transformation pipelines.
Practical experience with Azure and/or AWS cloud technologies.
Hands-on experience with several of the following:
Airbyte
Azure Data Factory
Databricks
Snowflake
Microsoft Fabric
AWS Glue
Apache Spark
Robust SQL and Python skills.
Experience with Git, Azure DevOps and CI/CD pipelines.
Understanding of data quality, monitoring, security and cloud data architecture.
Valuable problem-solving, communication and teamwork skills.
📌 Data Engineer Ahmedabad (India)
🏢 Sync Origins
📍 India