08 Aug
|
Sync Origins
|
Ahmedabad
08 Aug
Sync Origins
Ahmedabad
Role & responsibilities
Design, build and support batch and near-real-time data ingestion pipelines.
Ingest data from databases, APIs, SFTP, cloud storage and enterprise applications.
Work with formats such as CSV, JSON, XML, Parquet and Delta.
Build data pipelines using tools such as Airbyte, Azure Data Factory, Databricks, Snowflake and Microsoft Fabric.
Implement data validation, reconciliation, logging, monitoring and error handling.
Develop reusable and metadata-driven ingestion frameworks.
Apply CI/CD, version control and automated testing using Azure DevOps and Git.
Work with architects, analysts and data scientists to deliver enterprise data solutions.
Produce clear technical documentation and support production pipelines.
Preferred candidate profile
34 years of hands-on data engineering experience.
Solid experience building data ingestion and transformation pipelines.
Practical experience with Azure and/or AWS cloud technologies.
Hands-on experience with several of the following:
Airbyte
Azure Data Factory
Databricks
Snowflake
Microsoft Fabric
AWS Glue
Apache Spark
Solid SQL and Python skills.
Experience with Git, Azure DevOps and CI/CD pipelines.
Understanding of data quality, monitoring, security and cloud data architecture.
Positive problem-solving, communication and teamwork skills.
📌 Data Engineer Ahmedabad
🏢 Sync Origins
📍 Ahmedabad