07 Aug
|
Sync Origins
|
Ahmedabad
07 Aug
Sync Origins
Ahmedabad
Role & responsibilities
- Design, build and support batch and near-real-time data ingestion pipelines.
- Ingest data from databases, APIs, SFTP, cloud storage and enterprise applications.
- Work with formats such as CSV, JSON, XML, Parquet and Delta.
- Build data pipelines using tools such as Airbyte, Azure Data Factory, Databricks, Snowflake and Microsoft Fabric.
- Implement data validation, reconciliation, logging, monitoring and error handling.
- Develop reusable and metadata-driven ingestion frameworks.
- Apply CI/CD, version control and automated testing using Azure DevOps and Git.
- Work with architects, analysts and data scientists to deliver enterprise data solutions.
- Produce clear technical documentation and support production pipelines.
Preferred candidate profile
- 34 years of hands-on data engineering experience.
- Solid experience building data ingestion and transformation pipelines.
- Practical experience with Azure and/or AWS cloud technologies.
- Hands-on experience with several of the following:
- Airbyte
- Azure Data Factory
- Databricks
- Snowflake
- Microsoft Fabric
- AWS Glue
- Apache Spark
- Strong SQL and Python skills.
- Experience with Git, Azure DevOps and CI/CD pipelines.
- Understanding of data quality, monitoring, security and cloud data architecture.
- Good problem-solving, communication and teamwork skills.
📌 Data Engineer (Ahmedabad)
🏢 Sync Origins
📍 Ahmedabad