23 Oct
|
DoublU
|
Bengaluru
Role Overview : We are looking for a skilled Data Engineer with strong hands-on experience in Snowflake, Azure Data Factory (ADF), SQL, Python, and dbt to build, maintain, and optimize scalable cloud-based data pipelines.Key Responsibilities : - Develop data ingestion pipelines from relational databases, files, and APIs into Snowflake.- Build and maintain data transformation pipelines using dbt.- Implement data pipelines using the Medallion Architecture (Bronze, Silver, and Gold layers).- Develop reusable, metadata-driven ingestion frameworks.- Implement data quality checks, error handling, reconciliation, and pipeline monitoring.- Perform source data profiling, troubleshoot data issues, and support defect resolution.- Maintain source-to-target mappings, technical documentation, and operational runbooks.- Participate in code reviews, Agile ceremonies, and cooperative development activities.Required Skills :
- Strong SQL skills and hands-on Snowflake development experience.- Practical experience with Azure Data Factory (ADF).- Python programming for data engineering, automation, and API integration.- Production-level experience with dbt (Core or Cloud).- Knowledge of orchestration tools such as Airflow, Dagster, ADF, or Snowflake Tasks.- Familiarity with CDC and data replication tools such as Fivetran, Qlik Replicate, or Debezium.- Understanding of Git, CI/CD, and data pipeline deployment practices.- Experience working with Coalesce is required.- Strong problem-solving and communication skills.Good to Have : - SnowPro Core certification.- Experience with AWS or Azure cloud storage and API integrations.- Experience in large-scale data migration or source consolidation projects.- Experience supporting production-grade data platforms. (ref:hirist.tech)
📌 Data Engineer - Snowflake/Azure Data Factory (Bengaluru)
🏢 DoublU
📍 Bengaluru