15 Oct
|
DoublU
|
Bengaluru
We're Hiring | Lead Engineer – II – Data Engineering on Cloud
Experience: 5–7 Years
Location: Chennai | Bengaluru | Mumbai | Pune
Employment Type: Full time
Notice Period: Immediate Joiners Preferred
Role Overview:
We are looking for a skilled Data Engineer with strong hands-on experience in Snowflake, Azure Data Factory (ADF), SQL, Python, and dbt to build, maintain, and optimize scalable cloud-based data pipelines.
Key Responsibilities:
• Develop data ingestion pipelines from relational databases, files, and APIs into Snowflake.
• Build and maintain data transformation pipelines using dbt.
• Implement data pipelines using the Medallion Architecture (Bronze, Silver, and Gold layers).
• Develop reusable, metadata-driven ingestion frameworks.
• Implement data quality checks, error handling, reconciliation, and pipeline monitoring.
• Perform source data profiling, troubleshoot data issues, and support defect resolution.
• Maintain source-to-target mappings, technical documentation, and operational runbooks.
• Participate in code reviews, Agile ceremonies,
and collaborative development activities.
•
Required Skills:
• Strong SQL skills and hands-on Snowflake development experience.
• Practical experience with Azure Data Factory (ADF).
• Python programming for data engineering, automation, and API integration.
• Production-level experience with dbt (Core or Cloud).
• Knowledge of orchestration tools such as Airflow, Dagster, ADF, or Snowflake Tasks.
• Familiarity with CDC and data replication tools such as Fivetran, Qlik Replicate, or Debezium.
• Understanding of Git, CI/CD, and data pipeline deployment practices.
• Experience working with Coalesce is required.
• Strong problem-solving and communication skills.
Good to Have:
• SnowPro Core certification.
• Experience with AWS or Azure cloud storage and API integrations.
• Experience in large-scale data migration or source consolidation projects.
• Experience supporting production-grade data platforms.
Interested c
📌 Lead Engineer – II – Data Engineering on Cloud (Bengaluru)
🏢 DoublU
📍 Bengaluru