13 Oct
|
Virtusa
|
Hyderabad
Job Requirements
Data Engineer
Location: HYD Campus, Hyderabad
Years of Experience: 5-7 Years
Job Summary: We are seeking a skilled Data Engineer with expertise in Snowflake ETL and dbt pipeline construction. The ideal candidate will leverage Snowflake’s elastic compute for high-performance data transformations and ensure the integrity of our data ecosystem through comprehensive testing and documentation.
Responsibilities
• Design and implement ETL processes using Snowflake and dbt to refine data through modular models.
• Utilize Dagster for managing scheduled and event-driven batch loads into Snowflake, ensuring idempotent and observable data ingestion.
• Implement unit tests and asset checks in dbt and Dagster to validate transformation logic before production deployment.
• Create and maintain comprehensive documentation of data flows, metadata, and transformation logic using dbt’s auto-generated docs and Dagster’s lineage graphs.
• Implement Snowflake Dynamic Data Masking for granular control over sensitive information,
ensuring compliance and data security.
Mandatory Skills
• Proven experience in Data Engineering with a focus on Snowflake ETL and dbt.
• Solid SQL skills and experience in building modular dbt models.
• Familiarity with Dagster for data orchestration and batch ingestion.
• Experience in implementing unit tests and data quality checks.
• Knowledge of data security practices, including column-level masking.
Preferred Skills
• Experience with cloud data warehousing solutions.
• Familiarity with data governance and compliance frameworks.
• Understanding of data visualization tools and techniques.
Qualifications
• Bachelor's degree in Computer Science, Engineering, or a related field.
• 5-7 years of experience in Data Engineering or a related role.
• Strong analytical and problem-solving skills.
Work Experience
5-7Years
📌 Snowflake DBT (Hyderabad)
🏢 Virtusa
📍 Hyderabad