We are seeking a highly skilled and experienced Snowflake Data Engineering Lead to join our data engineering team. The ideal candidate will be an expert in Snowflake, Collibra AWS and its services, Airflow, Snowpark, PySpark, and SQL. This role requires robust leadership capabilities, excellent client communication skills, and the ability to understand business requirements and translate them into technical solutions.
Key Responsibilities:
- Lead the design, development,and deployment of data solutions using Snowflake and AWS services.
- Architect and implement scalable data pipelines using Airflow, PySpark, and Snowpark.
- Implement and support Collibra data governance solutions for banking environments.
- Configure business glossary, metadata, lineage, and governance workflows.
- Define and maintain data governance policies, standards, and controls.
- Support data quality, regulatory compliance, and risk management initiatives.
- Collaborate with business users, data stewards,
and technology teams
- Conduct code reviews and provide constructive feedback to team members.
- Troubleshoot and resolve data-related issues and performance bottlenecks.
- Stay updated with the latest trends and technologies in cloud data platforms and analytics.
Required Skills & Qualifications:
- Expert-level proficiency in Snowflake including advanced features like Snowpark & PySpark.
- Hands-on experience with Apache Airflow for orchestrating data workflows.
- Proficiency in PySpark for ETL pipeline processing.
- Advanced SQL coding skills with a focus on performance and scalability.
- Excellent communication and interpersonal skills for client interaction.
- Proven ability to understand business requirements and translate them into technical solutions.
- Experience in leading and managing technical teams.
- Bachelor's or Masters degree in Computer Science, Information Technology, or related field.