02 Sep
|
Quantiphi Analytics Solution
|
Bengaluru
02 Sep
Quantiphi Analytics Solution
Bengaluru
Senior Data Engineer While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth. If working in an environment that encourages you to innovate and excel, not just in skilled but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer - Snowflake Experience Level: 4 Years Work location: Mumbai, Bangalore &
- Trivandrum Notice Period: Looking for 0-15 days joiners Role &
Responsibilities : Snowflake Development: Design, develop, and optimize data structures within Snowflake on Azure, utilizing Snowpipe, Snowpark, Stored Procedures, UDFs, and Streams &
- Tasks.
Pipeline Orchestration: Build and manage complex ETL/ELT data pipelines using Azure Data Factory (ADF), incorporating robust error handling, alerting, and CDC methods.
Data Platform Management: Work proficiently within the Azure data ecosystem, utilizing Azure Data Lake Storage (ADLS) and integrating Azure Key Vault for secure credential management.
Advanced Querying: Develop complex SQL logic and perform query optimization and data manipulation across data warehouse and staging environments. Data Security &
- Governance: Implement Snowflake security configurations, including Role-Based Access Control (RBAC) and Data-Masking features. DevOps &
- Integration: Manage CI/CD pipelines using Azure DevOps (Git and branching strategies) and integrate data streams via SFTP and REST APIs.
Quality Assurance: Assist in developing automated testing frameworks for data pipeline validation and data quality monitoring.
Data Modeling:
Apply dimensional modeling concepts (Star and Snowflake schemas) to build efficient data structures for financial reporting.
Financial
Alignment &
- Collaboration: Support the integration of financial data from platforms like Sage Intacct GL, SkyGen, and ClearWater; collaborate with stakeholders to gather technical requirements.
Team Mentorship: Lead, mentor, and conduct code reviews for Junior Data Engineers to ensure alignment with engineering standards.
Skills expectation: Snowflake Expertise (Advanced): Strong hands-on experience with Snowflake on Azure, including performance tuning, virtual warehouses, data loading, RBAC, Data-Masking, and Snowpark.
Azure Data Services: Extensive experience with Azure Data Factory (ADF) for complex pipeline orchestration, alongside proficiency in ADLS and Azure Key Vault. SQL &
- Programming: Expert-level SQL skills for data manipulation and query optimization, combined with intermediate Python skills for scripting and data processing. Data Warehousing &
- Modeling: Solid understanding of core data warehousing concepts, ETL/ELT patterns, and dimensional modeling. DevOps &
- Testing: Experience implementing CI/CD pipelines using Azure DevOps, version control (Git), and automated pipeline testing.
Domain Awareness: Good to have knowledge of financial processes and familiarity with data structures from Sage Intacct GL, SkyGen, or ClearWater.
Collaborative Execution: Strong problem-solving skills with the ability to translate business needs into technical pipelines and guide junior team members. If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us !
Experience Level Senior Level
📌 Senior Data Engineer (Bengaluru)
🏢 Quantiphi Analytics Solution
📍 Bengaluru