Senior Data Engineer

Experience: Not Available to Not Available years

Location: Mumbai, Bangalore & Trivandrum

Skills: Snowflake, SQL, Azure Data Factory, Azure Data Lake Storage Gen2, Azure Blob Storage, Azure SQL Database, Azure Key Vaults, Python, Pyspark, CI/CD, Azure DevOps, Git, dimensional modeling, Star Schema, Snowflake Schema, data warehousing, automated testing, financial processes, Sage Intact GL

Role & Responsibilities :
Design, develop, and optimize data loading techniques, virtual warehouses, and performance tuning within Snowflake.
Build complex SQL logics, stored procedures, and User-Defined Functions (UDFs) in Snowflake.
Implement and manage Snowflake data sharing and security features.
Design, develop, and orchestrate complex data pipelines using Azure Data Factory (ADF).
Work proficiently with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database.
Integrate Azure Key Vaults for secure credential management within data solutions.
Perform advanced SQL querying, optimization, and data manipulation across various relational database systems.
Implement and manage CI/CD pipelines for data solutions, preferably using Azure DevOps, including version control (Git) and branching strategies.
Develop automated testing for data pipelines and data quality.
Apply solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.
Utilize strong programming skills in Python, Pyspark for data processing, scripting, and automation.
Solve complex analytical and data-related problems with meticulous attention to detail.
Lead the development of data pipelines and orchestration using Azure Data Factory (ADF) for data ingestion, cleansing, and transformation.
Lead, mentor, and conduct code reviews for Junior Data Engineers.




Assist in development and developing automated testing for data pipelines and data quality.
Knowledge on financial processes such as budgeting, forecasting, financial reporting, accounts payable/receivable, sage intact general ledger, and treasury operations, and relevant financial regulations.

Skills expectation:
Snowflake Expertise: Deep expertise in Snowflake, data loading techniques, virtual warehouses, and performance tuning.
Strong experience with Snowflake SQL / building complex logics, stored procedures, and UDFs.
Experience with Snowflake data sharing and security features.
Azure Data Services (Expert): Azure Data Factory (ADF)-> Extensive experience designing, developing, and orchestrating complex data pipelines.
Azure Data Storage-> Proficient with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database.
Azure Key Vaults-> Hands-on experience integrating Key Vaults for secure credential management.
SQL (Expert): Advanced SQL querying, optimization, and data manipulation skills.
Experience with various relational database systems.
CI/CD (Advanced): Proven experience implementing and managing CI/CD pipelines for data solutions, preferably using Azure DevOps.
Understanding of version control (Git) and branching strategies.
Experience with automated testing for data pipelines and data quality.
Data Modeling: Solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.
Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.
Python: Solid programming skills in Python for data processing, scripting, and automation.
Experience with relevant libraries.
Domain Knowledge: Finance / Good to have Sage Intact GL knowledge.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us !

📌 Senior Data Engineer (Mumbai)
🏢 Quantiphi Analytics Solutions
📍 Mumbai