22 Sep
|
Khoj Information Technology
|
India
22 Sep
Khoj Information Technology
India
Role Summary
We are seeking a skilled Snowflake Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, deploying, and supporting enterprise data solutions on the Snowflake platform. This role involves building scalable data pipelines, developing metadata-driven frameworks, automating database deployments, and supporting production environments. The successful candidate will possess strong troubleshooting skills, be comfortable working across both application and database administration domains, and consistently produce well-documented, maintainable solutions.
Key Responsibilities
Snowflake Engineering & Development
- Design, develop, and maintain robust data solutions using Snowflake.
- Develop and support database objects including tables, views, streams, tasks, stored procedures, and dynamic SQL frameworks.
- Build scalable and performant ETL/ELT pipelines for data integration and analytics workloads.
- Optimize Snowflake query performance, storage utilization, and compute efficiency.
- Implement metadata-driven and configuration-based data processing frameworks.
Database Administration & Scripting
- Develop, support, and maintain database administration scripts for operational and support activities.
- Create automation scripts for database monitoring, housekeeping, deployments, validations, and health checks.
- Assist with Snowflake platform administration activities, including role management, access controls, warehouse management, and object security.
- Support operational automation across development, test, and production environments.
· Support Amazon Aurora PostgreSQL operational activities, including connectivity validation, performance troubleshooting, access coordination, and environment support.
Database Deployment & Release Management
- Utilize Liquibase for source-controlled database deployments and schema migrations.
- Develop and maintain deployment scripts and release automation processes.
- Ensure database changes are properly version-controlled, tested, and promoted through environments.
- Partner with development and operations teams to establish deployment standards and best practices.
Data Engineering & Operational Support
- Develop efficient data ingestion, transformation, and validation processes.
· Design, develop, and support AWS Glue jobs and workflows for data ingestion, transformation, cataloging,
and orchestration across cloud and enterprise data platforms.
· Work with Amazon S3 for data landing, staging, archival, file organization, access patterns, and integration with Snowflake and AWS Glue pipelines.
· Support AWS Database Migration Service (AWS DMS) tasks for data replication, migration, validation, monitoring, and issue resolution across source and target platforms.
- Troubleshoot and resolve issues related to data pipelines, database performance, and application integrations.
- Perform root cause analysis and implement corrective actions for recurring issues.
- Monitor data loads, data quality processes, and platform performance to ensure reliability and availability.
- Support production incident management and operational escalations.
Software Engineering & Documentation
- Write clean, maintainable, and supportable code following engineering best practices.
- Design solutions with long-term maintenance, observability, and troubleshooting requirements in mind.
- Implement appropriate logging, exception handling, auditing, and monitoring capabilities.
- Produce comprehensive technical documentation for all solutions, processes, and deployments.
- Create and maintain operational runbooks, troubleshooting guides, architectural documentation, and knowledge transfer materials.
- Ensure all code deliveries are supplemented with proper and abundant documentation to support future maintenance and operational activities.
System Integration & DevOps
- Support CI/CD processes for database and data engineering solutions.
- Utilize GitHub for source code management, version control, and collaboration.
- Collaborate with application development, infrastructure, and data teams to deliver integrated enterprise solutions.
· Integrate Snowflake solutions with AWS services, including AWS Glue, Amazon Aurora PostgreSQL, Amazon S3, and AWS DMS, to support scalable enterprise data processing and interoperability.
- Participate in code reviews, deployment reviews, and technical design discussions.
Required Skills & Qualifications
· At least 6 years of relevant data engineering experience, including hands-on work with cloud data platforms and production data environments.
- Strong hands-on working experience with Snowflake development and administration.
- Proficiency in writing and optimizing complex SQL queries and Snowflake stored procedures.
· Hands-on proficiency with AWS Glue for ETL development, workflow orchestration, job monitoring, and troubleshooting.
- Experience developing database and application support scripts.
· Experience working with Amazon Aurora PostgreSQL, including SQL development, integration support, operational troubleshooting, and performance analysis.
· Experience working with Amazon S3 for storage, ingestion, staging, and integration with cloud-native data pipelines.
· Experience with AWS DMS for database migration, change data capture, replication monitoring, and troubleshooting.
- Hands-on experience with Liquibase for database deployment and schema version management.
- Strong troubleshooting, analytical, and problem-solving skills.
- Experience supporting production data warehouse or data platform environments.
- Ability to develop maintainable, reusable, and well-documented code.
- Experience with source control systems such as GitHub.
- Excellent verbal and written communication skills.
- Solid attention to detail and commitment to operational excellence.
Preferred Qualifications (Plus)
- Experience with cloud platforms such as AWS.
· Experience building cloud-native data pipelines using AWS Glue, Amazon Aurora PostgreSQL, Amazon S3, AWS DMS, Snowflake, and related AWS data services.
- Experience with Snowflake performance tuning and cost optimization.
- Experience implementing metadata-driven frameworks and data validation solutions.
- Proficiency with Python, Shell Scripting.
- Familiarity with CI/CD pipelines and DevOps practices.
- Knowledge of data warehousing concepts, dimensional modeling, and enterprise reporting platforms.
- Experience with monitoring, observability, and operational support frameworks.
- Experience supporting regulatory, audit, and data governance requirements.
Pay: Up to ₹2,000,000.00 per year
Application Question(s):
- Can you start immediately?
Experience:
- snowflake: 4 years (Preferred)
- Microsoft SQL Server: 5 years (Preferred)
- AWS: 3 years (Preferred)
Work Location: Remote
📌 Snowflake/AWS Data Engineer (India)
🏢 Khoj Information Technology
📍 India