30 Sep
|
Demand AI
|
Pune
Job Description
About the Role
n
We are looking for a Data Engineer with 3–5 years of experience to build and maintain data pipelines, Snowflake integrations, and data platforms while supporting the administration, performance, security, and reliability of our database environments.
n
The ideal candidate should have robust SQL and RDBMS fundamentals, hands-on Snowflake experience, and the ability to work across relational and NoSQL databases.
n
Key Responsibilities
n
Data Engineering & Snowflake
n
n
- Design, develop, and maintain data pipelines and ETL/ELT processes using Snowflake.
n
- Develop complex SQL queries, transformations, views, stored procedures, tasks, and streams.
n
- Build incremental data ingestion and data synchronization pipelines.
n
- Implement and maintain Snowflake integrations with external applications, cloud storage, and data sources.
n
- Work with stages, file formats, COPY, Snowpipe, storage integrations, and connectors.
n
- Monitor and troubleshoot data pipelines and resolve data quality and processing issues.
n
- Optimize Snowflake queries and workloads for performance, scalability, and cost.
n
- Support data modeling and schema design for analytical workloads.
n
n
Database Operations
n
n
- Manage and maintain databases across RDBMS and NoSQL environments.
n
- Perform database administration activities including user/role management, access control, security, monitoring, maintenance, and troubleshooting.
n
- Implement and maintain RBAC and least-privilege access across database platforms.
n
- Monitor database health, performance, storage,
and resource utilization.
n
- Perform query and database performance tuning and identify optimization opportunities.
n
- Support backup, recovery, disaster recovery, and database maintenance activities.
n
- Troubleshoot production database issues and participate in root-cause analysis and incident resolution.
n
- Maintain database standards, documentation, and operational procedures.
n
n
Required Skills & Experience
n
n
- 3–5 years of experience in Data Engineering or a similar role.
n
- Strong hands-on experience with Snowflake.
n
- Proficient in SQL, including complex queries, data transformation, and query optimization.
n
- Strong understanding of RDBMS and NoSQL database concepts.
n
- Hands-on experience with databases such as PostgreSQL, DynamoDB, or similar technologies.
n
- Experience with Snowflake Streams, Tasks, Stages, Snowpipe, Stored Procedures, Views, and Data Loading.
n
- Experience building and troubleshooting ETL/ELT data pipelines.
n
- Good understanding of database performance tuning, indexing, partitioning, and query optimization.
n
- Experience with database users, roles, permissions, and RBAC.
n
- Understanding of database security, monitoring, backup, and recovery concepts.
n
- Experience with Python or scripting for data engineering and automation.
n
- Strong troubleshooting and problem-solving skills.
n
n
Good to Have
n
n
- Knowledge of ClickHouse or other analytical databases.
n
- Experience with AWS cloud services and cloud-based data platforms.
n
- Experience working with B2B SaaS / MarTech data platforms.
n
📌 Data Engineer (Pune)
🏢 Demand AI
📍 Pune