Data Engineer (AWS, SQL) (Bengaluru)

Data Engineer (AWS, SQL) (Bengaluru)

20 Nov
|
Straive
|
Bengaluru

20 Nov

Straive

Bengaluru

Senior Data Engineer (AWS & Snowflake Specialist) Experience Level: 5–6 Years
Role Overview
This role is for a data powerhouse who can bridge the gap between high-performance big
data processing on AWS and elite-level data warehousing in Snowflake. You will be
responsible for the entire lifecycle of data, ensuring that every pipeline includes robust
validation and observability.
Key Responsibilities
Big Data Processing: Leverage AWS EMR (Spark/Hive) for heavy-lift data
processing and Athena for serverless ad-hoc querying of S3 data lakes.
Data Validation: Implement Outstanding Expectations (GX) or equivalent Python-based
validation libraries to prevent 'data silent failure' within EMR and Snowflake ingestion
layers.
Snowflake Engineering: Architect end-to-end Snowflake environments, utilizing
SnowSQL for scripting and SnowPipe for continuous, automated data ingestion.
System Integration: Build and maintain Snowflake Integrations (Storage
Integrations with S3, API Integrations,



and Notification Services).
Advanced ETL: Develop robust pipelines that transition data from raw AWS storage
into optimized Snowflake schemas.
Technical Requirements
Core Languages (Strong Proficiency Required):
SQL: Expert mastery of Snowflake-specific SQL extensions, CTEs, and
performance tuning (Micro-partitioning).
Python: Advanced scripting for automation, Boto3 for AWS resource
management, and data manipulation.

Data Quality: Proven experience implementing automated data testing and
validation frameworks within production pipelines.
AWS Stack: Extensive experience with EMR, Redshift, Athena, S3, and IAM
security policies.
Snowflake Mastery: * Proven experience with Snowflake Data Engineering
features (Streams, Tasks, and External Tables).
Hands-on usage of SnowPipe for real-time or near-real-time data loading.

📌 Data Engineer (AWS, SQL) (Bengaluru)
🏢 Straive
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (aws, sql) (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data engineer (aws, sql) (bengaluru) / bengaluru