07 Aug
|
Sparix Global
|
Noida
07 Aug
Sparix Global
Noida
Data Engineer (Subcontractor) Immediate Joiners Required Position Details
Position Name Experience Location Joining Duration Budget Data Engineer 8 11 Years Remote Absolute Immediate 6 Months 2 - 2.5.0 LPM
Job Description
We are looking for an experienced Data Engineer with expertise in building and maintaining scalable data pipelines on AWS. The ideal candidate should have hands-on experience with contemporary data engineering tools and cloud-native architectures.
Primary Skills
AWS
AWS Glue
AWS Lambda
Python
Apache Spark
Apache Airflow
DBT (Data Build Tool)
Amazon Redshift
AWS Step Functions
Shell Scripting
Docker
Roles Responsibilities
Perform data ingestion and data validation using the existing data framework.
Design and develop an productive data ingestion framework to enable faster data onboarding.
Process structured and semi-structured data using batch processing into Amazon S3.
Transform, refine, and load data into Amazon Redshift.
Perform data transformation and operations in Redshift using DBT.
Export processed data to Amazon S3 for Salesforce integration.
Handle data validation, reconciliation, and auditing.
Build configurable data processing workflows using JSON, configuration tables, or similar approaches to enable non-technical users.
Develop and maintain Shell scripts and Docker-based solutions for automation and deployment.
Nice to Have
Terraform
Required Skills
AWS
Glue
Lambda
Python
Spark
Airflow
DBT
Amazon Redshift
AWS Step Functions
Amazon S3
Data Ingestion
Data Validation
ETL Pipelines
Shell Scripting
Docker
Salesforce Integration
JSON Configuration
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer Noida
🏢 Sparix Global
📍 Noida