06 Aug
|
Sparix Global
|
Noida
06 Aug
Sparix Global
Noida
Data Engineer (Subcontractor) Immediate Joiners Required Position Details
Position Name Experience Location Joining Duration Budget Data Engineer 8 11 Years Remote Absolute Immediate 6 Months 2 - 2.5.0 LPM
Job Description
We are looking for an experienced Data Engineer with expertise in building and maintaining scalable data pipelines on AWS. The ideal candidate should have hands-on experience with modern data engineering tools and cloud-native architectures.
Primary Skills
- AWS
- AWS Glue
- AWS Lambda
- Python
- Apache Spark
- Apache Airflow
- DBT (Data Build Tool)
- Amazon Redshift
- AWS Step Functions
- Shell Scripting
- Docker
Roles Responsibilities
- Perform data ingestion and data validation using the existing data framework.
- Design and develop an productive data ingestion framework to enable faster data onboarding.
- Process structured and semi-structured data using batch processing into Amazon S3.
- Transform, refine, and load data into Amazon Redshift.
- Perform data transformation and operations in Redshift using DBT.
- Export processed data to Amazon S3 for Salesforce integration.
- Handle data validation, reconciliation, and auditing.
- Build configurable data processing workflows using JSON, configuration tables, or similar approaches to enable non-technical users.
- Develop and maintain Shell scripts and Docker-based solutions for automation and deployment.
Nice to Have
- Terraform
Required Skills
- AWS
- Glue
- Lambda
- Python
- Spark
- Airflow
- DBT
- Amazon Redshift
- AWS Step Functions
- Amazon S3
- Data Ingestion
- Data Validation
- ETL Pipelines
- Shell Scripting
- Docker
- Salesforce Integration
- JSON Configuration
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Data Engineer (Noida)
🏢 Sparix Global
📍 Noida