02 Oct
|
Black And White Business Solutions
|
Kochi
02 Oct
Black And White Business Solutions
Kochi
Hiring for One of the topmost MNC!!
ROLE: AWS Data Engineer
Exp: 6 to 8 YRS
Location: Chennai, Bengaluru, Hyderabad
Work mode: 5 Days work from office
Notice Period: 0-30 Days Only
Role Overview
We are looking for an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines and data warehouse solutions on AWS. The ideal candidate should have solid hands-on experience with AWS Glue, Amazon Redshift, SQL, and Python, along with a good understanding of ETL/ELT processes and data engineering best practices.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines using AWS services.
- Develop and maintain AWS Glue Jobs, Crawlers, Workflows, and Data Catalog.
- Build and optimize data pipelines for loading data into Amazon Redshift.
- Develop complex SQL queries, stored procedures, views, and transformations.
- Perform data extraction from various sources such as databases, APIs, files, and cloud storage.
- Work extensively with Amazon S3 for data storage and staging.
- Implement data transformations using Python/PySpark and AWS Glue.
- Optimize Redshift performance through appropriate distribution keys, sort keys, table design, and query optimization.
- Implement incremental data loading and CDC (Change Data Capture) processes where required.
- Monitor and troubleshoot data pipelines, ETL failures, and data-quality issues.
- Implement data validation and reconciliation processes to ensure data accuracy.
- Schedule and orchestrate data workflows using AWS services or other orchestration tools.
- Implement security and access controls using AWS IAM.
- Work with DevOps teams to implement CI/CD for data pipelines.
--
Thanks & Regards
Bhavana B
Black and White Business Solutions Pvt.Ltd.
Bangalore,Karnataka,India.
Direct Number:(phone hidden)
[email protected] |www.blackwhite.in
📌 Aws Data Engineer (Kochi)
🏢 Black And White Business Solutions
📍 Kochi