20 Aug
|
Objectways Technologies
|
Bengaluru
20 Aug
Objectways Technologies
Bengaluru
About the Role
We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and lakehouse solutions on AWS. The ideal candidate will have solid experience in enterprise-scale data engineering, ETL development, and modern cloud-based data platforms. This role will be responsible for building and maintaining Medallion Architecture (Bronze, Silver, Gold) data pipelines to support analytics, reporting, and business intelligence initiatives.
Key Responsibilities
Design, develop, and maintain AWS-based data pipelines following Medallion Architecture (Bronze, Silver, Gold).
Build and optimize ETL/ELT workflows using AWS Glue, Spark, and Python.
Develop and manage data ingestion pipelines using AWS DMS and Kinesis.
Implement data transformation and enrichment processes to support analytics and reporting requirements.
Integrate data solutions with AWS Athena, Redshift, and other downstream data consumers.
Create and maintain datasets using Parquet and Apache Iceberg formats.
Ensure data quality, consistency, governance,
and lineage across the data platform.
Implement monitoring, logging, and alerting mechanisms to maintain pipeline reliability.
Collaborate with Data Architects, Data Analysts, and Business Stakeholders to understand data requirements and deliver scalable solutions.
Participate in CI/CD implementation and automation for ETL deployment and maintenance.
Support data cataloging, governance, and security initiatives using AWS Lake Formation and/or DataZone.
Required Qualifications
5+ years of experience in Data Engineering.
Proven experience building enterprise-scale ETL/ELT and Lakehouse solutions.
Experience handling large-scale data processing and analytics workloads.
Solid understanding of data modeling, performance optimization, and data quality practices.
Solid hands-on experience with AWS Glue, AWS DMS (Database Migration Service), AWS Kinesis, Amazon Athena,Amazon Redshift,Apache
📌 Aws Data Engineer Bengaluru
🏢 Objectways Technologies
📍 Bengaluru