19 Aug
|
Objectways Technologies
|
Bengaluru
19 Aug
Objectways Technologies
Bengaluru
About the Role
We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and lakehouse solutions on AWS. The ideal candidate will have solid experience in enterprise-scale data engineering, ETL development, and modern cloud-based data platforms. This role will be responsible for building and maintaining Medallion Architecture (Bronze, Silver, Gold) data pipelines to support analytics, reporting, and business intelligence initiatives.
Key Responsibilities
- Design, develop, and maintain AWS-based data pipelines following Medallion Architecture (Bronze, Silver, Gold).
- Build and optimize ETL/ELT workflows using AWS Glue, Spark, and Python.
- Develop and manage data ingestion pipelines using AWS DMS and Kinesis.
- Implement data transformation and enrichment processes to support analytics and reporting requirements.
- Integrate data solutions with AWS Athena, Redshift, and other downstream data consumers.
- Create and maintain datasets using Parquet and Apache Iceberg formats.
- Ensure data quality, consistency, governance,
and lineage across the data platform.
- Implement monitoring, logging, and alerting mechanisms to maintain pipeline reliability.
- Collaborate with Data Architects, Data Analysts, and Business Stakeholders to understand data requirements and deliver scalable solutions.
- Participate in CI/CD implementation and automation for ETL deployment and maintenance.
- Support data cataloging, governance, and security initiatives using AWS Lake Formation and/or DataZone.
Required Qualifications
- 5+ years of experience in Data Engineering.
- Proven experience building enterprise-scale ETL/ELT and Lakehouse solutions.
- Experience handling large-scale data processing and analytics workloads.
- Strong understanding of data modeling, performance optimization, and data quality practices.
- Strong hands-on experience with AWS Glue, AWS DMS (Database Migration Service), AWS Kinesis, Amazon Athena,Amazon Redshift,Apache
📌 AWS Data Engineer (Bengaluru)
🏢 Objectways Technologies
📍 Bengaluru