07 Sep
|
HCLTech
|
Bengaluru
Bangalore, Karnataka
Job Summary
We are looking for an experienced ETL Architect to design, build, and govern large-scale data processing platforms on AWS. The ideal candidate will have deep expertise in Amazon EC2, Amazon EMR, Apache Spark , data lake architectures, and enterprise ETL frameworks. The role requires strong hands-on experience with Parquet and Avro data formats , schema management, data versioning, and high-performance data pipelines supporting analytics and business-critical workloads.
AWS Technologies
Amazon EC2
Amazon EMR
Amazon S3
AWS IAM
CloudWatch
AWS Glue (preferred)
Big Data Technologies
Apache Spark
Spark SQL
PySpark / Scala Spark
Hadoop ecosystem fundamentals
Data Formats
Strong hands-on experience with:
Parquet
Avro
Schema evolution and optimization techniques
ETL & Data Integration
Enterprise ETL Architecture
Data Ingestion Frameworks
Batch & Streaming Processing
Data Quality Frameworks
Data Governance & Versioning
Data Lineage
Data Cataloging
Dataset Versioning
Metadata Management
Audit & Compliance Controls
Programming & Databases
Python
Scala (preferred)
SQL
Data Warehouse Concepts
Key Responsibilities
We are looking for an experienced ETL Architect to design, build, and govern large-scale data processing platforms on AWS. The ideal candidate will have deep expertise in Amazon EC2, Amazon EMR, Apache Spark , data lake architectures, and enterprise ETL frameworks. The role requires solid hands-on experience with Parquet and Avro data formats , schema management, data versioning, and high-performance data pipelines supporting analytics and business-critical workloads.
Skill Requirements
Other Requirements
#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-
📌 Senior Design Lead (Bengaluru)
🏢 HCLTech
📍 Bengaluru