13 Nov
|
Hitachi Digital Services
|
Bengaluru
13 Nov
Hitachi Digital Services
Bengaluru
Role & responsibilities
- Develop data pipelines in Python and PySpark for ingestion, cleansing, transformation, and aggregation.
- Build and maintain Talend jobs (Talend Studio and Talend Management Console), including components, context variables, and job scheduling.
- Design and run data workloads on AWS: S3 for storage, Glue or EMR for Spark processing.
- Load data into dimensional models (fact and dimension tables, surrogate keys, slowly changing dimensions).
- Write and tune SQL for data validation, joins, and ranking, and resolve data-quality issues.
Preferred candidate profile
- Python: data processing, packaging, and unit testing.
- PySpark: DataFrame API, Spark SQL, partitioning, and performance tuning.
- AWS: S3, Glue or EMR
- Talend: job design, components, context variables, and error handling.
- SQL: Oracle or similar, including joins, window functions, and data validation..
📌 Data Engineer (Bengaluru)
🏢 Hitachi Digital Services
📍 Bengaluru