26 Aug
|
NTT DATA Business Solutions
|
Bengaluru
26 Aug
NTT DATA Business Solutions
Bengaluru
Job Summary
We are currently seeking a Data Engineer Senior Consultant to join our team in Bangalore, Karntaka (IN-KA), India (IN).
Technical Expertise
- Databricks Mastery: Hands-on experience with Delta Lake, Unity Catalog, Photon engine, Databricks Workflows, and Delta Live Tables (DLT).
- Legacy Systems Experience: Proven track record working with or migrating away from at least one legacy stack (e.g., Hadoop/Hive, Teradata, Oracle, Snowflake, SAS, SQL Server).
- Languages Spark: Exceptional proficiency in Python (PySpark) and complex SQL (including optimization of heavy joins and aggregations).
- Data Movement: Experience with cloud data migration utilities (e.g., AWS DMS, Azure Data Factory, GCP Storage Transfer, DistCp, or WANdisco).
- Orchestration DevOps: Experience with Git workflows, CI/CD pipelines,
and orchestration engines like Airflow or Azure DevOps.
Key Responsibilities Assessment Migration Strategy
- Audit and map legacy data systems (e.g., traditional data warehouses, on-premise Hadoop clusters, or older cloud architectures) to document dependencies, schemas, and processing logic.
- Design migration patterns (e.g., lift-and-shift, re-platforming, or re-architecting) that minimize business disruption and operational downtime.
- Estimate compute, storage, and timeline requirements for data transfer phases, ensuring cost-effective migration tracks.
📌 Data Engineer Senior Consultant (Bengaluru)
🏢 NTT DATA Business Solutions
📍 Bengaluru