Specialist - Data Engineering

5 - 7 Years

Role description

Architect and implement core ETL graphs choose partitioning keys sortmerge strategies and memory settings to meet SLAs

Handson technical lead for a Ab Initio delivery team design graphs enforce standards mentor devs own performance and production readiness for assigned modules

Do deep code reviews of GDE graphs naming parameterization component reuse error handling and logging

Lead performance investigations identify skew repartition points costly sorts and recommend rewritepartitioning improvements

Prepare test datasets and scripts for unitregressionperformance testing

Work with Ops to ensure CoOperating scheduling appropriate restart strategies and runbook snippets for each graph

Working Basic knowledge in Bigdata Hadoop Eco system

Experience and expertise on SQL and Unix shell scripting Knowledge on Abinitio air commands and m commands

Musthave technical skills

Expert with GDE graph authoring and debugging comfortable editing cfg parameter files and using graph debuggerslogs





Strong knowledge of Ab Initio operators Join Reformat Dedup RollupAggregate Rank Sort Partition Merge Lookup and when to use each optimally in a parallel workplace

Mastery of partitioning strategies and the impact on network IO memory and mergesort costs

Familiarity with EME for metadata component checkins and versioning

Ability to write auxiliary shell scripts and SQL for test data and postprocessing

Own delivery of large ETL landscapes built on Ab Initio GDE graphs CoOperating deployment EME metadata

Define and enforce an Ab Initiospecific delivery model component library governance naming conventions asset versioning in EME release pipelines for graphs and sandboxes

Set organizationlevel standards for metadatadriven development shared enterprise components and reuse of transform libraries and parameter sets

Lead major production incident response for Ab Initio stacks triage root cause postmortem defecttochange feedthrough

Skills

Mandatory Skills : AbInitio

📌 Ab Initio Technical Lead / Senior Ab Initio Data Engineer (Pune)
🏢 LTIMindtree
📍 Pune