NTT DATA strives to hire exceptional, creative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.
We are currently seeking a Data Engineer Sr. Consultant to join our team in Bangalore, Karnātaka (IN-KA), India (IN).
Day-to-Day Job Duties
• Analyze existing Informatica workflows, mappings and AWS Glue jobs to understand source-to-target mappings and transformation logic.
• Develop Databricks notebooks and data pipelines to migrate existing ETL workloads to the Databricks Lakehouse.
• Develop data transformations using Python, PySpark, Spark SQL and Databricks SQL.
• Implement Bronze, Silver and Gold layer processing following established project architecture and coding patterns.
• Develop batch and incremental processing pipelines using Delta Lake and established watermark/control mechanisms.
• Develop and maintain Databricks Jobs/Workflows and Lakeflow Declarative Pipelines as required.
• Reuse common project frameworks for logging, auditing, data quality,
error handling and notifications.
• Convert Informatica transformations, mappings, lookups and business rules into equivalent Databricks implementations while preserving existing business logic.
• Support migration of AWS Glue jobs and database-based processing into Databricks.
• Perform unit testing and source-to-target data reconciliation for migrated pipelines.
• Investigate and resolve data, SQL, PySpark and pipeline execution issues.
• Support integration testing, regression testing, UAT and production validation.
• Work with senior developers and technical leads to resolve technical issues and dependencies.
• Follow established coding, performance, security and development standards.
• Participate in code reviews and incorporate review feedback.
• Prepare technical documentation and support knowledge transfer for migrated workloads.
• Support deployment, monitoring, productio
📌 Data Engineer Sr. Consultant (Bengaluru)
🏢 NTT DATA Services
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.