12 Oct
|
TransUnion
|
Hyderabad
12 Oct
TransUnion
Hyderabad
TransUnion's Job Applicant Privacy Notice
Team Overview
An M02 is responsible for managing a development team, ensuring delivery of software solutions, and aligning execution with business and product goals.
The role balances:
* People management
* Technical oversight
* Delivery accountability
Typically owns a single team of engineers
This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
Role Overview And Core Responsibilities
Team Leadership & Delivery
• Lead a team of software and data engineers (typically 5–10 members).
• Ensure timely and high-quality delivery of platform capabilities, data processing solutions, and feature enhancements.
• Drive execution of large-scale distributed processing initiatives and data platform modernization efforts.
• Foster a culture of engineering excellence, innovation, and accountability.
Technical Oversight
• Provide technical leadership for large-scale distributed data processing systems built on Apache Spark.
• Guide architecture, design, and implementation decisions for scalable, fault-tolerant, and high-performance data processing workloads.
• Establish best practices for Spark application development, optimization, observability, and operational excellence.
• Ensure adherence to coding standards, performance requirements, scalability guidelines, and security controls.
• Lead troubleshooting and resolution of complex production issues involving Spark jobs, data pipelines, cluster performance, and resource management.
• Drive optimization of Spark workloads through partitioning strategies, query tuning, caching, memory management, and effective resource utilization.
Data Platform & Spark Engineering
• Design and oversee development of batch and real-time data processing pipelines using Apache Spark.
• Collaborate on architecture involving Spark, Iceberg, Hive, Hadoop, AWS EMR, AWS Glue, GCP Data
📌 Manager -- Big Data Application (Hyderabad)
🏢 TransUnion
📍 Hyderabad