05 Aug
|
TransUnion
|
Bengaluru
05 Aug
TransUnion
Bengaluru
Manager I, Data Engineering & Java
Experience: 2 to 4 years
Location: Bengaluru
Skills: Java, Apache Spark, Flink, Kafka, Hadoop, Snowflake, BigQuery, Redshift, ETL, ELT, Airflow, Dagster, Python, bash, RESTful API, SQL, AWS, Azure, GCP, Spring Boot
TransUnion's Job Applicant Privacy Notice
What We'll Bring: This is role is for a Manager to lead a team in building global platforms that are hosted across multiple countries in both public and private cloud environments. We value people who are passionate around solving business problems through innovation and engineering practices. We embrace a culture of experimentation and constantly strive for improvement and learning. You'll work in a collaborative environment that encourages diversity of thought and creative solutions that are in the best interests of our customers globally.
What You'll Bring:
Key Responsibilities
Leadership & Team Management
• Lead, mentor, and develop a high-performing team of data engineers.
• Drive engineering best practices, code reviews, and system design discussions.
• Partner with product, analytics, and platform teams to understand data needs and prioritize work.
Data Engineering
• Design and maintain scalable, resilient data pipelines.
• Architect end-to-end data solutions across batch and streaming frameworks.
• Ensure high availability, data quality, and optimized performance across data platforms.
• Oversee the ingestion, transformation, and storage of large-scale datasets.
• Define and implement long-term data engineering strategy, tooling, and infrastructure improvements.
• Evaluate and adopt emerging technologies in data processing, storage, and orchestration.
• Promote automation, CI/CD,
and DevOps practices across data engineering workflows.
• Monitor and troubleshoot data workflows, ensuring reliability and scalability.
• Implement data governance, quality, and security standards in collaboration with relevant teams.
• Optimize workflows for cost efficiency and performance.
Impact You'll Make:
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 10+ years of experience in data engineering or backend engineering roles, including 2–4 years in a management/leadership capacity.
• Strong proficiency in Java (preferred), with experience in building distributed systems.
• Deep experience with big data technologies such as: Apache Spark, Flink, Kafka, Hadoop, or similar.
• Data warehouses (Snowflake, BigQuery, Redshift, or similar).
• Expertise in designing ETL/ELT pipelines and workflow orchestration tools (Airflow, Dagster, etc.).
• Experience with Big Data systems (Hadoop, Spark, Hive, etc.) and principles (Map/Reduce, etc.).
• Experience with scripting (Python, bash, etc.) and RESTful API.
• Robust knowledge of SQL and data modeling concepts.
• Experience with cloud platforms (AWS, Azure, GCP).
Preferred Qualifications
• Experience with microservices built in Java/Spring Boot.
• Working knowledge of Python for data scripting or ML workflows.
• Background in real-time streaming architectures.
• Exposure to MLOps or analytics engineering workflows.
• Strong communication and stakeholder management skills.
This is a hybrid position and involves regular performance of job responsibilities virtually as well as in-person at an assigned TU office location for a minimum of two days a week.
TransUnion Job Title
Manager I, Applications Development
📌 Manager I, Data Engineering & Java (Bengaluru)
🏢 TransUnion
📍 Bengaluru