Informa is a leading academic publishing, business intelligence, knowledge and events business, creating unique content and connectivity for customers all over the world. Taylor & Francis is one of the world's largest publishers of high-quality, peer reviewed scholarly journals, books, e-books and reference works. We strongly believe that this requires us to encourage and examine different ideas and voices, so that any work that meets our exacting levels of quality deserves to be included in our publications. We are seeking a skilled Lead Data Engineer with expertise in Enterprise Data Warehouse concepts and Multi-Dimensional Data Modelling principles to join our Technology team, who is reporting to Engineering Manager. Function as part of an Agile engineering team in the role of Lead Data Engineer, responsible for orchestrating and upholding the highest levels of Engineering and Enterprise Data Warehouse Concepts and practices throughout the Software Development Life Cycle, collaborating closely with development, operations, and architecture teams.

Define delivery phases and perform project, task and individual management duties for team, setting activities, sub-activities, and milestones, while ensuring that development and delivery standards are rigorously enforced.

Manage and enhance our Continuous Integration, Delivery, and Deployment processes, teams, and users to ensure high-quality and efficient delivery.

Collaborate closely with Engineering Managers and Business Analysts to produce accurate delivery estimates and oversee the transition from analysis through design to deliver

Design and implement scalable data solutions using AWS services

Design and implement data models for warehouse solutions

Implement comprehensive unit testing strategies





Mentor junior engineers on AWS best practices and data engineering concepts

Deploy and troubleshoot solutions as needed, adhering to best practices throughout the development lifecycle to identify and resolve issues prior to deployment.

Plan, design, and develop cloud-based applications, analytical services, and platforms.

Demonstrate excellent communication, organizational skills, and a proactive approach to meeting deadlines and achieving project goals.

Proven experience as a Lead Data Engineer with expertise in Python and Spark.

Experience in CI/CD pipelines using GitHub and GitHub Actions to streamline development workflows.

Develop and maintain ETL pipelines using AWS Glue, Lambda, and EventBridge.

Manage data storage solutions across S3 and Redshift.

Implement security best practices using AWS IAM.

Experience with cloud computing services, especially AWS ECS, RDS, EFS, S3, Lambda, to build scalable and resilient applications.

Experience with database management including SQL (e.g., MySQL) and NoSQL (e.g., MongoDB), ensuring efficient data storage and retrieval.

Ensure code quality through SonarCloud integration

In-depth knowledge in Test Driven Development (TDD) for Data Pipelines and Python

Excellent container orchestration skills using Docker, ensuring efficient application deployment and management.

Solid understanding of Agile methodologies and implementations (Kanban, XP, Scrum).

Bachelor's degree in computer science or a related field, or equivalent work experience.





24 days annual leave

- Pension contributions
- Medical insurance for self and dependants; life cover and personal accident cover for self
- Seasonal social and charitable events
- Training and development
- Right tools for remote working

That's why we work in-person with each other, or with customers and partners, three days a week or more. When you're not spending time together in one of our offices or other workplaces – like at conference – you get the flexibility and support to work from home or remotely.

We ask that candidates live within a commutable distance of our office in Bengaluru to ensure that as a balanced worker they can make it to our office location 3 days per week.

This could include having the application form in a different format, more time for questions, or anything else – please ask us, we are happy to be flexible! If you're excited about working with Taylor & Francis to foster human progress through knowledge, we invite you to apply even if your existing skills and experience don't fit every item listed above. We believe in and value diversity of people and thought, fostering a supportive and inclusive environment where all colleagues can learn and succeed as their true selves. If you have a disability, or face another barrier, and would like to request an adjustment to assist your participation in the hiring process and/or in the advertised position, please contact [HIDDEN TEXT]. We genuinely care about our colleagues, promoting work-life balance, wellbeing, and flexible working. We believe that the skills and experience you bring to Taylor & Francis are invaluable. To find out more about our business and the great career opportunities please go to our Careers Site:

📌 Lead Data Engineer (work from home) (remote)
🏢 taylor & francis group
📍 Bengaluru