At PDI Technologies, we empower some of the world's leading convenience retail and petroleum brands with cutting-edge technology solutions that drive growth and operational efficiency. By “Connecting Convenience” across the globe, we empower businesses to increase productivity, make more informed decisions, and engage faster with customers through loyalty programs, shopper insights, and unmatched real-time market intelligence via mobile applications, such as GasBuddy. We’re a global team committed to excellence, collaboration, and driving real impact. Explore our opportunities and become part of a company that values diversity, integrity, and growth.

Role Overview

We are looking for a Senior Data Engineer to join the Data Operations team. In this role, you will help expand and optimize our data pipeline architecture to make it accessible to cross-functional teams. Our ideal candidate has experience with building and maintaining data pipelines end-to-end. They should be interested in stewarding complex data flows with the end goal of reaching consumer and business users.

As a Senior Data Engineer, you will support our engineering, business, and product teams by ensuring optimal data collection and delivery through our infrastructure. This will include examining existing systems for optimization, investigating new techniques, and working with various stakeholders to ensure consistent delivery throughout the Gas Buddy ecosystem.

n

Key Responsibilities

- Design, implement, and maintain low-latency ETL/ELT pipelines for different data sources and destinations (e.g. RDS, Salesforce, Google Analytics,



Partner API's etc).
- Make Gas Buddy data more discoverable and easier to use for Data Scientists and Analysts.
- Collaborate with other engineers and Data Scientists to discover the best solutions.
- Diagnose and solve issues in our existing data pipelines and envision and build their successors.
- Partner with our DevOps engineers to build and evolve a secure infrastructure for our data stack.
- Develop standardized tooling to support ELT/ETL development using Python, Spark, Redshift/Snowflake, Kinesis, and Elasticsearch
- Support your colleagues by reviewing code and designs.

Qualifications

- 5+ years hands-on experience.
- Managing cloud infrastructure, preferably AWS.
- Managing databases and related other open-source software (Postgres, Spark, Redshift, Elasticsearch, Snowflake, SQS Queue...).
- Working with Python packages, frameworks, and environments for data processing.
- Working with and analyzing structured and unstructured datasets.
- Advanced working knowledge of SQL and experience working with relational databases.
- Experience building and optimizing ‘big data’ data pipelines, architectures and working with data lakes.
- Working knowledge of message queuing, stream processing,



and highly scalable ‘big data’ data stores.
- Experience supporting and working with cross-functional teams in a energetic environment.
- Excellent communication skills and ability to present data in a professional manner.
- Ability to balance detail-oriented work with important project deadlines.
- Knowledge of web services and data driven application architecture.
- Experience working in an Agile development environment.
- Experience with Containerization tools (Docker, Kubernetes, AWS ECS) is an asset.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Experience with DBT is an asset.

Behavioral Competencies

- Ensures Accountability
- Manages Complexity
- Communicates Effectively
- Balances Stakeholders
- Collaborates Effectively

n

PDI is committed to offering a well-rounded benefits program, designed to support and care for you, and your family throughout your life and career. This includes a competitive salary, market-competitive benefits, and a quarterly perks program. We encourage a good work-life balance with ample time off [time away] and, where appropriate, hybrid working arrangements. Employees have access to continuous learning, professional certifications, and leadership development opportunities. Our global culture fosters diversity, inclusion, and values authenticity, trust, curiosity, and diversity of thought, ensuring a supportive environment for all.

📌 Data Engineer IV (Chennai)
🏢 Important Group
📍 Chennai