16 Aug
|
S&P Global Mobility
|
Bengaluru
16 Aug
S&P Global Mobility
Bengaluru
The Role:
We are seeking a Lead Data Engineer with extensive experience as a hands-on
developer to join our fast-paced data engineering organization. This role is
critical in building current data products and modernizing existing data platforms.
The ideal candidate is a seasoned data engineer with a strong background in
designing, coding, and optimizing large-scale data pipelines, working deeply
with Python, distributed data processing frameworks, and SQL across both
on-premises and cloud environments. This individual will also provide technical
leadership, guiding other engineers through complex data design and
implementation challenges.
Responsibilities:
Data Engineering & Architecture
* Design, build, and maintain scalable, production-grade data pipelines and
data products.
* Develop and optimize ETL/ELT workflows using Python and distributed data
processing technologies.
* Implement and evolve data models that support both operational and analytical
use cases.
* Modernize legacy data platforms, including refactoring and migrating
workloads to cloud environments.
* Diagnose and resolve complex data issues related to performance, data
quality, and pipeline reliability.
Cloud-Based Data Development
* Build data solutions using a variety of cloud services for storage,
processing, orchestration, and analytics.
* Design efficient data processing architectures leveraging distributed
computing frameworks.
* Optimize data workloads for scalability, performance, and cost efficiency in
the cloud.
* Write and maintain infrastructure-as-code scripts to provision and manage
data platform resources required for pipelines and jobs.
Technical Leadership & Mentoring
* Lead by example through hands-on development, technical design, and code
ownership.
* Participate in and drive code and architecture reviews, ensuring high
standards for quality, performance, and maintainability.
* Mentor and support data engineers in Python, distributed data processing,
SQL, and cloud-based da
📌 Lead Data Engineer (Bengaluru)
🏢 S&P Global Mobility
📍 Bengaluru