17 Aug
|
S&P Global Mobility
|
Bengaluru
17 Aug
S&P Global Mobility
Bengaluru
The Role:
We are seeking a Lead Data Engineer with extensive experience as a hands-on
developer to join our quick-paced data engineering organization. This role is
critical in building current data products and modernizing existing data platforms.
The ideal candidate is a seasoned data engineer with a solid background in
designing, coding, and optimizing large-scale data pipelines, working deeply
with Python, distributed data processing frameworks, and SQL across both
on-premises and cloud environments. This individual will also provide technical
leadership, guiding other engineers through complex data design and
implementation challenges.
Responsibilities:
Data Engineering & Architecture
Design, build, and maintain scalable, production-grade data pipelines and
data products.
Develop and optimize ETL/ELT workflows using Python and distributed data
processing technologies.
Implement and evolve data models that support both operational and analytical
use cases.
Modernize legacy data platforms, including refactoring and migrating
workloads to cloud environments.
Diagnose and resolve complex data issues related to performance, data
quality, and pipeline reliability.
Cloud-Based Data Development
Build data solutions using a variety of cloud services for storage,
processing, orchestration, and analytics.
Design efficient data processing architectures leveraging distributed
computing frameworks.
Optimize data workloads for scalability, performance, and cost efficiency in
the cloud.
Write and maintain infrastructure-as-code scripts to provision and manage
data platform resources required for pipelines and jobs.
Technical Leadership & Mentoring
Lead by example through hands-on development, technical design, and code
ownership.
Participate in and drive code and architecture reviews, ensuring high
standards for quality, performance, and maintainability.
Mentor and support data engineers in Python, distributed data processing,
SQL, and cloud-based da
📌 Lead Data Engineer Bengaluru
🏢 S&P Global Mobility
📍 Bengaluru