16 Aug
|
R.L. Polk
|
Bengaluru
16 Aug
R.L. Polk
Bengaluru
The Role:
We are seeking a Lead Data Engineer with extensive experience as a hands-on developer to join our fast-paced data engineering organization. This role is critical in building new data products and modernizing existing data platforms.
The ideal candidate is a seasoned data engineer with a strong background in designing, coding, and optimizing large-scale data pipelines, working deeply with Python, distributed data processing frameworks, and SQL across both on-premises and cloud environments. This individual will also provide technical leadership, guiding other engineers through complex data design and implementation challenges.
Responsibilities:
Data Engineering & Architecture
- Design, build, and maintain scalable, production-grade data pipelines and data products.
- Develop and optimize ETL/ELT workflows using Python and distributed data processing technologies.
- Implement and evolve data models that support both operational and analytical use cases.
- Modernize legacy data platforms, including refactoring and migrating workloads to cloud environments.
- Diagnose and resolve complex data issues related to performance, data quality, and pipeline reliability.
Cloud-Based Data Development
- Build data solutions using a variety of cloud services for storage, processing, orchestration, and analytics.
- Design effective data processing architectures leveraging distributed computing frameworks.
- Optimize data workloads for scalability, performance, and cost efficiency in the cloud.
- Write and maintain infrastructure-as-code scripts to provision and manage data platform resources required for pipelines and jobs.
Technical Leadership & Mentoring
- Lead by example through hands-on development, technical design, and code ownership.
- Participate in and drive code and architecture reviews, ensuring high standards for quality, performance, and maintainability.
- Mentor and support data engineers in Python, distributed data processing, SQL, and cloud-based data en
📌 Lead Data Engineer (Bengaluru)
🏢 R.L. Polk
📍 Bengaluru