Entity:
Technology
Job Family Group:
ITS Group Data Engineers Data Engineer - (Individual Contributor, Grade I)
BP Business Solutions India Private Limited is seeking a skilled Data Engineer to design, develop, and maintain robust data pipelines and infrastructure, ensuring data quality and accessibility to support business intelligence and analytics initiatives.Responsibilities
- Part of a cross-disciplinary team, working closely with other data engineers, software engineers, data scientists, data managers and business partners.
- Implements and maintains reliable and scalable data infrastructure to move, process and serve data.
- Writes, deploys and maintains software to build, integrate, manage, maintain, and quality-assure data at bp.
- Adheres to and advocates for software engineering best practices (e.g. technical design, technical design review, unit testing, monitoring alerting, checking in code, code review, documentation),
- Responsible for deploying secure and well-tested software that meets privacy and compliance requirements; develops,
maintains and improves CI / CD pipeline,
- Responsible for service reliability and following site-reliability engineering best practices: on-call rotations for services they maintain, responsible for defining and maintaining SLAs. Help design, build, deploy and maintain infrastructure as code. Containerizes server deployments.
- Actively contributes to improve developer velocity.
Qualifications
Essential
- Hands-on experience (typically 2 - 5 years) designing, planning, building, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments
- Development experience in one or more object-oriented programming languages (e.g. Python, Scala, Java, C#)
- Strong experience on Databricks, Notebooks, Delta Lake, Delta live tables
- Experience in AWS cloud, Glue, Lambda, Redshift etc.
- Robust experience on ETL, ELT using PySpark.
- Experience with SQL and no
📌 Data Engineer (Pune)
🏢 Castrol
📍 Pune