Entity:
Technology
Job Family Group:
IT&S; Group
Job Description:
Let me tell you about the role
Our data engineers build and run the data pipelines and platforms that bp pulse relies on every day. The team builds on Databricks and AWS.
As a Senior Data Engineer, you will design and build data pipelines, model data for analysis, and keep our platforms dependable and well-governed. It's a hands-on, senior role: setting a high engineering standard, mentoring other engineers, and acting as an informal technical lead within the squad leading through experience rather than a formal management line.
What you will deliver
• Design, build and run reliable, scalable, distributed data pipelines on Databricks and AWS.
• Model data for analysis, keeping it accurate, well-governed and easy to use.
• Write secure, well-tested software to build, integrate and quality-assure data across bp pulse, meeting privacy and compliance needs.
• Follow and encourage valuable engineering practice: technical design and review, testing, code review, source control and documentation.
• Build and improve CI/CD pipelines and manage infrastructure as code.
• Look after the pipelines and services the team builds monitoring, alerting and business-hours support and keep improving their reliability.
• Mentor other engineers and share knowledge to lift the quality of the team's work.
• Work with people across the business to understand what they need and turn it into dependable data products.
What you will need to be successful
Essential
• Strong, hands-on experience building and running reliable, scalable, distributed data pipelines and data products in complex settings.
• Hands-on experience with Databricks, PySpark, Spark SQL, Delta Lake, Unity Catalog and Workflows (or similar lakehouse experience, with a real appetite to grow on Databricks).
• Experience with AWS data and serverless services (e.g. Lambda, Glue, S3, Redshift, Kinesis, SNS/SQS).
• Strong Python and advanced SQL.
• Positive data modellin
📌 Senior Data Engineer Pune
🏢 Bp
📍 Pune