Entity:
Technology
Job Family Group:
IT&S; Group
Job Description:
Let me tell you about the role
Our data engineers build and run the data pipelines and platforms that bp pulse relies on every day. The team builds on Databricks and AWS.
As a Data Engineer, you will build and maintain data pipelines, help keep our data accurate and well-governed, and work closely with senior engineers who will support your growth. It's a hands-on role with plenty of room to develop a outstanding fit if you have solid fundamentals and want to deepen your skills on a modern data stack.
What you will deliver
• Build and maintain reliable, scalable data pipelines on Databricks and AWS.
• Implement data ingestion, validation and transformation.
• Write well-tested software to build, integrate and quality-assure data across bp pulse, meeting privacy and compliance needs.
• Follow valuable engineering and data practice: technical design, testing, code review, source control, documentation, data modelling and observability.
• Help build and improve CI/CD pipelines and infrastructure as code.
• Run data quality checks to keep data accurate and reliable.
• Help keep pipelines and services healthy monitoring, alerting and business-hours support.
• Work with senior engineers and people across the business to turn needs into dependable data products.
What you will need to be successful
Essential
• Hands-on experience building and maintaining reliable, scalable data pipelines and data products, often alongside more senior engineers.
• Experience with Databricks, PySpark, Spark SQL and Delta Lake (or a similar lakehouse platform, with a real appetite to grow on Databricks).
• Experience with AWS data and serverless services (e.g. Lambda, Glue, S3, Kinesis, SNS/SQS).
• Valuable Python and SQL skills.
• An understanding of data modelling and data quality fundamentals.
• Some experience with CI/CD and infrastructure as code.
• Strong verbal and written communication skills.
• A curious, continuous-improvement minds
📌 Data Engineer Pune
🏢 Bp
📍 Pune