We are looking for a talented individual with minimum 5 years of experience to join a team of passionate and highly-skilled technology professionals in creating leading customer-centric software for the energy and finance sector.
Roles & Responsibilities-
- Building and optimizing data pipelines to facilitate the extraction of data from multiple sources and load it into data warehouses. A DataOps engineer must be familiar with extract, load, transform (ELT) and extract, transform, load (ETL) tools.
- Using automation to streamline data processing. To reduce development time and increase data reliability, DataOps engineers automate manual processes, such as data extraction and testing.
- Managing the production of data pipelines. A DataOps engineer provides organizations with access to structured datasets and analytics they will further analyze and derive insights from.
- Designing data engineering assets. This involves developing frameworks to support an organizations data demands.
- Facilitating collaboration.
DataOps engineers communicate and collaborate with other data and BI team members to enhance the quality of data products.
- Testing. This involves executing automated testing at every stage of a pipeline to increase productivity while reducing errors. This includes unit tests (testing separate components of a data pipeline) as well as performance tests (testing the responsiveness) and end-to-end tests (testing the whole pipeline).
- Adopting current solutions. This includes testing and adopting solutions and tools that adhere to the DataOps best practices.
- Handling security. DataOps engineers ensure data security standards are applied across the data pipelines.
- Reducing waste and improving data flow. This involves continually striving to reduce wasted effort, identify gaps and correct them, and improve data development and deployment processes.
- Database Consolidations: Assist in consolidating multiple databases across different cloud prov