Data Engineer-1 (Airoli)

Data Engineer-1 (Airoli)

29 Oct
|
Viridien
|
Airoli

29 Oct

Viridien

Airoli

Team Description

Data Hub is a dynamic team of scientists and developers who love solving complex problems. We provide leading edge technology solutions and services to solve our clients’ data transformation and analytics challenges across a range of industries including geothermal, environmental, hydrocarbon and mineral exploration. You will be working in an open and collaborative environment with opportunities to learn, grow, and develop. We have an informal team culture and believe work should be fun and rewarding.

Principal Accountabilities

- Plan, develop, deploy and maintain connectors and integrations between our data system and clients systems, such as systems of record or downstream consumption channels.
- Contribute to the development of our data platform infrastructure. This includes our orchestration systems, data processing logic and the interactions between system components.
- Help develop a flexible framework for data transformations by creating a modular system where new transformation logic can be easily developed and integrated into our product offering.- Influence our choice of architecture and technology. You will be expected to communicate design ideas and solutions clearly through architectural diagrams and documentation to both technical and non-technical stakeholders.
- Awareness of best practices in software and data engineering, writing secure, performant, and maintainable code (Python, SQL). You will have a keen eye for minimising technical debt and optimising performance where it matters.
- Partner with data analysts, data scientists, and other end-users to understand their requirements and ensure the platform and its data are accessible, reliable, and meet project delivery needs.
- Share your work and best practices; collaborate with others; ensure what we build and how we build it aligns to our ambition for growth.

Qualifications and Experience

Key Competencies

- Experience of developing data integrations with geoscience or other scientific data types.
- Experience with geospatially referenced data and experience with oil and gas and/or mining domains highly advantageous
- Previous experience of designing, building and maintaining data transformations in a system or product setting.
- Ability to write secure and performant code in Python and SQL, and ability to optimise queries and data pipelines.
- Experience using orchestrators and ETL tools, especially Airflow
- Significant RDBMS experience (PostgreSQL, Oracle). Experience with other database types such as NoSQL database (e.g. Neo4j, Elastic) or Vector also beneficial
- Data architecture experience relating to data modelling, data warehousing and schema design (3NF, dimensional modelling, medallion architecture).
- Experience using docker, VCS (git, Gitlab) and knowledge of CI/CD
- Enthusiastic attitude towards learning and the flexibility to adapt to recent challenges or changes in direction.

Experience of the following tools / technologies will also be beneficial :

- Knowledge of DevOps and DataOps best practices.
- Kubernetes deployment experience.
- Microsoft Azure and cloud native data technologies, e.g. Azure Data Factory, Databricks.
- RESTful API / GraphQL.
- Infrastructure as Code Our Hiring Process

At Viridien, we are committed to delivering a respectful, inclusive, and transparent recruitment experience.

We see things differently. Diversity fuels our innovation, we value the unique ways in which we differ, and we are committed to equal employment opportunities for all professionals.

📌 Data Engineer-1 (Airoli)
🏢 Viridien
📍 Airoli

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data engineer-1 (airoli) / airoli

Subscribe to this job alert:

Get the latest job offers by email for: data engineer-1 (airoli) / airoli