WHAT YOULL DO:
Design data pipelines utilizing ETL tools, event driven software, and other streaming software.
Design data architecture that is easy and maintainable while enabling Data Analysts, Data Scientists, and stakeholders to efficiently work with data.
Partner with both data scientists and engineers to bring our amazing concepts to reality. This requires learning to speak the language of statisticians as well as software engineers.
Ensure reliability and quality in data pipelines and enforce data governance, security and protection of our customer information while balancing tech debt.
Partner with product and engineering teams to design data models for downstream consumers.
Evaluate and champion recent engineering tools that help us move faster and scale our team
WHAT YOU’LL NEED:
You have 5+ years of data engineer experience coding in Python and using SQL.
Experience working with at least one major Datawarehouse in BigQuery, Snowflake, Databricks
Bachelor's degree in technology or data science or a related filed, work experience can be substituted for education
You are comfortable with data engineering tools such as Airflow, dbt,
AirByte/ Fivetran, Atlassian suite, GitHub, Terraform as well as Kubernetes.
You understand standard ETL patterns, up-to-date data warehousing ideas such as data mesh or data vaulting, and data quality practices regarding test driven design and data observability.
You have experience partnering with data analysts, data scientists, and engineering stakeholders.
You have a background in data engineering, computer science, software development or another engineering field
You can communicate with a team and articulate ideas to both team members and non-technical stakeholders
You have a drive to learn and master new technologies and techniques
Bachelor's degree or relevant experience can substitute for formal education
Technologies You Will Use
Python/ Airflow for data pipeline and automation.
Airbyte for ETL purpose
dbt for data transformation
Snowflake/ BigQuery as Data Warehouse
AWS, GCP, Terraform, Kubernetes, GitHub and more: we keep adopting new tools as we grow!
📌 Senior Data Engineer Bengaluru
🏢 Allegis Group
📍 Bengaluru
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.