01 Sep
|
Steigen Elevators
|
Hyderabad
01 Sep
Steigen Elevators
Hyderabad
Tech stacks: AWS, databricks, pyspark, DBT, airflow ,sql
Shift Timing : Evening Shift 6:30pm Work from Office
Responsibilities Include
Design and maintain DBT models that produce trusted datasets, features, and metrics the Data Science team relies on for analysis, experimentation, ML, and reporting.
Build and operate pipelines in Databricks - PySpark jobs and Delta/Iceberg tables - that turn raw operational events into analysis-ready data.
Develop deep familiarity with operations so the datasets, schemas, and models
you ship reflect how the business actually works.
Orchestrate end-to-end data workflows in Airflow (and Prefect where it fits), with SLAs the DS team can count on for daily models, dashboards, and operational decisions.
Participate in peer code reviews and raise the bar on data quality, testing, and
documentation across the team's models.
Partner with data scientists to scope, design, and productionize feature pipelines and the model-supporting data behind them.
Optimize DBT and Spark workloads for cost, performance, and reliability as data
volume grows.
Learning new technologies quickly - nobody comes into this role knowing every piece of the stack.
5+ years of experience building, testing, and deploying data engineering systems.
Experience with at least one distributed data system, and the ability to reason about consistency, latency, throughput, and fault tolerance.
Robust SQL and proficiency with at least one of (py)Spark, DBT, or Airflow in production.
Experience with Infrastructure-as-Code systems such as Terraform, AWS CDK, or
Pulumi.
Understanding or strong interest in supply chain and the data challenges it creates.
A self-starter who takes initiative, moves fast, and ships while collaborating on big
challenges.
Enthusiastic about working closely with team members to develop creative solutions to
novel problems.
Excellent written and oral communication in English.
Tech: DBT, Databricks, (py)Spark, Airflow, Prefect, SQL, Iceberg/De
📌 Data engineer (Hyderabad)
🏢 Steigen Elevators
📍 Hyderabad