21 Nov
|
Orbion Infotech
|
India
21 Nov
Orbion Infotech
India
About the Prospect
A rapid-scaling tech firm in the Enterprise Data & AI Solutions space, we build and operationalize data infrastructure that powers real-time analytics, AI modeling, and decision automation for global enterprises. Our data engineering teams design scalable ETL/ELT pipelines, optimize data lakes and warehouses, and integrate ML workflows—leveraging modern cloud platforms to turn raw data into business-ready intelligence at scale.
Role & Responsibilities
Lead end-to-end data platform architecture: design, build, and scale ETL/ELT pipelines, data models, and ingestion frameworks for multi-petabyte datasets.
Own data infrastructure modernization: migrate on-prem workloads to cloud-native stacks (AWS/Azure/GCP) and implement data governance, lineage, and quality controls.
Partner with Data Science & Analytics teams to deliver feature stores, training datasets, and batch/stream inference pipelines with SLA-aligned reliability.
Implement observability, monitoring, and automation tooling (e.g., Datafold,
Great Expectations, Prometheus) to ensure data freshness and pipeline health.
Mentor and upskill engineers; set engineering standards for CI/CD, code review, and documentation in data teams.
Collaborate with DevOps & Security to deploy infrastructure-as-code (Terraform, CloudFormation) and enforce data access controls and compliance.
Skills & Qualifications
Must-Have
AWS Glue
Apache Airflow
Spark
SQL
Python
dbt
Redshift
BigQuery
Preferred
Google Cloud Dataflow
Delta Lake
MLflow
Benefits & Culture Highlights
Hybrid work model with adaptable office days in Bangalore and remote-friendly policies.
Access to cloud credits, certification reimbursements, and learning stipends for skill growth.
Flat org structure, fast decision-making, and ownership culture for high-impact contributors.
📌 Data Engineer Lead 10 Yrs Bangalore Bengaluru (India)
🏢 Orbion Infotech
📍 India