20 Nov
|
Orbion Infotech
|
Bengaluru
20 Nov
Orbion Infotech
Bengaluru
About the Opportunity
A rapid-scaling tech firm in the Enterprise Data & AI Solutions space, we build and operationalize data infrastructure that powers real-time analytics, AI modeling, and decision automation for global enterprises. Our data engineering teams design scalable ETL/ELT pipelines, optimize data lakes and warehouses, and integrate ML workflows—leveraging modern cloud platforms to turn raw data into business-ready intelligence at scale.
Role & Responsibilities
- Lead end-to-end data platform architecture: design, build, and scale ETL/ELT pipelines, data models, and ingestion frameworks for multi-petabyte datasets.
- Own data infrastructure modernization: migrate on-prem workloads to cloud-native stacks (AWS/Azure/GCP) and implement data governance, lineage, and quality controls.
- Partner with Data Science & Analytics teams to deliver feature stores, training datasets, and batch/stream inference pipelines with SLA-aligned reliability.
- Implement observability, monitoring, and automation tooling (e.g.,
Datafold, Great Expectations, Prometheus) to ensure data freshness and pipeline health.
- Mentor and upskill engineers; set engineering standards for CI/CD, code review, and documentation in data teams.
- Collaborate with DevOps & Security to deploy infrastructure-as-code (Terraform, CloudFormation) and enforce data access controls and compliance.
Skills & Qualifications
- Must-Have
- AWS Glue
- Apache Airflow
- Spark
- SQL
- Python
- dbt
- Redshift
- BigQuery
- Preferred
- Google Cloud Dataflow
- Delta Lake
- MLflow
Benefits & Culture Highlights
- Hybrid work model with flexible office days in Bangalore and remote-friendly policies.
- Access to cloud credits, certification reimbursements, and learning stipends for skill growth.
- Flat org structure, fast decision-making, and ownership culture for high-impact contributors.
📌 Data Engineer Lead( 10 Yrs Bangalore) (Bengaluru)
🏢 Orbion Infotech
📍 Bengaluru