19 Nov
|
Orbion Infotech
|
Bengaluru
19 Nov
Orbion Infotech
Bengaluru
About The Chance A fast-scaling tech firm in the Enterprise Data & AI Solutions space, we build and operationalize data infrastructure that powers real-time analytics, AI modeling, and decision automation for global enterprises. Our data engineering teams design scalable ETL/ELT pipelines, optimize data lakes and warehouses, and integrate ML workflows—leveraging modern cloud platforms to turn raw data into business-ready intelligence at scale. Role & Responsibilities
• Lead end-to-end data platform architecture: design, build, and scale ETL/ELT pipelines, data models, and ingestion frameworks for multi-petabyte datasets.
• Own data infrastructure modernization: migrate on-prem workloads to cloud-native stacks (AWS/Azure/GCP) and implement data governance, lineage, and quality controls.
• Partner with Data Science & Analytics teams to deliver feature stores, training datasets, and batch/stream inference pipelines with SLA-aligned reliability.
• Implement observability, monitoring, and automation tooling (e.g., Datafold, Excellent Expectations, Prometheus)
to ensure data freshness and pipeline health.
• Mentor and upskill engineers; set engineering standards for CI/CD, code review, and documentation in data teams.
• Collaborate with DevOps & Security to deploy infrastructure-as-code (Terraform, CloudFormation) and enforce data access controls and compliance. Skills & Qualifications
• Must-Have
• AWS Glue
• Apache Airflow
• Spark
• SQL
• Python
• dbt
• Redshift
• BigQuery
• Preferred
• Google Cloud Dataflow
• Delta Lake
• MLflow Benefits & Culture Highlights
• Hybrid work model with flexible office days in Bangalore and remote-friendly policies.
• Access to cloud credits, certification reimbursements, and learning stipends for skill growth.
• Flat org structure, rapid decision-making, and ownership culture for high-impact contributors.
Skills:
spark,data,python
📌 Data Engineer Lead( 10 Yrs Bangalore) (Bengaluru)
🏢 Orbion Infotech
📍 Bengaluru