03 Aug
|
VIDA
|
Bengaluru
At VIDA we’re building the future of digital identity. As a Data Engineer you’ll work across the stack—from platform and infrastructure to data pipelines and end-user tooling. You’ll help us modernize our batch ETLs and lead our push into streaming and real-time fraud detection. We run on AWS and make extensive use of Scala Spark, dbt, and Terraform.Responsibilities
- Build and expose the data lake/lakehouse so teams can understand business and product performance and make better decisions.
- Design and evolve a data platform that enables scientists and analysts to query, model, and ship features and product metrics.
- Develop scalable and reliable batch and streaming pipelines that ingest from wide-ranging sources and land trusted datasets.
- Maintain and fix existing ETLs, improving reliability, observability, and cost while planning safe backfills and replays.
- Model curated layers and maintain transformation logic (e.g., dbt), including testing, documentation, and data quality.
- Build with Infrastructure as Code (e.g., Terraform) and contribute to CI/CD and deployment practices.
- Partner with Engineering, and Data Science to deliver low-latency signals and features for real-time decisioning.
- Contribute to internal tools, reusable components, and simple dashboards that unblock self-service.
Requirements
- Solid engineering foundation with 5+ years of relevant experience in data engineering and/or distributed systems.
- Hands-on work building data pipelines (batch and/or streaming) using at least one distributed framework (e.g., Spark, Kafka, Flink).
- Comfortable with SQL and a transformation framework (e.g., dbt or similar).
- Familiarity with AWS services for data (any mix of S3, EMR/Glue, Kinesis/MSK, Lambda, Redshift/Athena) or equivalent cloud experience.
- Exposure to workflow orchestration (e.g., Airflow).
- Experience using Terraform (or similar IaC) to manage data/platform resources.
- Ownership mindset, focus on reliability, and enjoyment of collaborati
📌 Data Engineer (Bengaluru)
🏢 VIDA
📍 Bengaluru