07 Aug
|
Interra Information Technologies
|
Greater Noida
07 Aug
Interra Information Technologies
Greater Noida
Tech stack flow
PostgreSQL Source of truth MinIO Object storage Apache Iceberg Table format Dremio SQL query engine
Day-to-day responsibilities
- Build ingestion pipelines that pull transactional data from PostgreSQL and land it in MinIO buckets in a structured, partitioned layout.
- Manage Iceberg tables define schemas, partition strategies, and run scheduled maintenance jobs (compaction, snapshot expiry).
- Power Dremio analytics by building virtual datasets and reflections that let analysts run self-serve SQL without touching raw storage.
- Own data quality add row counts, null checks, and freshness alerts at every stage of the pipeline.
- Collaborate with analysts and ML engineers to expose clean, well-documented datasets in Dremio for dashboards and model training.
Job Title - Database Developer
Experience - 4 to 7 Years
Location- Noida, Uttar Pradesh
Work Mode- Work from Office (WFO)
Employment Type - Full time
Department - Data Engineering / Database Development
Interested candidates can share their updated resume at:
[email protected]
Apply here: https://interrait.keka.com/careers/jobdetails/75505
A real example
Scenario: Finance team needs daily revenue numbers, but the data lives in 3 PostgreSQL tables and query time is too slow for dashboards.
1PostgreSQL Write a CDC job or scheduled query to extract orders, payments, refunds tables into Parquet files.
2MinIO Land the Parquet files in s3://warehouse/finance/raw/, partitioned by event_date so only today's data is reprocessed.
3Apache Iceberg Register an Iceberg table on top of that path. Use Iceberg's schema evolution to add a net_revenue column next sprint — no pipeline rewrite needed.
4Dremio Create a virtual dataset that joins the Iceberg table to a dimension table. Enable a reflection so the finance dashboard loads in under 2 seconds.
📌 Database Engineer Lakehouse & Analytics Platform (Greater Noida)
🏢 Interra Information Technologies
📍 Greater Noida