Development of data processes for the automated ongoing generation of patient level data (the “data product”) to be used by various business stakeholders for a variety of purposes (e.g. dashboards, reports, studies).
Downstream manipulation of datasets after their onboarding from data vendors/partners (an activity predominantly carried out by the vendors and Client IT department) from “raw” format as provided into useable data structures that will be used to carry out RWE studies, dashboards & other data outputs
Transformation of raw datasets into usable datasets
Occasional conversion of bespoke / one-off datasets (e.g. biomarkers, mutations) to OMOP format (including an understanding of what can and cannot be converted to OMOP format, e.g. to allow analysis to be carried out on residual data that cannot be converted to OMOP).
Communication
Technical engagement with key stakeholders (e.g. epidemiologist, statisticians, market access/health economists)
from outside the RWE programming team to ensure a full and detailed understanding of end-user requirement is created and carefully documented. This includes scoping discussions, business analysis and translation of verbalised end-user needs into actionable data structures
Detailed technical engagement with colleagues from within the RWE programming team to build data structures required for the generation of RWE study outputs and data products; also support those team members in creating the study outputs where the data engineer’s skillset can add incremental value
Liaison & ongoing interaction with IT department to ensure that raw datasets inbound from data partners are fit for the agreed purposes (as per bullet point 1 above)
Liaise, where required, with technical staff employed by analysis software vendors (Databricks etc)
Documentation
Maintain explicit documentation of data flows, schemas, pipelines, and processes to facilitate onboarding, troubleshooting and auditing.
Quality, Validation & Support
Design and carr
📌 Principal Data Engineer (India)
🏢 Veramed
📍 India