Table 1 Range of definitions and nomenclature given to silent trials
From: A scoping review of silent trials for medical artificial intelligence
Study type | Definition |
|---|---|
Prospective clinical validation study (modern silent evaluation) | A prospective algorithmic validation involving an assessment of the model’s predictions against live expert annotations to verify facts about the patient or outcome of interest. Separation is maintained between care and model evaluation. |
Prospective algorithmic validation (traditional silent trial) | Running the model live while maintaining a separation between care and model evaluation; assessing model performance but not assessing against live annotations of real-world information beyond the data obtained |
Prospective validation study (internal validation) | Conducting a cross-sectional assessment of a model’s performance |
Prospective observational study | Integrated into the clinical system; may or may not be observable to clinical users |
Temporal validation | Prospective algorithmic validation with a particular focus on the model’s performance over time |
