Validation, updating and impact of clinical prediction rules: a review
- PMID: 19208371
- DOI: 10.1016/j.jclinepi.2008.04.008
Validation, updating and impact of clinical prediction rules: a review
Abstract
Objective: To provide an overview of the research steps that need to follow the development of diagnostic or prognostic prediction rules. These steps include validity assessment, updating (if necessary), and impact assessment of clinical prediction rules.
Study design and setting: Narrative review covering methodological and empirical prediction studies from primary and secondary care.
Results: In general, three types of validation of previously developed prediction rules can be distinguished: temporal, geographical, and domain validations. In case of poor validation, the validation data can be used to update or adjust the previously developed prediction rule to the new circumstances. These update methods differ in extensiveness, with the easiest method a change in model intercept to the outcome occurrence at hand. Prediction rules -- with or without updating -- showing good performance in (various) validation studies may subsequently be subjected to an impact study, to demonstrate whether they change physicians' decisions, improve clinically relevant process parameters, patient outcome, or reduce costs. Finally, whether a prediction rule is implemented successfully in clinical practice depends on several potential barriers to the use of the rule.
Conclusion: The development of a diagnostic or prognostic prediction rule is just a first step. We reviewed important aspects of the subsequent steps in prediction research.
Similar articles
-
Clinical prediction rules to stratify short-term risk of stroke among patients diagnosed in the emergency department with a transient ischemic attack.Ann Emerg Med. 2009 May;53(5):662-73. doi: 10.1016/j.annemergmed.2008.08.004. Epub 2008 Oct 11. Ann Emerg Med. 2009. PMID: 18849093
-
Validating and updating a prediction rule for neurological sequelae after childhood bacterial meningitis.Scand J Infect Dis. 2006;38(1):19-26. doi: 10.1080/00365540500372671. Scand J Infect Dis. 2006. PMID: 16338834
-
Risk prediction models: II. External validation, model updating, and impact assessment.Heart. 2012 May;98(9):691-8. doi: 10.1136/heartjnl-2011-301247. Epub 2012 Mar 7. Heart. 2012. PMID: 22397946 Review.
-
Good generalizability of a prediction rule for prediction of persistent shoulder pain in the short term.J Clin Epidemiol. 2007 Sep;60(9):947-53. doi: 10.1016/j.jclinepi.2006.11.015. Epub 2007 May 4. J Clin Epidemiol. 2007. PMID: 17689811
-
Clinical prediction rules. Applications and methodological standards.N Engl J Med. 1985 Sep 26;313(13):793-9. doi: 10.1056/NEJM198509263131306. N Engl J Med. 1985. PMID: 3897864 Review.
Cited by
-
An interrater reliability analysis of preoperative mortality risk calculators used for elective high-risk noncardiac surgical patients shows poor to moderate reliability.BMC Anesthesiol. 2024 Oct 30;24(1):392. doi: 10.1186/s12871-024-02771-8. BMC Anesthesiol. 2024. PMID: 39478449 Free PMC article.
-
Development and temporal validation of a clinical prediction model of transition to psychosis in individuals at ultra-high risk in the UHR 1000+ cohort.World Psychiatry. 2024 Oct;23(3):400-410. doi: 10.1002/wps.21240. World Psychiatry. 2024. PMID: 39279417 Free PMC article.
-
Development and External Validation of a Prediction Model for Colorectal Cancer Among Patients Awaiting Surveillance Colonoscopy Following Polypectomy.Gastro Hep Adv. 2024 Mar 15;3(5):671-683. doi: 10.1016/j.gastha.2024.03.008. eCollection 2024. Gastro Hep Adv. 2024. PMID: 39165417 Free PMC article.
-
Diagnostic prediction models for bacterial meningitis in children with a suspected central nervous system infection: a systematic review and prospective validation study.BMJ Open. 2024 Aug 7;14(8):e081172. doi: 10.1136/bmjopen-2023-081172. BMJ Open. 2024. PMID: 39117411 Free PMC article.
-
Geographical validation of the Smart Triage Model by age group.PLOS Digit Health. 2024 Jul 1;3(7):e0000311. doi: 10.1371/journal.pdig.0000311. eCollection 2024 Jul. PLOS Digit Health. 2024. PMID: 38949998 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources