Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

OBJECTIVE: To compare meta-analyses of diagnostic test accuracy using the Moses-Littenberg summary receiver operating characteristic (SROC) approach with those of the hierarchical SROC (HSROC) model. STUDY DESIGN AND SETTING: Twenty-six data sets from existing test accuracy systematic reviews were reanalyzed with the Moses-Littenberg model, using equal weighting ("E-ML") and weighting by the inverse variance of the log DOR ("W-ML"), and with the HSROC model. The diagnostic odds ratios (DORs) were estimated and covariates added to both models to estimate relative DORs (RDORs) between subgroups. Models were compared by calculating the ratio of DORs, the ratio of RDORs, and P-values for detecting asymmetry and effects of covariates on DOR. RESULTS: Compared to the HSROC model, the Moses-Littenberg model DOR estimates were a median of 22% ("E-ML") and 47% ("W-ML") lower at Q*, and 7% and 42% lower at the central point in the data. Instances of the ML models giving estimates higher than the HSROC model also occurred. Investigations of heterogeneity also differed; the Moses-Littenberg models on average estimating smaller differences in RDOR. CONCLUSIONS: Moses-Littenberg meta-analyses can generate lower estimates of test accuracy, and smaller differences in accuracy, compared to mathematically superior hierarchical models. This has implications for the usefulness of meta-analyses using this approach. We recommend meta-analysis of diagnostic test accuracy studies to be conducted using available hierarchical model-based approaches.

Original publication

DOI

10.1016/j.jclinepi.2016.07.011

Type

Journal article

Journal

J clin epidemiol

Publication Date

12/2016

Volume

80

Pages

77 - 87

Keywords

Diagnostic odds ratio, Diagnostic test accuracy, Hierarchical models, Meta-analysis, Summary ROC curves, Systematic review, Diagnostic Tests, Routine, Humans, Meta-Analysis as Topic, Odds Ratio, ROC Curve, Reproducibility of Results