The Moses-Littenberg meta-analytical method generates systematic differences in test accuracy compared to hierarchical meta-analytical models.

Dinnes J., Mallett S., Hopewell S., Roderick PJ., Deeks JJ.

OBJECTIVE: To compare meta-analyses of diagnostic test accuracy using the Moses-Littenberg summary receiver operating characteristic (SROC) approach with those of the hierarchical SROC (HSROC) model. STUDY DESIGN AND SETTING: Twenty-six data sets from existing test accuracy systematic reviews were reanalyzed with the Moses-Littenberg model, using equal weighting ("E-ML") and weighting by the inverse variance of the log DOR ("W-ML"), and with the HSROC model. The diagnostic odds ratios (DORs) were estimated and covariates added to both models to estimate relative DORs (RDORs) between subgroups. Models were compared by calculating the ratio of DORs, the ratio of RDORs, and P-values for detecting asymmetry and effects of covariates on DOR. RESULTS: Compared to the HSROC model, the Moses-Littenberg model DOR estimates were a median of 22% ("E-ML") and 47% ("W-ML") lower at Q*, and 7% and 42% lower at the central point in the data. Instances of the ML models giving estimates higher than the HSROC model also occurred. Investigations of heterogeneity also differed; the Moses-Littenberg models on average estimating smaller differences in RDOR. CONCLUSIONS: Moses-Littenberg meta-analyses can generate lower estimates of test accuracy, and smaller differences in accuracy, compared to mathematically superior hierarchical models. This has implications for the usefulness of meta-analyses using this approach. We recommend meta-analysis of diagnostic test accuracy studies to be conducted using available hierarchical model-based approaches.

DOI

10.1016/j.jclinepi.2016.07.011

Type

Journal article

Journal

J clin epidemiol

Publication Date

12/2016

Volume

80

Pages

77 - 87

Keywords

Diagnostic odds ratio, Diagnostic test accuracy, Hierarchical models, Meta-analysis, Summary ROC curves, Systematic review, Diagnostic Tests, Routine, Humans, Meta-Analysis as Topic, Odds Ratio, ROC Curve, Reproducibility of Results

Permalink Original publication