Description
Multi-Reader Multi-Case Analysis of Variance.
Description
Estimation and comparison of the performances of diagnostic tests in multi-reader multi-case studies where true case statuses (or ground truths) are known and one or more readers provide test ratings for multiple cases. Reader performance metrics are provided for area under and expected utility of ROC curves, likelihood ratio of positive or negative tests, and sensitivity and specificity. ROC curves can be estimated empirically or with binormal or binormal likelihood-ratio models. Statistical comparisons of diagnostic tests are based on the ANOVA model of Obuchowski-Rockette and the unified framework of Hillis (2005) <doi:10.1002/sim.2024>. The ANOVA can be conducted with data from a full factorial, nested, or partially paired study design; with random or fixed readers or cases; and covariances estimated with the DeLong method, jackknifing, or an unbiased method. Smith and Hillis (2020) <doi:10.1117/12.2549075>.
README.md
MRMCaov: Multi-Reader Multi-Case Analysis of Variance
Getting Started
MRMCaov is an R package for statistical comparison of diagnostic tests - such as those based on medical imaging - for which ratings have been obtained from multiple readers and on multiple cases. Features of the package include the following.
- Statistical comparisons of diagnostic tests with respect to reader performance metrics
- Comparisons based on the ANOVA model of Obuchowski-Rockette and the unified framework of Hillis
- Reader performance metrics for area under receiver operating characteristic curves (ROC AUCs), partial AUCs, expected utility of ROC curves, likelihood ratio of positive or negative tests, sensitivity, specificity, and user-defined metrics
- Parametric and nonparametric estimation and plotting of ROC curves
- Support for factorial, nested, and partially paired study designs
- Inference for random or fixed readers and cases
- Conversion of Obuchowski-Rockette to Roe, Metz & Hillis model parameters and vice versa
- DeLong, jackknife, and unbiased covariance estimation
- Compatibility with Microsoft Windows, MacOS, and Linux
Documentation: User Guide
Installation
Enter the following at the R console to install the package.
install.packages("MRMCaov")
Citing the Software
## Text format
citation("MRMCaov")
To cite MRMCaov in publications, please use the following two references, including the R package URL.
Smith BJ, Hillis SL, Pesce LL (2023). _MCMCaov: Multi-Reader Multi-Case Analysis of Variance_. R
package version 0.3.0, <https://github.com/brian-j-smith/MRMCaov>.
Smith BJ, Hillis SL (2020). "Multi-reader multi-case analysis of variance software for diagnostic
performance comparison of imaging modalities." In Samuelson F, Taylor-Phillips S (eds.),
_Proceedings of SPIE 11316, Medical Imaging 2020: Image Perception, Observer Performance, and
Technology Assessment_, 113160K. doi:10.1117/12.2549075 <https://doi.org/10.1117/12.2549075>,
<https://pubmed.ncbi.nlm.nih.gov/32351258>.
To see these entries in BibTeX format, use 'print(<citation>, bibtex=TRUE)', 'toBibtex(.)', or set
'options(citation.bibtex.max=999)'.
## Bibtex format
toBibtex(citation("MRMCaov"))
@Manual{MRMCaov-package,
author = {Brian J Smith and Stephen L Hillis and Lorenzo L Pesce},
title = {{MCMCaov}: Multi-Reader Multi-Case Analysis of Variance},
year = {2023},
note = {R package version 0.3.0},
url = {https://github.com/brian-j-smith/MRMCaov},
}
@InProceedings{MRMCaov-SPIE2020,
author = {Brian J. Smith and Stephen L. Hillis},
title = {Multi-reader multi-case analysis of variance software for diagnostic performance comparison of imaging modalities},
booktitle = {Proceedings of SPIE 11316, Medical Imaging 2020: Image Perception, Observer Performance, and Technology Assessment},
editor = {Frank Samuelson and Sian Taylor-Phillips},
month = {16 March},
year = {2020},
pages = {113160K},
doi = {10.1117/12.2549075},
url = {https://pubmed.ncbi.nlm.nih.gov/32351258},
}