Overview:  OR-DBM MRMC 2.4 represents an upgrade to the program DBM MRMC 2.3.  New features include the ability to perform both Dorfman-Berbaum-Metz (DBM) and Obuchowski-Rockette (OR) analyses for all three types of analyses: random readers and random cases, random readers and fixed cases, and fixed reader and random cases.  For the OR method three types of error covariance estimation can be selected: jackknife, bootstrap, or the method of DeLong et al (1988, Biometrics).  The program also allows for user-friendly “stacked” data entry format and the ability to export data in previous formats to the stacked format

OR-DBM MRMC References

Dorfman, D.D., Berbaum, K.S., & Metz, C.E. (1992). Receiver operating characteristic rating analysis: Generalization to the population of  readers and patients with the jackknife method. Investigative Radiology, 27, 723-731.


Dorfman, D.D., Berbaum, K.S., Lenth, R.V., Chen, Y.F., & Donaghy, B.A. (1998).  Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: Factorial experimental design. Academic Radiology, 5, 591-602.


Hillis, S.L., & Berbaum, K.S. (2004). Power estimation for the Dorfman-Berbaum-Metz method. Academic Radiology, 11, 1260-1273.


Hillis, S.L., Obuchowski, N.A., Schartz, K.M., & Berbaum, K.S. (2005). A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Statistics in Medicine, 24, 1579-1607.  DOI:10.1002/sim.2024.


Hillis, S.L. (2005). Monte Carlo validation of the Dorfman-Berbaum-Metz method using normalized pseudovalues and less data-based model simplification. Academic Radiology, 12, 1534-1541  DOI:10.1016/j.acra.2005.07.012.


Hillis, S.L. (2007). A comparison of denominator degrees of freedom for multiple observer ROC analysis. Statistics in Medicine, 26, 596-619. DOI: 10.1002/sim.2532.
Hillis, S.L., Berbaum, K.S., Metz, C.E. (2008).  Recent developments in the Dorfman-Berbaum-Metz procedure for multireader ROC study analysis. Academic Radiology, 15, 647-661. DOI:10.1016/j.acra.2007.12.015


OR-DBM MRMC Downloads

   Terms of Use   ||   Privacy Statement   ||   Copyright 2018 Medical Image Perception Laboratory