Multi-Reader Sample Size Program for Diagnostic Studies

Overview (updated 02-20-18):

The Multi-Reader Sample Size Sample Size Program for Diagnostic Studies performs sample size computations for diagnostic reader-performance studies. Such studies are commonly used in radiology, where radiologists evaluate cases based on corresponding images resulting from an imaging modality (such as mammography for breast cancer) with respect to confidence of disease. In such studies a typical reader-performance measure is the area under the ROC curve. In the most common study design, the factorial design, each reader reads all cases under each modality (or test).

The program includes options for specifying five different study designs, nonequivalence and noninferiority hypotheses, and three different inference situations. The program works for any type of reader performance outcome. The program requires parameter estimates that are either conjectured or obtained from pilot data. Pilot data estimates can be obtained from analyses of data sets that use the methods proposed by Obuchowski & Rockette and by Dorfman, Berbaum and Metz, and updated by Hillis and colleagues. The software provides various combinations of the numbers of readers and cases needed for a specified power, or alternatively provides the power corresponding to specified numbers of readers and cases.

Questions? Contact Steve Hillis (steve-hillis@uiowa.edu).

Brief Instructions

The program will run under Windows, macOS, and Linux. However, you must have a Java run-time environment (JRE) installed. The process of obtaining the JRE varies with operating system. To install the program, simple download the “Executable” file below. This is an executable jar file. Users may also wish to download the “Instructions” file below which provides a description of obtaining the current JRE for Windows. To run the program, simply double-click the executable jar file. The name of the jar file will be of the form pssYYYYMMDD.jar where YYYYMMDD is the date of the current version of the program (e.g., pss20170828.jar). The user manual is contained within the jar file and may be accessed using the Help menu in the program (it is also available as a separate download below).

Note to macOS and Linux users: The program has only been tested using the JRE provided by Oracle. Use of other JREs is possible but not supported.


Downloads

 TitleDescriptionModified Date 
Hillis & Schartz (2015) Proc. SPIEDemonstration of multi- and single-reader sample size article8/28/2017Download
InstructionsDownload and installation instructions2/6/2018Download
User ManualUser manual for the power program8/28/2017Download
ExecutableExecutable JAR file5/25/2018Download
Van Dyke sample data setSample data file for use with power program8/28/2017Download

   Terms of Use   ||   Privacy Statement   ||   Copyright 2006 Medical Image Perception Laboratory