On the Structure of Multiple Testing Procedures
The full text of this version of the working paper is not currently available online.
Abstract:
The field of "multiple hypothesis testing" has traditionally focused on defining and estimating various error measures based on the p-values individually obtained from each test. In this paper we discuss common structure present in typical multiple testing procedures. We introduce "single thresholding procedures" (STPs), a large class of multiple testing procedures encompassing the majority of those used in practice. We propose new concepts of significance for STPs, eliminating the intermediate step of calculating p-values for each test individually. With these developments, it is straightforward to consider the optimality of STPs and show that many complicated procedures actually reduce to a STP. As a specific example, we show that single-stage multiple hypothesis testing procedures are optimal over their corresponding multiple-stage procedures, an open question of much interest in the genomics field.
Subject Area:
General Biostatistics, Multivariate Analysis, Statistical Theory and Methods
Suggested Citation:
Jeffrey Leek and John D. Storey, "On the Structure of Multiple Testing Procedures" (September 19, 2006). UW Biostatistics Working Paper Series. Working Paper 294.
http://www.bepress.com/uwbiostat/paper294