A Comparison of Methods to Control Type I Errors in Microarray Studies

Jinsong Chen, Lawrence Berkeley National Laboratory
Mark J. van der Laan, University of California, Berkeley
Martyn T. Smith, University of California, Berkeley
Alan E. Hubbard, University of California, Berkeley

Abstract

Microarray studies often need to simultaneously examine thousands of genes to determine which are differentially expressed. One main challenge in those studies is to find suitable multiple testing procedures that provide accurate control of the error rates of interest and meanwhile are most powerful, that is, they return the longest list of truly interesting genes among competitors. Many multiple testing methods have been developed recently for microarray data analysis, especially resampling based methods, such as permutation methods, the null-centered and scaled bootstrap (NCSB) method, and the quantile-transformed-bootstrap-distribution (QTBD) method. Each of these methods has its own merits and limitations. Theoretically permutation methods can fail to provide accurate control of Type I errors when the so-called subset pivotality condition is violated. The NCSB method does not suffer from that limitation, but an impractical number of bootstrap samples are often needed to get proper control of Type I errors. The newly developed QTBD method has the virtues of providing accurate control of Type I errors under few restrictions. However, the relative practical performance of the above three types of multiple testing methods remains unresolved. This paper compares the above three resampling based methods according to the control of family wise error rates (FWER) through data simulations. Results show that among the three resampling based methods, the QTBD method provides relatively accurate and powerful control in more general circumstances.

Submitted: June 8, 2007 · Accepted: September 2, 2007 · Published: October 11, 2007

Recommended Citation

Chen, Jinsong; van der Laan, Mark J.; Smith, Martyn T.; and Hubbard, Alan E. (2007) "A Comparison of Methods to Control Type I Errors in Microarray Studies," Statistical Applications in Genetics and Molecular Biology: Vol. 6 : Iss. 1, Article 28.
Available at: http://www.bepress.com/sagmb/vol6/iss1/art28

 
 
 
 

ISSN: 1544-6115 ©1999-2008 The Berkeley Electronic Press™ All rights reserved.

To submit, subscribe, recommend this journal to your library, or sign up for email alerts, please visit: http://www.bepress.com/sagmb