SCORE Study Report 8: Closed tests for all pairwise comparisons of means

Neal Oden, Paul C. VanVeldhuisen, Ingrid U. Scott, Michael S. Ip

Research output: Contribution to journalReview articlepeer-review

4 Scopus citations


We compare five closed tests for strong control of family-wide type I error while making all pairwise comparisons of means in clinical trials with multiple arms such as the SCORE Study. We simulated outcomes of the SCORE Study under its design hypotheses, and used P values from chi-squared tests to compare performance of a pairwise closed test described below to Bonferroni and Hochberg adjusted P values. Pairwise closed testing was more powerful than Hochberg's method by several definitions of multiple-test power. Simulations over a wider parameter space, and considering other closed methods, confirmed this superiority for P values based on normal, logistic, and Poisson distributions. The power benefit of pairwise closed testing begins to disappear with five or more arms and with unbalanced designs. For trials with four or fewer arms and balanced designs, investigators should consider using pairwise closed testing in preference to Shaffer's, Hommel's, and Hochberg's approaches when making all pairwise comparisons of means. If not all P values from the closed family are available, Shaffer's method is a good choice.

Original languageEnglish (US)
Pages (from-to)405-420
Number of pages16
JournalDrug Information Journal
Issue number4
StatePublished - Jul 2010

All Science Journal Classification (ASJC) codes

  • Pharmacology (nursing)
  • Drug guides
  • Public Health, Environmental and Occupational Health
  • Pharmacology (medical)


Dive into the research topics of 'SCORE Study Report 8: Closed tests for all pairwise comparisons of means'. Together they form a unique fingerprint.

Cite this