Hypothesis Testing and Estimation in Adaptive Designs with Blinded and Unblinded Interim Analysis
Hypothesis Testing and Estimation in Adaptive Designs with Blinded and Unblinded Interim Analysis
Disciplines
Other Human Medicine, Health Sciences (60%); Computer Sciences (20%); Mathematics (20%)
Keywords
-
Interim Analysis,
Clinical Trials,
Adaptive Designs,
Sample Size Reassessment,
Multiple Testing,
Treatment Selection
The design of clinical trials requires to make assumptions on numerous parameters that may have an impact on the chance of success. Examples are the variability of outcomes, the effect sizes and safety profiles of investigated treatments, or the influence of covariates. Often, little information on these parameters is available a-priori and it is difficult to obtain reliable estimates. Clinical trial designs that allow to estimate these unknown parameters from interim data and to adapt the remainder of the trial accordingly, have, therefore, raised increasing interest in recent years. A wide range of adaptations, including sample size reassessment, and selection of treatments and subgroups, has been considered so far. For the application of adaptive designs in confirmative clinical trials, preservation of the integrity of the trial is pivotal. Of special concern is the control of the type I error rate and the impact of adaptations on effect estimates. An essential tool to maintain the integrity of controlled randomized clinical trials is blinding: if the treatment allocations of individual patients remain unknown to patients and investigators, potential biases, as, e.g., a biased evaluation of endpoints, can be avoided. Trial adaptations based on blinded interim data (i.e., without revealing the individual treatment allocations) are, therefore, perceived to have much less impact on the integrity of a trial, compared to unblinded interim analyses. Blinded interim analyses prohibit a direct estimation of treatment effects. Nuisance parameters like the variability of endpoints or overall event rates, however, can be easily estimated and can be used as basis for sample size reassessment. The project has two main goals. On the one hand, we will investigate to what extent the common perception, that adaptations based on blinded data reviews have only marginal impact on the properties of standard single stage testing and estimation procedures, is justified. We want to extend previous research on blinded sample size reassessment to a wider range of clinical trial settings. This will include multiarmed trials and trials with several endpoints. Furthermore, we will consider unrestricted adaptation rules based on blinded data to assess their potential impact on statistical inference procedures that do not explicitly account for the adaptations. Besides adaptive clinical trials, we will investigate trials where the choice of the analysis strategy is based on a blinded review of the data. The second major goal of the project is to develop novel testing procedures and confidence intervals that strictly control the type I error rate and coverage probability, respectively. In a first step we will consider adaptive designs with unblinded interim analysis. Such tests are equally applicable to designs with blinded interim analysis. We will improve these tests for the special setting where the adaptations are based only on blinded data and derive corresponding confidence intervals. In a second step we will extend on our previous work on single stage multiple testing procedures based on weighted directed graphs and generalize it to adaptive multiple tests controlling the family-wise error rate. This methodology allows to derive adaptive gatekeeping procedures that have applications in clinical trials with multiple treatment arms, subgroups and/or endpoints where, e.g., treatment groups are selected at interim. Additionally, we plan to derive simultaneous confidence intervals corresponding to the investigated adaptive multiple testing procedures.
In traditional clinical trials with the objective to demonstrate efficacy of new therapies, patients are often recruited for several years but the results are analysed only at the end. Adaptive trial designs in contrast, allow one to perform interim analyses and to adapt the remainder of the trial accordingly. For example, the number of patients included in a trial can be adapted or treatment arms with apparently little or no treatment effect can be dropped. An important field of application is also the development of personalized therapies. Here, by a modification of the inclusion criteria, adaptive designs allow one to exclude groups of patients from a clinical trial that apparently do not benefit from a therapy. For the application of adaptive designs in confirmative clinical trials, the preservation of the integrity of the trial is pivotal. Of special concern is the control of the false positive rate of statistical hypotheses tests and the impact of adaptations on the unbiasedness of effect estimates. In the first part of this project we assessed the robustness of adaptive designs and explored scenarios where things can go wrong, leading to biased results and unfounded claims of treatment effects. We investigated to what extent the common perception that adaptations based on blinded data reviews, where the individual treatment assignments are not revealed, have only marginal impact on the properties of standard single stage testing and estimation procedures, is indeed justified. Especially, we gave examples where blinded adaptations may lead to substantially biased results and derived conditions when adaptations based on blinded interim data have no negative influence on the validity of the statistical analysis. In a second step, we developed novel, robust analysis methods for adaptive clinical trial designs with blinded and unblinded interim analyses that allow for a valid interpretation of study results in spite of data dependent trial adaptations. We especially focused on clinical trials with multiple objectives, where several treatment arms or patient populations are investigated. Another emphasis was clinical trials in oncology, where the survival times of patients are analysed. The project results extend the possibilities for designing, analysing and assessing adaptive clinical trials and have a high importance for their efficient implementation for the authorisation of new therapies by regulatory authorities.
- Tim Friede, Georg-August-Universität Göttingen - Germany
- Werner Brannath, Universität Bremen - Germany
- Cyrus Mehta, Harvard University - USA
Research Output
- 447 Citations
- 21 Publications
-
2018
Title Flexible alpha allocation strategies for confirmatory adaptive enrichment clinical trials with a prespecified subgroup DOI 10.1002/sim.7851 Type Journal Article Author Sugitani T Journal Statistics in Medicine Pages 3387-3402 -
2012
Title Unplanned adaptations before breaking the blind DOI 10.1002/sim.5361 Type Journal Article Author Posch M Journal Statistics in Medicine Pages 4146-4153 Link Publication -
2012
Title Weighted parametric tests defined by graphs [Internet]. Type Journal Article Author Klinglmueller F Journal The Comprehensive R Archive Network (CRAN). -
2011
Title Maximum inflation of the type 1 error rate when sample size and allocation rate are adapted in a pre-planned interim look DOI 10.1002/sim.4230 Type Journal Article Author Graf A Journal Statistics in Medicine Pages 1637-1647 Link Publication -
2011
Title Graphical approaches for multiple comparison procedures using weighted Bonferroni, Simes, or parametric tests DOI 10.1002/bimj.201000239 Type Journal Article Author Bretz F Journal Biometrical Journal Pages 894-913 Link Publication -
2011
Title Cross-platform comparison of microarray data using order restricted inference DOI 10.1093/bioinformatics/btr066 Type Journal Article Author Klinglmueller F Journal Bioinformatics Pages 953-960 Link Publication -
2013
Title Simultaneous confidence intervals that are compatible with closed testing in adaptive designs DOI 10.1093/biomet/ast035 Type Journal Article Author Magirr D Journal Biometrika Pages 985-996 Link Publication -
2015
Title Optimized Response-Adaptive Clinical Trials, Sequential Treatment Allocation Based on Markov Decision Problems DOI 10.1007/978-3-658-08344-1 Type Book Author Ondra T Publisher Springer Nature -
2015
Title Generalizing boundaries for triangular designs, and efficacy estimation at extended follow-ups DOI 10.1186/s13063-015-1018-1 Type Journal Article Author Allison A Journal Trials Pages 522 Link Publication -
2015
Title Maximum type I error rate inflation from sample size reassessment when investigators are blind to treatment labels DOI 10.1002/sim.6848 Type Journal Article Author Zebrowska M Journal Statistics in Medicine Pages 1972-1984 Link Publication -
2016
Title Sample Size Reassessment and Hypothesis Testing in Adaptive Survival Trials DOI 10.1371/journal.pone.0146465 Type Journal Article Author Magirr D Journal PLOS ONE Link Publication -
2013
Title Author's reply DOI 10.1002/bimj.201200256 Type Journal Article Author Bretz F Journal Biometrical Journal Pages 266-266 Link Publication -
2013
Title Adaptive Budgets in Clinical Trials DOI 10.1080/19466315.2013.783504 Type Journal Article Author Posch M Journal Statistics in Biopharmaceutical Research Pages 282-292 Link Publication -
2012
Title GMCP - an r package for a graphical approach to weighted multiple test procedures [Internet]. Type Journal Article Author Rohmeyer K Journal The Comprehensive R Archive Network (CRAN). -
2012
Title False discovery rate control in two-stage designs DOI 10.1186/1471-2105-13-81 Type Journal Article Author Zehetmayer S Journal BMC Bioinformatics Pages 81 Link Publication -
2014
Title Connections between permutation and t-tests: relevance to adaptive methods DOI 10.1002/sim.6288 Type Journal Article Author Proschan M Journal Statistics in Medicine Pages 4734-4742 Link Publication -
2014
Title A simple and flexible graphical approach for adaptive group-sequential clinical trials DOI 10.1080/10543406.2014.972509 Type Journal Article Author Sugitani T Journal Journal of Biopharmaceutical Statistics Pages 202-216 Link Publication -
2014
Title Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency DOI 10.1186/1745-6215-15-383 Type Journal Article Author Elsäßer A Journal Trials Pages 383 Link Publication -
2014
Title Adaptive graph-based multiple testing procedures DOI 10.1002/pst.1640 Type Journal Article Author Klinglmueller F Journal Pharmaceutical Statistics Pages 345-356 Link Publication -
2016
Title Estimation after blinded sample size reassessment DOI 10.1177/0962280216670424 Type Journal Article Author Posch M Journal Statistical Methods in Medical Research Pages 1830-1846 Link Publication -
2015
Title Sample size reassessment for a two-stage design controlling the false discovery rate DOI 10.1515/sagmb-2014-0025 Type Journal Article Author Zehetmayer S Journal Statistical Applications in Genetics and Molecular Biology Pages 429-442 Link Publication