• Skip to content (access key 1)
  • Skip to search (access key 7)
FWF — Austrian Science Fund
  • Go to overview page Discover

    • Research Radar
      • Research Radar Archives 1974–1994
    • Discoveries
      • Emmanuelle Charpentier
      • Adrian Constantin
      • Monika Henzinger
      • Ferenc Krausz
      • Wolfgang Lutz
      • Walter Pohl
      • Christa Schleper
      • Elly Tanaka
      • Anton Zeilinger
    • Impact Stories
      • Verena Gassner
      • Wolfgang Lechner
      • Birgit Mitter
      • Oliver Spadiut
      • Georg Winter
    • scilog Magazine
    • Austrian Science Awards
      • FWF Wittgenstein Awards
      • FWF ASTRA Awards
      • FWF START Awards
      • Award Ceremony
    • excellent=austria
      • Clusters of Excellence
      • Emerging Fields
    • In the Spotlight
      • 40 Years of Erwin Schrödinger Fellowships
      • Quantum Austria
    • Dialogs and Talks
      • think.beyond Summit
    • Knowledge Transfer Events
    • E-Book Library
  • Go to overview page Funding

    • Portfolio
      • excellent=austria
        • Clusters of Excellence
        • Emerging Fields
      • Projects
        • Principal Investigator Projects
        • Principal Investigator Projects International
        • Clinical Research
        • 1000 Ideas
        • Arts-Based Research
        • FWF Wittgenstein Award
      • Careers
        • ESPRIT
        • FWF ASTRA Awards
        • Erwin Schrödinger
        • doc.funds
        • doc.funds.connect
      • Collaborations
        • Specialized Research Groups
        • Special Research Areas
        • Research Groups
        • International – Multilateral Initiatives
        • #ConnectingMinds
      • Communication
        • Top Citizen Science
        • Science Communication
        • Book Publications
        • Digital Publications
        • Open-Access Block Grant
      • Subject-Specific Funding
        • AI Mission Austria
        • Belmont Forum
        • ERA-NET HERA
        • ERA-NET NORFACE
        • ERA-NET QuantERA
        • Alternative Methods to Animal Testing
        • European Partnership BE READY
        • European Partnership Biodiversa+
        • European Partnership BrainHealth
        • European Partnership ERA4Health
        • European Partnership ERDERA
        • European Partnership EUPAHW
        • European Partnership FutureFoodS
        • European Partnership OHAMR
        • European Partnership PerMed
        • European Partnership Water4All
        • Gottfried and Vera Weiss Award
        • LUKE – Ukraine
        • netidee SCIENCE
        • Herzfelder Foundation Projects
        • Quantum Austria
        • Rückenwind Funding Bonus
        • WE&ME Award
        • Zero Emissions Award
      • International Collaborations
        • Belgium/Flanders
        • Germany
        • France
        • Italy/South Tyrol
        • Japan
        • Korea
        • Luxembourg
        • Poland
        • Switzerland
        • Slovenia
        • Taiwan
        • Tyrol-South Tyrol-Trentino
        • Czech Republic
        • Hungary
    • Step by Step
      • Find Funding
      • Submitting Your Application
      • International Peer Review
      • Funding Decisions
      • Carrying out Your Project
      • Closing Your Project
      • Further Information
        • Integrity and Ethics
        • Inclusion
        • Applying from Abroad
        • Personnel Costs
        • PROFI
        • Final Project Reports
        • Final Project Report Survey
    • FAQ
      • Project Phase PROFI
      • Project Phase Ad Personam
      • Expiring Programs
        • Elise Richter and Elise Richter PEEK
        • FWF START Awards
  • Go to overview page About Us

    • Mission Statement
    • FWF Video
    • Values
    • Facts and Figures
    • Annual Report
    • What We Do
      • Research Funding
        • Matching Funds Initiative
      • International Collaborations
      • Studies and Publications
      • Equal Opportunities and Diversity
        • Objectives and Principles
        • Measures
        • Creating Awareness of Bias in the Review Process
        • Terms and Definitions
        • Your Career in Cutting-Edge Research
      • Open Science
        • Open-Access Policy
          • Open-Access Policy for Peer-Reviewed Publications
          • Open-Access Policy for Peer-Reviewed Book Publications
          • Open-Access Policy for Research Data
        • Research Data Management
        • Citizen Science
        • Open Science Infrastructures
        • Open Science Funding
      • Evaluations and Quality Assurance
      • Academic Integrity
      • Science Communication
      • Philanthropy
      • Sustainability
    • History
    • Legal Basis
    • Organization
      • Executive Bodies
        • Executive Board
        • Supervisory Board
        • Assembly of Delegates
        • Scientific Board
        • Juries
      • FWF Office
    • Jobs at FWF
  • Go to overview page News

    • News
    • Press
      • Logos
    • Calendar
      • Post an Event
      • FWF Informational Events
    • Job Openings
      • Enter Job Opening
    • Newsletter
  • Discovering
    what
    matters.

    FWF-Newsletter Press-Newsletter Calendar-Newsletter Job-Newsletter scilog-Newsletter

    SOCIAL MEDIA

    • LinkedIn, external URL, opens in a new window
    • , external URL, opens in a new window
    • Facebook, external URL, opens in a new window
    • Instagram, external URL, opens in a new window
    • YouTube, external URL, opens in a new window

    SCILOG

    • Scilog — The science magazine of the Austrian Science Fund (FWF)
  • elane login, external URL, opens in a new window
  • Scilog external URL, opens in a new window
  • de Wechsle zu Deutsch

  

Hypothesis Testing and Estimation in Adaptive Designs with Blinded and Unblinded Interim Analysis

Hypothesis Testing and Estimation in Adaptive Designs with Blinded and Unblinded Interim Analysis

Martin Posch (ORCID: 0000-0001-8499-8573)
  • Grant DOI 10.55776/P23167
  • Funding program Principal Investigator Projects
  • Status ended
  • Start November 1, 2010
  • End October 31, 2015
  • Funding amount € 293,044

Disciplines

Other Human Medicine, Health Sciences (60%); Computer Sciences (20%); Mathematics (20%)

Keywords

    Interim Analysis, Clinical Trials, Adaptive Designs, Sample Size Reassessment, Multiple Testing, Treatment Selection

Abstract Final report

The design of clinical trials requires to make assumptions on numerous parameters that may have an impact on the chance of success. Examples are the variability of outcomes, the effect sizes and safety profiles of investigated treatments, or the influence of covariates. Often, little information on these parameters is available a-priori and it is difficult to obtain reliable estimates. Clinical trial designs that allow to estimate these unknown parameters from interim data and to adapt the remainder of the trial accordingly, have, therefore, raised increasing interest in recent years. A wide range of adaptations, including sample size reassessment, and selection of treatments and subgroups, has been considered so far. For the application of adaptive designs in confirmative clinical trials, preservation of the integrity of the trial is pivotal. Of special concern is the control of the type I error rate and the impact of adaptations on effect estimates. An essential tool to maintain the integrity of controlled randomized clinical trials is blinding: if the treatment allocations of individual patients remain unknown to patients and investigators, potential biases, as, e.g., a biased evaluation of endpoints, can be avoided. Trial adaptations based on blinded interim data (i.e., without revealing the individual treatment allocations) are, therefore, perceived to have much less impact on the integrity of a trial, compared to unblinded interim analyses. Blinded interim analyses prohibit a direct estimation of treatment effects. Nuisance parameters like the variability of endpoints or overall event rates, however, can be easily estimated and can be used as basis for sample size reassessment. The project has two main goals. On the one hand, we will investigate to what extent the common perception, that adaptations based on blinded data reviews have only marginal impact on the properties of standard single stage testing and estimation procedures, is justified. We want to extend previous research on blinded sample size reassessment to a wider range of clinical trial settings. This will include multiarmed trials and trials with several endpoints. Furthermore, we will consider unrestricted adaptation rules based on blinded data to assess their potential impact on statistical inference procedures that do not explicitly account for the adaptations. Besides adaptive clinical trials, we will investigate trials where the choice of the analysis strategy is based on a blinded review of the data. The second major goal of the project is to develop novel testing procedures and confidence intervals that strictly control the type I error rate and coverage probability, respectively. In a first step we will consider adaptive designs with unblinded interim analysis. Such tests are equally applicable to designs with blinded interim analysis. We will improve these tests for the special setting where the adaptations are based only on blinded data and derive corresponding confidence intervals. In a second step we will extend on our previous work on single stage multiple testing procedures based on weighted directed graphs and generalize it to adaptive multiple tests controlling the family-wise error rate. This methodology allows to derive adaptive gatekeeping procedures that have applications in clinical trials with multiple treatment arms, subgroups and/or endpoints where, e.g., treatment groups are selected at interim. Additionally, we plan to derive simultaneous confidence intervals corresponding to the investigated adaptive multiple testing procedures.

In traditional clinical trials with the objective to demonstrate efficacy of new therapies, patients are often recruited for several years but the results are analysed only at the end. Adaptive trial designs in contrast, allow one to perform interim analyses and to adapt the remainder of the trial accordingly. For example, the number of patients included in a trial can be adapted or treatment arms with apparently little or no treatment effect can be dropped. An important field of application is also the development of personalized therapies. Here, by a modification of the inclusion criteria, adaptive designs allow one to exclude groups of patients from a clinical trial that apparently do not benefit from a therapy. For the application of adaptive designs in confirmative clinical trials, the preservation of the integrity of the trial is pivotal. Of special concern is the control of the false positive rate of statistical hypotheses tests and the impact of adaptations on the unbiasedness of effect estimates. In the first part of this project we assessed the robustness of adaptive designs and explored scenarios where things can go wrong, leading to biased results and unfounded claims of treatment effects. We investigated to what extent the common perception that adaptations based on blinded data reviews, where the individual treatment assignments are not revealed, have only marginal impact on the properties of standard single stage testing and estimation procedures, is indeed justified. Especially, we gave examples where blinded adaptations may lead to substantially biased results and derived conditions when adaptations based on blinded interim data have no negative influence on the validity of the statistical analysis. In a second step, we developed novel, robust analysis methods for adaptive clinical trial designs with blinded and unblinded interim analyses that allow for a valid interpretation of study results in spite of data dependent trial adaptations. We especially focused on clinical trials with multiple objectives, where several treatment arms or patient populations are investigated. Another emphasis was clinical trials in oncology, where the survival times of patients are analysed. The project results extend the possibilities for designing, analysing and assessing adaptive clinical trials and have a high importance for their efficient implementation for the authorisation of new therapies by regulatory authorities.

Research institution(s)
  • Medizinische Universität Wien - 100%
International project participants
  • Tim Friede, Georg-August-Universität Göttingen - Germany
  • Werner Brannath, Universität Bremen - Germany
  • Cyrus Mehta, Harvard University - USA

Research Output

  • 447 Citations
  • 21 Publications
Publications
  • 2018
    Title Flexible alpha allocation strategies for confirmatory adaptive enrichment clinical trials with a prespecified subgroup
    DOI 10.1002/sim.7851
    Type Journal Article
    Author Sugitani T
    Journal Statistics in Medicine
    Pages 3387-3402
  • 2012
    Title Unplanned adaptations before breaking the blind
    DOI 10.1002/sim.5361
    Type Journal Article
    Author Posch M
    Journal Statistics in Medicine
    Pages 4146-4153
    Link Publication
  • 2012
    Title Weighted parametric tests defined by graphs [Internet].
    Type Journal Article
    Author Klinglmueller F
    Journal The Comprehensive R Archive Network (CRAN).
  • 2011
    Title Maximum inflation of the type 1 error rate when sample size and allocation rate are adapted in a pre-planned interim look
    DOI 10.1002/sim.4230
    Type Journal Article
    Author Graf A
    Journal Statistics in Medicine
    Pages 1637-1647
    Link Publication
  • 2011
    Title Graphical approaches for multiple comparison procedures using weighted Bonferroni, Simes, or parametric tests
    DOI 10.1002/bimj.201000239
    Type Journal Article
    Author Bretz F
    Journal Biometrical Journal
    Pages 894-913
    Link Publication
  • 2011
    Title Cross-platform comparison of microarray data using order restricted inference
    DOI 10.1093/bioinformatics/btr066
    Type Journal Article
    Author Klinglmueller F
    Journal Bioinformatics
    Pages 953-960
    Link Publication
  • 2013
    Title Simultaneous confidence intervals that are compatible with closed testing in adaptive designs
    DOI 10.1093/biomet/ast035
    Type Journal Article
    Author Magirr D
    Journal Biometrika
    Pages 985-996
    Link Publication
  • 2015
    Title Optimized Response-Adaptive Clinical Trials, Sequential Treatment Allocation Based on Markov Decision Problems
    DOI 10.1007/978-3-658-08344-1
    Type Book
    Author Ondra T
    Publisher Springer Nature
  • 2015
    Title Generalizing boundaries for triangular designs, and efficacy estimation at extended follow-ups
    DOI 10.1186/s13063-015-1018-1
    Type Journal Article
    Author Allison A
    Journal Trials
    Pages 522
    Link Publication
  • 2015
    Title Maximum type I error rate inflation from sample size reassessment when investigators are blind to treatment labels
    DOI 10.1002/sim.6848
    Type Journal Article
    Author Zebrowska M
    Journal Statistics in Medicine
    Pages 1972-1984
    Link Publication
  • 2016
    Title Sample Size Reassessment and Hypothesis Testing in Adaptive Survival Trials
    DOI 10.1371/journal.pone.0146465
    Type Journal Article
    Author Magirr D
    Journal PLOS ONE
    Link Publication
  • 2013
    Title Author's reply
    DOI 10.1002/bimj.201200256
    Type Journal Article
    Author Bretz F
    Journal Biometrical Journal
    Pages 266-266
    Link Publication
  • 2013
    Title Adaptive Budgets in Clinical Trials
    DOI 10.1080/19466315.2013.783504
    Type Journal Article
    Author Posch M
    Journal Statistics in Biopharmaceutical Research
    Pages 282-292
    Link Publication
  • 2012
    Title GMCP - an r package for a graphical approach to weighted multiple test procedures [Internet].
    Type Journal Article
    Author Rohmeyer K
    Journal The Comprehensive R Archive Network (CRAN).
  • 2012
    Title False discovery rate control in two-stage designs
    DOI 10.1186/1471-2105-13-81
    Type Journal Article
    Author Zehetmayer S
    Journal BMC Bioinformatics
    Pages 81
    Link Publication
  • 2014
    Title Connections between permutation and t-tests: relevance to adaptive methods
    DOI 10.1002/sim.6288
    Type Journal Article
    Author Proschan M
    Journal Statistics in Medicine
    Pages 4734-4742
    Link Publication
  • 2014
    Title A simple and flexible graphical approach for adaptive group-sequential clinical trials
    DOI 10.1080/10543406.2014.972509
    Type Journal Article
    Author Sugitani T
    Journal Journal of Biopharmaceutical Statistics
    Pages 202-216
    Link Publication
  • 2014
    Title Adaptive clinical trial designs for European marketing authorization: a survey of scientific advice letters from the European Medicines Agency
    DOI 10.1186/1745-6215-15-383
    Type Journal Article
    Author Elsäßer A
    Journal Trials
    Pages 383
    Link Publication
  • 2014
    Title Adaptive graph-based multiple testing procedures
    DOI 10.1002/pst.1640
    Type Journal Article
    Author Klinglmueller F
    Journal Pharmaceutical Statistics
    Pages 345-356
    Link Publication
  • 2016
    Title Estimation after blinded sample size reassessment
    DOI 10.1177/0962280216670424
    Type Journal Article
    Author Posch M
    Journal Statistical Methods in Medical Research
    Pages 1830-1846
    Link Publication
  • 2015
    Title Sample size reassessment for a two-stage design controlling the false discovery rate
    DOI 10.1515/sagmb-2014-0025
    Type Journal Article
    Author Zehetmayer S
    Journal Statistical Applications in Genetics and Molecular Biology
    Pages 429-442
    Link Publication

Discovering
what
matters.

Newsletter

FWF-Newsletter Press-Newsletter Calendar-Newsletter Job-Newsletter scilog-Newsletter

Contact

Austrian Science Fund (FWF)
Georg-Coch-Platz 2
(Entrance Wiesingerstraße 4)
1010 Vienna

office(at)fwf.ac.at
+43 1 505 67 40

General information

  • Job Openings
  • Jobs at FWF
  • Press
  • Philanthropy
  • scilog
  • FWF Office
  • Social Media Directory
  • LinkedIn, external URL, opens in a new window
  • , external URL, opens in a new window
  • Facebook, external URL, opens in a new window
  • Instagram, external URL, opens in a new window
  • YouTube, external URL, opens in a new window
  • Cookies
  • Whistleblowing/Complaints Management
  • Accessibility Statement
  • Data Protection
  • Acknowledgements
  • IFG-Form
  • Social Media Directory
  • © Österreichischer Wissenschaftsfonds FWF
© Österreichischer Wissenschaftsfonds FWF