Research
Print page Print page
Switch language
The Capital Region of Denmark - a part of Copenhagen University Hospital
Published

The "RCT augmentation": a novel simulation method to add patient heterogeneity into phase III trials

Research output: Contribution to journalJournal articleResearchpeer-review

Harvard

APA

CBE

MLA

Vancouver

Author

Bibtex

@article{fd0bb6e241b34fea85a8f9f762376e7d,
title = "The {"}RCT augmentation{"}: a novel simulation method to add patient heterogeneity into phase III trials",
abstract = "BACKGROUND: Phase III randomized controlled trials (RCT) typically exclude certain patient subgroups, thereby potentially jeopardizing estimation of a drug's effects when prescribed to wider populations and under routine care ({"}effectiveness{"}). Conversely, enrolling heterogeneous populations in RCTs can increase endpoint variability and compromise detection of a drug's effect. We developed the {"}RCT augmentation{"} method to quantitatively support RCT design in the identification of exclusion criteria to relax to address both of these considerations. In the present manuscript, we describe the method and a case study in schizophrenia.METHODS: We applied typical RCT exclusion criteria in a real-world dataset (cohort) of schizophrenia patients to define the {"}RCT population{"} subgroup, and assessed the impact of re-including each of the following patient subgroups: (1) illness duration 1-3 years; (2) suicide attempt; (3) alcohol abuse; (4) substance abuse; and (5) private practice management. Predictive models were built using data from different {"}augmented RCT populations{"} (i.e., subgroups where patients with one or two of such characteristics were re-included) to estimate the absolute effectiveness of the two most prevalent antipsychotics against real-world results from the entire cohort. Concurrently, the impact on RCT results of relaxing exclusion criteria was evaluated by calculating the comparative efficacy of those two antipsychotics in virtual RCTs drawing on different {"}augmented RCT populations{"}.RESULTS: Data from the {"}RCT population{"}, which was defined with typical exclusion criteria, allowed for a prediction of effectiveness with a bias < 2{\%} and mean squared error (MSE) = 5.8-6.8{\%}. Compared to this typical RCT, RCTs using augmented populations provided improved effectiveness predictions (bias < 2{\%}, MSE = 5.3-6.7{\%}), while returning more variable comparative effects. The impact of augmentation depended on the exclusion criterion relaxed. Furthermore, half of the benefit of relaxing each criterion was gained from re-including the first 10-20{\%} of patients with the corresponding real-world characteristic.CONCLUSIONS: Simulating the inclusion of real-world subpopulations into an RCT before running it allows for quantification of the impact of each re-inclusion upon effect detection (statistical power) and generalizability of trial results, thereby explicating this trade-off and enabling a controlled increase in population heterogeneity in the RCT design.",
author = "{GetReal Consortium Work Package 2} and Helene Karcher and Shuai Fu and Jie Meng and Ankarfeldt, {Mikkel Z{\"o}llner} and Orestis Efthimiou and Mark Belger and Haro, {Josep Maria} and Lucien Abenhaim and Clementine Nordon",
year = "2018",
month = "7",
day = "6",
doi = "10.1186/s12874-018-0534-6",
language = "English",
volume = "18",
pages = "75",
journal = "BMC Medical Research Methodology",
issn = "1471-2288",
publisher = "BioMed Central Ltd",
number = "75",

}

RIS

TY - JOUR

T1 - The "RCT augmentation"

T2 - a novel simulation method to add patient heterogeneity into phase III trials

AU - GetReal Consortium Work Package 2

AU - Karcher, Helene

AU - Fu, Shuai

AU - Meng, Jie

AU - Ankarfeldt, Mikkel Zöllner

AU - Efthimiou, Orestis

AU - Belger, Mark

AU - Haro, Josep Maria

AU - Abenhaim, Lucien

AU - Nordon, Clementine

PY - 2018/7/6

Y1 - 2018/7/6

N2 - BACKGROUND: Phase III randomized controlled trials (RCT) typically exclude certain patient subgroups, thereby potentially jeopardizing estimation of a drug's effects when prescribed to wider populations and under routine care ("effectiveness"). Conversely, enrolling heterogeneous populations in RCTs can increase endpoint variability and compromise detection of a drug's effect. We developed the "RCT augmentation" method to quantitatively support RCT design in the identification of exclusion criteria to relax to address both of these considerations. In the present manuscript, we describe the method and a case study in schizophrenia.METHODS: We applied typical RCT exclusion criteria in a real-world dataset (cohort) of schizophrenia patients to define the "RCT population" subgroup, and assessed the impact of re-including each of the following patient subgroups: (1) illness duration 1-3 years; (2) suicide attempt; (3) alcohol abuse; (4) substance abuse; and (5) private practice management. Predictive models were built using data from different "augmented RCT populations" (i.e., subgroups where patients with one or two of such characteristics were re-included) to estimate the absolute effectiveness of the two most prevalent antipsychotics against real-world results from the entire cohort. Concurrently, the impact on RCT results of relaxing exclusion criteria was evaluated by calculating the comparative efficacy of those two antipsychotics in virtual RCTs drawing on different "augmented RCT populations".RESULTS: Data from the "RCT population", which was defined with typical exclusion criteria, allowed for a prediction of effectiveness with a bias < 2% and mean squared error (MSE) = 5.8-6.8%. Compared to this typical RCT, RCTs using augmented populations provided improved effectiveness predictions (bias < 2%, MSE = 5.3-6.7%), while returning more variable comparative effects. The impact of augmentation depended on the exclusion criterion relaxed. Furthermore, half of the benefit of relaxing each criterion was gained from re-including the first 10-20% of patients with the corresponding real-world characteristic.CONCLUSIONS: Simulating the inclusion of real-world subpopulations into an RCT before running it allows for quantification of the impact of each re-inclusion upon effect detection (statistical power) and generalizability of trial results, thereby explicating this trade-off and enabling a controlled increase in population heterogeneity in the RCT design.

AB - BACKGROUND: Phase III randomized controlled trials (RCT) typically exclude certain patient subgroups, thereby potentially jeopardizing estimation of a drug's effects when prescribed to wider populations and under routine care ("effectiveness"). Conversely, enrolling heterogeneous populations in RCTs can increase endpoint variability and compromise detection of a drug's effect. We developed the "RCT augmentation" method to quantitatively support RCT design in the identification of exclusion criteria to relax to address both of these considerations. In the present manuscript, we describe the method and a case study in schizophrenia.METHODS: We applied typical RCT exclusion criteria in a real-world dataset (cohort) of schizophrenia patients to define the "RCT population" subgroup, and assessed the impact of re-including each of the following patient subgroups: (1) illness duration 1-3 years; (2) suicide attempt; (3) alcohol abuse; (4) substance abuse; and (5) private practice management. Predictive models were built using data from different "augmented RCT populations" (i.e., subgroups where patients with one or two of such characteristics were re-included) to estimate the absolute effectiveness of the two most prevalent antipsychotics against real-world results from the entire cohort. Concurrently, the impact on RCT results of relaxing exclusion criteria was evaluated by calculating the comparative efficacy of those two antipsychotics in virtual RCTs drawing on different "augmented RCT populations".RESULTS: Data from the "RCT population", which was defined with typical exclusion criteria, allowed for a prediction of effectiveness with a bias < 2% and mean squared error (MSE) = 5.8-6.8%. Compared to this typical RCT, RCTs using augmented populations provided improved effectiveness predictions (bias < 2%, MSE = 5.3-6.7%), while returning more variable comparative effects. The impact of augmentation depended on the exclusion criterion relaxed. Furthermore, half of the benefit of relaxing each criterion was gained from re-including the first 10-20% of patients with the corresponding real-world characteristic.CONCLUSIONS: Simulating the inclusion of real-world subpopulations into an RCT before running it allows for quantification of the impact of each re-inclusion upon effect detection (statistical power) and generalizability of trial results, thereby explicating this trade-off and enabling a controlled increase in population heterogeneity in the RCT design.

U2 - 10.1186/s12874-018-0534-6

DO - 10.1186/s12874-018-0534-6

M3 - Journal article

VL - 18

SP - 75

JO - BMC Medical Research Methodology

JF - BMC Medical Research Methodology

SN - 1471-2288

IS - 75

ER -

ID: 54781955