The Net Benefit of a treatment should take the correlation between benefits and harms into account.

OBJECTIVE: The assessment of benefits and harms from experimental treatments often ignores the association between outcomes. In a randomized trial, generalized pairwise comparisons (GPC) can be used to assess a Net Benefit that takes this association into account. STUDY DESIGN AND SETTINGS: We use GPC to analyze a fictitious trial of treatment versus control, with a binary efficacy outcome (response) and a binary toxicity outcome, as well as data from two actual randomized trials in oncology. In all cases, we compute the Net Benefit for scenarios with different orders of priority between response and toxicity, and a range of odds ratios (ORs) for the association between these outcomes. RESULTS: The GPC Net Benefit was quite different from the benefit/harm computed using marginal treatment effects on response and toxicity. In the fictitious trial using response as first priority, treatment had an unfavorable Net Benefit if OR < 1, but favorable if OR > 1. With OR = 1, the Net Benefit was 0. Results changed drastically using toxicity as first priority. CONCLUSION: Even in a simple situation, marginal treatment effects can be misleading. In contrast, GPC assesses the Net Benefit as a function of the treatment effects on each outcome, the association between outcomes, and individual patient priorities.

A new measure of treatment effect in clinical trials involving competing risks based on generalized pairwise comparisons.

In survival analysis with competing risks, the treatment effect is typically expressed using cause-specific or subdistribution hazard ratios, both relying on proportional hazards assumptions. This paper proposes a nonparametric approach to analyze competing risks data based on generalized pairwise comparisons (GPC). GPC estimate the net benefit, defined as the probability that a patient from the treatment group has a better outcome than a patient from the control group minus the probability of the opposite situation, by comparing all pairs of patients taking one patient from each group. GPC allow using clinically relevant thresholds and simultaneously analyzing multiple prioritized endpoints. We show that under proportional subdistribution hazards, the net benefit for competing risks settings can be expressed as a decreasing function of the subdistribution hazard ratio, taking a value 0 when the latter equals 1. We propose four net benefit estimators dealing differently with censoring. Among them, the Péron estimator uses the Aalen-Johansen estimator of the cumulative incidence functions to classify the pairs for which the patient with the best outcome could not be determined due to censoring. We use simulations to study the bias of these estimators and the size and power of the tests based on the net benefit. The Péron estimator was approximately unbiased when the sample size was large and the censoring distribution's support sufficiently wide. With one endpoint, our approach showed a comparable power to a proportional subdistribution hazards model even under proportional subdistribution hazards. An application of the methodology in oncology is provided.