Automated Item Generation: impact of item variants on performance and standard setting.

BACKGROUND: Automated Item Generation (AIG) uses computer software to create multiple items from a single question model. There is currently a lack of data looking at whether item variants to a single question result in differences in student performance or human-derived standard setting. The purpose of this study was to use 50 Multiple Choice Questions (MCQs) as models to create four distinct tests which would be standard set and given to final year UK medical students, and then to compare the performance and standard setting data for each. METHODS: Pre-existing questions from the UK Medical Schools Council (MSC) Assessment Alliance item bank, created using traditional item writing techniques, were used to generate four 'isomorphic' 50-item MCQ tests using AIG software. Isomorphic questions use the same question template with minor alterations to test the same learning outcome. All UK medical schools were invited to deliver one of the four papers as an online formative assessment for their final year students. Each test was standard set using a modified Angoff method. Thematic analysis was conducted for item variants with high and low levels of variance in facility (for student performance) and average scores (for standard setting). RESULTS: Two thousand two hundred eighteen students from 12 UK medical schools participated, with each school using one of the four papers. The average facility of the four papers ranged from 0.55-0.61, and the cut score ranged from 0.58-0.61. Twenty item models had a facility difference > 0.15 and 10 item models had a difference in standard setting of > 0.1. Variation in parameters that could alter clinical reasoning strategies had the greatest impact on item facility. CONCLUSIONS: Item facility varied to a greater extent than the standard set. This difference may relate to variants causing greater disruption of clinical reasoning strategies in novice learners compared to experts, but is confounded by the possibility that the performance differences may be explained at school level and therefore warrants further study.

Direct Measurement of Hexacontatetrapole, E6 γ Decay from

The only proposed observation of a discrete, hexacontatetrapole (E6) transition in nature occurs from the T_{1/2}=2.54(2)-min decay of ^{53m}Fe. However, there are conflicting claims concerning its γ-decay branching ratio, and a rigorous interrogation of γ-ray sum contributions is lacking. Experiments performed at the Australian Heavy Ion Accelerator Facility were used to study the decay of ^{53m}Fe. For the first time, sum-coincidence contributions to the weak E6 and M5 decay branches have been firmly quantified using complementary experimental and computational methods. Agreement across the different approaches confirms the existence of the real E6 transition; the M5 branching ratio and transition rate have also been revised. Shell model calculations performed in the full fp model space suggest that the effective proton charge for high-multipole, E4 and E6, transitions is quenched to approximately two-thirds of the collective E2 value. Correlations between nucleons may offer an explanation of this unexpected phenomenon, which is in stark contrast to the collective nature of lower-multipole, electric transitions observed in atomic nuclei.

The influence of candidates' physical attributes on patient ratings in simulated assessments of clinical practice.

BACKGROUND: We have previously shown that clinical examiners' scoring is not negatively impacted when a candidate has a tattoo, unnatural hair colour, or a regional accent. We investigated whether these physical attributes in exam candidates impact patient scoring. METHODS: Simulated/real patients were randomly assigned to watch five videos of simulated candidate performances of a cranial nerve examination: clear fail, borderline, good, 'clear pass' without an attribute, and 'clear pass' with one of the attributes (tattoo, purple hair, accent). Participants scored domains of communication and professionalism. We compared scores for the clear pass candidates with and without attributes. RESULTS: One hundred and eighty three patients participated. The total scores for the candidates with tattoos and purple hair were higher than the candidate with no physical attribute (p < 0.001). For the candidate with a Liverpool English accent no difference was identified (p = 0.120). CONCLUSIONS: The presence of certain physical attributes (tattoos or purple hair) was associated with higher scores given by patients to candidates in a simulated physical examination station.

Bridging the age gap in breast cancer: impact of omission of breast cancer surgery in older women with oestrogen receptor-positive early breast cancer on quality-of-life outcomes.

BACKGROUND: Primary endocrine therapy may be an alternative treatment for less fit women with oestrogen receptor (ER)-positive breast cancer. This study compared quality-of-life (QoL) outcomes in older women treated with surgery or primary endocrine therapy. METHODS: This was a multicentre, prospective, observational cohort study of surgery or primary endocrine therapy in women aged over 70 years with operable breast cancer. QoL was assessed using European Organisation for Research and Treatment of cancer QoL questionnaires QLQ-C30, -BR23, and -ELD14, and the EuroQol Five Dimensions 5L score at baseline, 6 weeks, and 6, 12, 18, and 24 months. Propensity score matching was used to adjust for baseline variation in health, fitness, and tumour stage. RESULTS: The study recruited 3416 women (median age 77 (range 69-102) years) from 56 breast units. Of these, 2979 (87.2 per cent) had ER-positive breast cancer; 2354 women had surgery and 500 received primary endocrine therapy (125 were excluded from analysis due to inadequate data or non-standard therapy). Median follow-up was 52 months. The primary endocrine therapy group was older and less fit. Baseline QoL differed between the groups; the mean(s.d.) QLQ-C30 global health status score was 66.2(21.1) in patients who received primary endocrine therapy versus 77.1(17.8) among those who had surgery plus endocrine therapy. In the unmatched analysis, changes in QoL between 6 weeks and baseline were noted in several domains, but by 24 months most scores had returned to baseline levels. In the matched analysis, major surgery (mastectomy or axillary clearance) had a more pronounced adverse impact than primary endocrine therapy in several domains. CONCLUSION: Adverse effects on QoL are seen in the first few months after surgery, but by 24 months these have largely resolved. Women considering surgery should be informed of these effects.

Bridging the age gap in breast cancer: cluster randomized trial of two decision support interventions for older women with operable breast cancer on quality of life, survival, decision quality, and treatment choices.

BACKGROUND: Rates of surgery and adjuvant therapy for breast cancer vary widely between breast units. This may contribute to differences in survival. This cluster RCT evaluated the impact of decision support interventions (DESIs) for older women with breast cancer, to ascertain whether DESIs influenced quality of life, survival, decision quality, and treatment choice. METHODS: A multicentre cluster RCT compared the use of two DESIs against usual care in treatment decision-making in older women (aged at least ≥70 years) with breast cancer. Each DESI comprised an online algorithm, booklet, and brief decision aid to inform choices between surgery plus adjuvant endocrine therapy versus primary endocrine therapy, and adjuvant chemotherapy versus no chemotherapy. The primary outcome was quality of life. Secondary outcomes included decision quality measures, survival, and treatment choice. RESULTS: A total of 46 breast units were randomized (21 intervention, 25 usual care), recruiting 1339 women (670 intervention, 669 usual care). There was no significant difference in global quality of life at 6 months after the baseline assessment on intention-to-treat analysis (difference -0.20, 95 per cent confidence interval (C.I.) -2.69 to 2.29; P = 0.900). In women offered a choice of primary endocrine therapy versus surgery plus endocrine therapy, knowledge about treatments was greater in the intervention arm (94 versus 74 per cent; P = 0.003). Treatment choice was altered, with a primary endocrine therapy rate among women with oestrogen receptor-positive disease of 21.0 per cent in the intervention versus 15.4 per cent in usual-care sites (difference 5.5 (95 per cent C.I. 1.1 to 10.0) per cent; P = 0.029). The chemotherapy rate was 10.3 per cent at intervention versus 14.8 per cent at usual-care sites (difference -4.5 (C.I. -8.0 to 0) per cent; P = 0.013). Survival was similar in both arms. CONCLUSION: The use of DESIs in older women increases knowledge of breast cancer treatment options, facilitates shared decision-making, and alters treatment selection. Trial registration numbers: EudraCT 2015-004220-61 (https://eudract.ema.europa.eu/), ISRCTN46099296 (http://www.controlled-trials.com).

The influence of candidates' physical attributes on assessors' ratings in clinical practice.

BACKGROUND: Assessments of physician competence in the work-place are common and often contribute to high-stakes assessments. Previous research suggests that assessors' judgements can be influenced by candidates' physical attributes. We investigated whether simulated candidates' scores were influenced by assessor bias based on tattoos, hair colour, and a regional accent. METHODS: We used an experimental, video-based, single-blinded, randomised, internet-based design. We created videos of simulated medical intern performances of a clinical examination at four different standards of competence. Four videos were also created of simulated candidates performing at a 'clear pass' standard, with either no stereotypical attribute (CPX), purple hair (CPH), tattoos (CPT) or a Liverpool English accent (CPA). Assessors were randomly assigned to watch five videos including the "clear pass" candidate without an attribute and one of the "clear pass" candidates with an attribute and asked to give an overall global grade for each candidate. We compared the global grades for the clear pass candidates with and without attributes. RESULTS: Ninety-eight assessors were included in the analysis. The total scores for the candidates with stereotyped attributes were not significantly lower than the candidate with no attribute. Assessors showed moderate levels of agreement between the global grades awarded for all the candidates. The global grades awarded to candidate with a stereotypical attribute were not significantly lower than for those without. CONCLUSIONS: The presence of tattoos, purple hair, or a regional accent did not systematically negatively influence the grade or score awarded by assessors to candidates in observed clinical examination scenarios.

Bridging the Age Gap: a prognostic model that predicts survival and aids in primary treatment decisions for older women with oestrogen receptor-positive early breast cancer.

BACKGROUND: A prognostic model was developed and validated using cancer registry data. This underpins an online decision support tool, informing primary treatment choice for women aged 70 years or older with hormone receptor-positive early breast cancer. METHODS: Data from women diagnosed between 2002 and 2010 in the English Northern and Yorkshire and West Midlands regions were used to develop the model. Primary treatment options of surgery with adjuvant endocrine therapy or primary endocrine therapy were compared. Models predicting the hazard of breast cancer-specific mortality and hazard of other-cause mortality were combined to derive survival probabilities. The model was validated externally using data from the Eastern Cancer Registration and Information Centre. RESULTS: The model was developed using data from 23 842 women, and validated externally on a data set from 14 526 patients. The overall model calibration was good. At 2 and 5 years, predicted mortality from breast cancer and other causes differed from the observed rate by less than 1 per cent. At 5 years, there were slight overpredictions in breast cancer mortality (2629 predicted versus 2556 observed deaths; P = 0·142) and mortality from all causes (6399 versus 6320 respectively; P = 0·583). The discrepancy varied between subgroups. Model discrimination was 0·75 or above for all mortality measures. CONCLUSION: A prognostic model for older women with oestrogen receptor-positive early breast cancer was developed and validated in the present study. This forms a basis for an online decision support tool (https://agegap.shef.ac.uk/).

ANTECEDENTES: Se ha desarrollado y validado un modelo pronóstico utilizando datos del registro de cáncer. Ello ha permitido ofrecer una herramienta online para facilitar la toma de decisiones respecto a la elección del tratamiento inicial en mujeres mayores de 70 años con cáncer de mama precoz y receptores de hormonas positivos. MÉTODOS: Se incluyeron un total de 23.842 mujeres, diagnosticadas entre 2002 y 2010 en las regiones del Norte, Yorkshire y West Midlands inglesas que cumplieron con los criterios de inclusión. Se compararon dos opciones de tratamiento: cirugía primaria asociada a tratamiento endocrino adyuvante o tratamiento primario endocrino. Para estimar la probabilidad de supervivencia se combinaron modelos predictivos para el riesgo de mortalidad específica por cáncer de mama y para el riesgo de mortalidad por otras causas. Se realizó una validación externa con datos del Eastern Cancer Registration and Information Center (n = 14.526). RESULTADOS: La calibración global del modelo fue buena. A los 2 y 5 años, la mortalidad anticipada por cáncer de mama y por otras causas difería de la observada en menos del 1%. A los 5 años, hubo una ligera sobrevaloración de la predicción de mortalidad por cáncer de mama (prevista versus real: 2.629 versus 2.556, P = 0,78) y de la mortalidad por todas las causas (6.399 versus 6.320, P = 0,14). Esta discrepancia varió entre subgrupos. La capacidad discriminativa del modelo fue del 0,75 o superior para todas las medidas de mortalidad. CONCLUSIÓN: En este estudio, se desarrolló y validó un modelo pronóstico para mujeres mayores con cáncer de mama precoz positivo para receptores de estrógenos. Esta herramienta que facilita la toma de decisiones está disponible online (https://agegap.shef.ac.uk/).

Breast cancer surgery in older women: outcomes of the Bridging Age Gap in Breast Cancer study.

BACKGROUND: Breast cancer surgery in older women is variable and sometimes non-standard owing to concerns about morbidity. Bridging the Age Gap in Breast Cancer is a prospective multicentre cohort study aiming to determine factors influencing treatment selection and outcomes from surgery for older patients with breast cancer. METHODS: Women aged at least 70 years with operable breast cancer were recruited from 57 UK breast units between 2013 and 2018. Associations between patient and tumour characteristics and type of surgery in the breast and axilla were evaluated using univariable and multivariable analyses. Oncological outcomes, adverse events and quality-of-life (QoL) outcomes were monitored for 2 years. RESULTS: Among 3375 women recruited, surgery was performed in 2816 patients, of whom 24 with inadequate data were excluded. Sixty-two women had bilateral tumours, giving a total of 2854 surgical events. Median age was 76 (range 70-95) years. Breast surgery comprised mastectomy in 1138 and breast-conserving surgery in 1716 procedures. Axillary surgery comprised axillary lymph node dissection in 575 and sentinel node biopsy in 2203; 76 had no axillary surgery. Age, frailty, dementia and co-morbidities were predictors of mastectomy (multivariable odds ratio (OR) for age 1·06, 95 per cent c.i. 1·05 to 1·08). Age, frailty and co-morbidity were significant predictors of no axillary surgery (OR for age 0·91, 0·87 to 0·96). The rate of adverse events was moderate (551 of 2854, 19·3 per cent), with no 30-day mortality. Long-term QoL and functional independence were adversely affected by surgery. CONCLUSION: Breast cancer surgery is safe in women aged 70 years or more, with serious adverse events being rare and no mortality. Age, ill health and frailty all influence surgical decision-making. Surgery has a negative impact on QoL and independence, which must be considered when counselling patients about choices.

ANTECEDENTES: La cirugía del cáncer de mama en mujeres mayores es variable y, a veces, no estandarizada debido a las reservas que origina la morbilidad quirúrgica. Bridging the Age Gap in Breast Cancer es un estudio de cohortes, prospectivo, multicéntrico cuyo objetivo fue determinar los factores que influyen en la selección del tratamiento y en los resultados de la cirugía en pacientes mayores con cáncer de mama. MÉTODOS: Se reclutaron mujeres de > 70 años de edad con cáncer de mama operable atendidas en 56 unidades de mama del Reino Unido entre 2013-2018. Los datos sobre las características de la paciente y del tumor se correlacionaron con el tipo de cirugía en la mama y en la axila mediante análisis univariable y multivariable. Se controlaron los resultados oncológicos, los eventos adversos y los resultados en cuanto a la calidad de vida durante 2 años. RESULTADOS: De 3.375 mujeres reclutadas, se realizó una intervención quirúrgica en 2.816 pacientes. Hubo 62 tumores bilaterales, por lo que se analizan 2.854 procedimientos. La mediana de edad fue de 76 años (rango 70-95). En 1.138 pacientes se realizó una mastectomía y en 1.798 cirugía conservadora de la mama. En cuanto a la cirugía de la axila, en 575 pacientes se realizó una linfadenectomía, en 2.203 una biopsia de ganglio centinela y en 76 no se realizó ningún procedimiento. Los factores predictores de mastectomía fueron la edad, la fragilidad, la demencia y las comorbilidades (riesgo relativo, RR 1,06; i.c. del 95% 1,05-1,08), mientras que para la cirugía axilar los factores predictores fueron la fragilidad y las comorbilidades (RR 0,91; i.c. del 95% 0,87-0,96). La tasa de efectos adversos fue moderada (551/2854; 19,3%), sin mortalidad a los 30 días. La calidad de vida a largo plazo y la independencia funcional se vieron negativamente afectadas por la cirugía. CONCLUSIÓN: La cirugía de cáncer de mama es segura, con escasos efectos adversos graves y sin mortalidad. La edad, las comorbilidades y la fragilidad tienen impacto en la toma de decisiones quirúrgicas. La cirugía tiene una repercusión negativa en la calidad de vida e independencia funcional, hechos que deben ser tenidos en cuenta al aconsejar a las pacientes sobre las opciones terapéuticas.

Adjuvant Chemotherapy for Breast Cancer in Older Women: An Analysis of Retrospective English Cancer Registration Data.

AIMS: Adjuvant chemotherapy is recommended as a treatment for women with high recurrence risk early breast cancer. Older women are less likely to receive chemotherapy than younger women. This study investigated the impact of chemotherapy on breast cancer-specific survival in women aged 70 + years using English registry data. MATERIALS AND METHODS: Cancer registration data were obtained from two English regions from 2002 to 2012 (n = 29 728). The impact of patient-level characteristics on the probability of receiving adjuvant chemotherapy was explored using logistic regression. Survival modelling was undertaken to show the effect of chemotherapy and age/health status on breast cancer-specific survival. Missing data were handled using multiple imputation. RESULTS: In total, 11 735 surgically treated early breast cancer patients were identified. Use of adjuvant chemotherapy has increased over time. Younger age at diagnosis, increased nodal involvement, tumour size and grade, oestrogen receptor-negative or human epidermal growth factor receptor 2-positive disease were all associated with increased probability of receiving chemotherapy. Chemotherapy was associated with a significant reduction in the hazard of breast cancer-specific mortality in women with high risk cancer, after adjusting for patient-level characteristics (hazard ratio 0.74, 95% confidence interval 0.67-0.81). DISCUSSION: Chemotherapy is associated with an improved breast cancer-specific survival in older women with early breast cancer at high risk of recurrence . Lower rates of chemotherapy use in older women may, therefore, contribute to inferior cancer outcomes. Decisions on potential benefits for individual patients should be made on the basis of life expectancy, treatment tolerance and patient preference.

Omission of surgery in older women with early breast cancer has an adverse impact on breast cancer-specific survival.

BACKGROUND: Primary endocrine therapy is used as an alternative to surgery in up to 40 per cent of women with early breast cancer aged over 70 years in the UK. This study investigated the impact of surgery versus primary endocrine therapy on breast cancer-specific survival (BCSS) in older women. METHODS: Cancer registration data for 2002-2010 were obtained from two English regions. A retrospective analysis was performed for women with oestrogen receptor (ER)-positive disease, using statistical modelling to show the effect of treatment (surgery or primary endocrine therapy) and age and health status on BCSS. Missing data were handled using multiple imputation. RESULTS: Cancer registration data on 23 961 women were retrieved. After data preprocessing, 18 730 of 23 849 women (78·5 per cent) were identified as having ER-positive disease; of these, 10 087 (53·9 per cent) had surgery and 8643 (46·1 per cent) had primary endocrine therapy. BCSS was worse in the primary endocrine therapy group than in the surgical group (5-year BCSS rate 69·4 and 89·9 per cent respectively). This was true for all strata considered, although the difference was less in the cohort with the greatest degree of co-morbidity. For older, frailer patients the hazard of breast cancer death had less relative impact on overall survival. CONCLUSION: BCSS in older women with ER-positive disease is worse if surgery is omitted. This treatment choice may contribute to inferior cancer outcomes. Selection for surgery on the basis of predicted life expectancy may permit choice of women for whom surgery confers little benefit.