Trust in automation and the accuracy of human-algorithm teams performing one-to-one face matching tasks.

The human face is commonly used for identity verification. While this task was once exclusively performed by humans, technological advancements have seen automated facial recognition systems (AFRS) integrated into many identification scenarios. Although many state-of-the-art AFRS are exceptionally accurate, they often require human oversight or involvement, such that a human operator actions the final decision. Previously, we have shown that on average, humans assisted by a simulated AFRS (sAFRS) failed to reach the level of accuracy achieved by the same sAFRS alone, due to overturning the system's correct decisions and/or failing to correct sAFRS errors. The aim of the current study was to investigate whether participants' trust in automation was related to their performance on a one-to-one face matching task when assisted by a sAFRS. Participants (n = 160) completed a standard face matching task in two phases: an unassisted baseline phase, and an assisted phase where they were shown the identification decision (95% accurate) made by a sAFRS prior to submitting their own decision. While most participants improved with sAFRS assistance, those with greater relative trust in automation achieved larger gains in performance. However, the average aided performance of participants still failed to reach that of the sAFRS alone, regardless of trust status. Nonetheless, further analysis revealed a small sample of participants who achieved 100% accuracy when aided by the sAFRS. Our results speak to the importance of considering individual differences when selecting employees for roles requiring human-algorithm interaction, including identity verification tasks that incorporate facial recognition technologies.

Face masks and fake masks: the effect of real and superimposed masks on face matching with super-recognisers, typical observers, and algorithms.

Mask wearing has been required in various settings since the outbreak of COVID-19, and research has shown that identity judgements are difficult for faces wearing masks. To date, however, the majority of experiments on face identification with masked faces tested humans and computer algorithms using images with superimposed masks rather than images of people wearing real face coverings. In three experiments we test humans (control participants and super-recognisers) and algorithms with images showing different types of face coverings. In all experiments we tested matching concealed or unconcealed faces to an unconcealed reference image, and we found a consistent decrease in face matching accuracy with masked compared to unconcealed faces. In Experiment 1, typical human observers were most accurate at face matching with unconcealed images, and poorer for three different types of superimposed mask conditions. In Experiment 2, we tested both typical observers and super-recognisers with superimposed and real face masks, and found that performance was poorer for real compared to superimposed masks. The same pattern was observed in Experiment 3 with algorithms. Our results highlight the importance of testing both humans and algorithms with real face masks, as using only superimposed masks may underestimate their detrimental effect on face identification.

A new way of classifying developmental prosopagnosia: Balanced Integration Score.

Despite severe everyday problems recognising faces, some individuals with developmental prosopagnosia (DP) can achieve typical accuracy scores on laboratory face recognition tests. To address this, studies sometimes also examine response times (RTs), which tend to be longer in DPs relative to control participants. In the present study, 24 potential (according to self-report) DPs and 110 age-matched controls completed the Cambridge Face and Bicycle Memory Tests, old new faces task, and a famous faces test. We used accuracy and the Balanced Integration Score (BIS), a measure that adjusts accuracy for RTs, to classify our sample at the group and individual levels. Subjective face recognition ability was assessed using the PI20 questionnaire and semi structured interviews. Fifteen DPs showed a major impairment using BIS compared with only five using accuracy alone. Logistic regression showed that a model incorporating the BIS measures was the most sensitive for classifying DP and showed highest area under the curve (AUC). Furthermore, larger between-group effect sizes were observed for a derived global (averaged) memory measure calculated using BIS versus accuracy alone. BIS is thus an extremely sensitive novel measure for attenuating speed-accuracy trade-offs that can otherwise mask impairment measured only by accuracy in DP.

Chronic Lymphocytic Leukemia IGHV Somatic Hypermutation Detection by Targeted Capture Next-Generation Sequencing.

BACKGROUND: Somatic hypermutation (SHM) status of the immunoglobulin heavy variable (IGHV) gene plays a crucial role in determining the prognosis and treatment of patients with chronic lymphocytic leukemia (CLL). A common approach for determining SHM status is multiplex polymerase chain reaction and Sanger sequencing of the immunoglobin heavy locus; however, this technique is low throughput, is vulnerable to failure, and does not allow multiplexing with other diagnostic assays. METHODS: Here we designed and validated a DNA targeted capture approach to detect immunoglobulin heavy variable somatic hypermutation (IGHV SHM) status as a submodule of a larger next-generation sequencing (NGS) panel that also includes probes for ATM, BIRC3, CHD2, KLHL6, MYD88, NOTCH1, NOTCH2, POT1, SF3B1, TP53, and XPO1. The assay takes as input FASTQ files and outputs a report containing IGHV SHM status and V allele usage following European Research Initiative on CLL guidelines. RESULTS: We validated the approach on 35 CLL patient samples, 34 of which were characterized using Sanger sequencing. The NGS panel identified the IGHV SHM status of 34 of 35 CLL patients. We showed 100% sensitivity and specificity among the 33 CLL samples with both NGS and Sanger sequencing calls. Furthermore, we demonstrated that this panel can be combined with additional targeted capture panels to detect prognostically important CLL single nucleotide variants, insertions/deletions, and copy number variants (TP53 copy number loss). CONCLUSIONS: A targeted capture approach to IGHV SHM detection can be integrated into broader sequencing panels, allowing broad CLL prognostication in a single molecular assay.

Multisite clinical cross-validation and variant interpretation of a next generation sequencing panel for lymphoid cancer prognostication.

AIMS: Genomic sequencing of lymphomas is under-represented in routine clinical testing despite having prognostic and predictive value. Clinical implementation is challenging due to a lack of consensus on reportable targets and a paucity of reference samples. We organised a cross-validation study of a lymphoma-tailored next-generation sequencing panel between two College of American Pathologists (CAP)-accredited clinical laboratories to mitigate these challenges. METHODS: A consensus for the genomic targets was discussed between the two institutes based on recurrence in diffuse large B-cell lymphoma, follicular lymphoma, mantle cell lymphoma, chronic lymphocytic leukaemia and T-cell lymphomas. Using the same genomic targets, each laboratory ordered libraries independently and a cross-validation study was designed to exchange samples (8 cell lines and 22 clinical samples) and their FASTQ files. RESULTS: The sensitivity of the panel when comparing different library preparation and bioinformatic workflows was between 97% and 99% and specificity was 100% when a 5% limit of detection cut-off was applied. To evaluate how the current standards for variant classification of tumours apply to lymphomas, the Association for Molecular Pathology/American Society of Clinical Oncology/CAP and OncoKB classification systems were applied to the panel. The majority of variants were assigned a possibly actionable class or likely pathogenic due to more limited evidence in the literature. CONCLUSIONS: The cross-validation study highlights the benefits of sample and data exchange for clinical validation and provided a framework for reporting the findings in lymphoid malignancies.

Case Report: Identification of a novel STAT3 mutation in EBV-positive inflammatory follicular dendritic cell sarcoma.

EBV-positive inflammatory follicular dendritic cell sarcoma (EBV+ IFDCS) is an uncommon disease primarily observed in Asia. It is characterized by the development of tumors believed to originate from follicular dendritic cells (FDC). The consistent association between this condition and clonal EBV infection suggests EBV's involvement as an etiological factor. However, diagnosing EBV+ IFDCS can be challenging due to its morphological variability and diverse immunohistochemical staining patterns. The genetic characteristics of EBV+ IFDCS remain insufficiently understood. To address this knowledge gap, we present a case study of a 47-year-old male patient diagnosed with EBV+ IFDCS. We utilized a Next-generation sequencing (NGS) platform to investigate the genetic profile of the tumor cells. We identified a single pathogenic mutation (G618R) in the STAT3 gene. This finding provides valuable insights into the genetic alterations associated with EBV+ IFDCS and potentially contributes to our understanding of the disease's pathogenesis.

Data-driven studies in face identity processing rely on the quality of the tests and data sets.

There is growing interest in how data-driven approaches can help understand individual differences in face identity processing (FIP). However, researchers employ various FIP tests interchangeably, and it is unclear whether these tests 1) measure the same underlying ability/ies and processes (e.g., confirmation of identity match or elimination of identity match) 2) are reliable, 3) provide consistent performance for individuals across tests online and in laboratory. Together these factors would influence the outcomes of data-driven analyses. Here, we asked 211 participants to perform eight tests frequently reported in the literature. We used Principal Component Analysis and Agglomerative Clustering to determine factors underpinning performance. Importantly, we examined the reliability of these tests, relationships between them, and quantified participant consistency across tests. Our findings show that participants' performance can be split into two factors (called here confirmation and elimination of an identity match) and that participants cluster according to whether they are strong on one of the factors or equally on both. We found that the reliability of these tests is at best moderate, the correlations between them are weak, and that the consistency in participant performance across tests and is low. Developing reliable and valid measures of FIP and consistently scrutinising existing ones will be key for drawing meaningful conclusions from data-driven studies.

Increase of Severe Pulmonary Infections in Adults Caused by M1UK Streptococcus pyogenes, Central Scotland, UK.

We characterized the epidemiology, host-pathogen characteristics, and outcomes of severe adult pulmonary Streptococcus pyogenes infections that coincided with a high community caseload in central Scotland, UK. The pulmonary infections had high illness and death rates and were associated with socioeconomic deprivation, influenza A co-infection, and the M1UK lineage of S. pyogenes.

An assessment of the downstream implications of blood culture collection and transit.

The implications of the variables within the pre-analytical phase of blood culture processing are poorly understood. This study aims to explore the effect of transit times (TT) and culture volume, on time to microbiological diagnosis and patient outcomes. Blood cultures received between 1st March and 31st July 2020/21 were identified. TT, time in incubator (TII), and for positive samples, request to positivity times (RPT) were calculated. Demographic details were recorded for all samples, and culture volume, length of stay (LoS), and 30-day mortality for patients with positive samples. Statistical analysis examined how culture volume and TT effected culture positivity and outcome; in the context of the 4-h national TT target. Totally, 14,375 blood culture bottles were received from 7367 patients; 988 (13.4%) were positive for organisms. There was no significant difference between TT of negative and positive samples. The RPT was significantly lower for samples with TT < 4 h (p < 0.001). Culture bottle volume did not affect RPT (p = 0.482) or TII (p = 0.367). A prolonged TT was associated with a longer length-of-stay in those with a bacteraemia with a significant organism (p = 0.001). We found shorter blood culture transportation time was associated with a significantly faster time of positive culture reporting, while optimal blood culture volume did not make a significant impact. Delays in reporting for significant organisms correspond to a prolonged LoS. Laboratory centralisation makes achieving the 4-h target a logistical challenge; however, this data suggests such targets have significant microbiological and clinical impacts.

Simulated automated facial recognition systems as decision-aids in forensic face matching tasks.

Automated Facial Recognition Systems (AFRS) are used by governments, law enforcement agencies, and private businesses to verify the identity of individuals. Although previous research has compared the performance of AFRS and humans on tasks of one-to-one face matching, little is known about how effectively human operators can use these AFRS as decision-aids. Our aim was to investigate how the prior decision from an AFRS affects human performance on a face matching task, and to establish whether human oversight of AFRS decisions can lead to collaborative performance gains for the human-algorithm team. The identification decisions from our simulated AFRS were informed by the performance of a real, state-of-the-art, Deep Convolutional Neural Network (DCNN) AFRS on the same task. Across five pre-registered experiments, human operators used the decisions from highly accurate AFRS (> 90%) to improve their own face matching performance compared with baseline (sensitivity gain: Cohen's d = 0.71-1.28; overall accuracy gain: d = 0.73-1.46). Yet, despite this improvement, AFRS-aided human performance consistently failed to reach the level that the AFRS achieved alone. Even when the AFRS erred only on the face pairs with the highest human accuracy (> 89%), participants often failed to correct the system's errors, while also overruling many correct decisions, raising questions about the conditions under which human oversight might enhance AFRS operation. Overall, these data demonstrate that the human operator is a limiting factor in this simple model of human-AFRS teaming. These findings have implications for the "human-in-the-loop" approach to AFRS oversight in forensic face matching scenarios. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Development of a comprehensive approach to adult hereditary cancer testing in Ontario.

BACKGROUND: Genetic testing for hereditary cancer susceptibility has advanced over time due to the discovery of new risk genes, improved technology and decreased cost. In the province of Ontario, testing eligibility criteria were initially developed to include hereditary breast, ovarian and colorectal cancer syndromes. The rapid evolution of genetic technologies has facilitated the ability to interrogate a large number of genes concurrently. This, coupled with new knowledge about risk genes, necessitated a coordinated approach to expanding the scope of genes and indications tested and synchronisation of access and test utilisation across the province as required in a publicly funded universal healthcare system. METHODS: Ontario Health-Cancer Care Ontario convened expert working groups to develop a standardised and comprehensive cancer gene list for adults and accompanying hereditary cancer testing (HCT) criteria using an evidence-based framework and broad laboratory and clinical genetics engagement. RESULTS: A standardised 76-cancer-gene panel, organised into 13 larger disease site panels and 25 single/small gene panels, was developed and endorsed by the working groups. Provincial genetic testing eligibility criteria were updated to align with the new panels and to guide clinical decision-making. In the first year following the implementation of these changes, 10 564 HCT panels were performed with an overall mutation detection rate of 12.2%. CONCLUSION: Using an evidence framework and broad clinical engagement to develop and endorse an updated guidance document, cancer genetic testing for adults in Ontario is now standardised and coordinated across the province.

How do looking patterns, anti-fat bias, and causal weight attributions relate to adults' judgements of child weight?

Prevailing weight-normative approaches to health pressure adults to visually categorise children's weight, despite little understanding of how such judgements are made. There is no evidence this strategy improves child health, and it may harm children with higher weights. To understand decision-making processes and identify potential mechanisms of harm we examined perceptual and attitudinal factors involved in adults' child weight category judgements. Eye movements of 42 adults were tracked while categorizing the weight of 40 computer-generated images of children (aged 4-5 & 10-11 years) varying in size. Questionnaires assessed child-focused weight bias and causal attributions for child weight. Participants' eye movement patterns resembled those previously reported for adult bodies. Categorisation data showed a perceptual bias towards the 'mid-range' category. For higher weight stimuli, participants whose category judgements most closely matched the stimulus's objective weight had higher child-focused anti-fat bias and weaker genetic attributions for child weight - i.e,. adults who 'label' higher weight in children in line with BMI categories report more stigmatising beliefs about such children, suggesting a possible mechanism of harm. Overall, adults' judgements reflect both unalterable perceptual biases and potentially harmful attitudinal factors, calling into question the feasibility and appropriateness of public health efforts to promote visual child weight categorisation.

Masked face identification is improved by diagnostic feature training.

To slow the spread of COVID-19, many people now wear face masks in public. Face masks impair our ability to identify faces, which can cause problems for professional staff who identify offenders or members of the public. Here, we investigate whether performance on a masked face matching task can be improved by training participants to compare diagnostic facial features (the ears and facial marks)-a validated training method that improves matching performance for unmasked faces. We show this brief diagnostic feature training, which takes less than two minutes to complete, improves matching performance for masked faces by approximately 5%. A control training course, which was unrelated to face identification, had no effect on matching performance. Our findings demonstrate that comparing the ears and facial marks is an effective means of improving face matching performance for masked faces. These findings have implications for professions that regularly perform face identification.

Visual search performance in 'CCTV' and mobile phone-like video footage.

Finding an unfamiliar person in a crowd of others is an integral task for police officers, CCTV-operators, and security staff who may be looking for a suspect or missing person; however, research suggests that it is difficult and accuracy in such tasks is low. In two real-world visual-search experiments, we examined whether being provided with four images versus one image of an unfamiliar target person would help improve accuracy when searching for that person through video footage. In Experiment 1, videos were taken from above and at a distance to simulate CCTV, and images of the target showed their face and torso. In Experiment 2, videos were taken from approximately shoulder height, such as one would expect from body-camera or mobile phone recordings, and target images included only the face. Our findings suggest that having four images as exemplars leads to higher accuracy in the visual search tasks, but this only reached significance in Experiment 2. There also appears to be a conservative bias whereby participants are more likely to respond that the target is not in the video when presented with only one image as opposed to 4. These results point to there being an advantage for providing multiple images of targets for use in video visual-search.

Familiar faces as islands of expertise.

Most people recognise and match pictures of familiar faces effortlessly, while struggling to match unfamiliar face images. This has led to the suggestion that true human expertise for faces applies only to familiar faces. This paper develops that idea to propose that we have isolated 'islands of expertise' surrounding each familiar face that allow us to perform better with faces that resemble those we already know. This idea is tested in three experiments. The first shows that familiarity with a person facilitates identification of their relatives. The second shows that people are better able to remember faces that resemble someone they already know. The third shows that while prompting participants to think about resemblance at study produces a large positive effect on subsequent recognition, there is still a significant effect if there is no such prompt. Face-space-R (Lewis, 2004) is used to illustrate a possible computational explanation of the processes involved.

Consensus Recommendations for MRD Testing in Adult B-Cell Acute Lymphoblastic Leukemia in Ontario.

Measurable (minimal) residual disease (MRD) is an established, key prognostic factor in adult B-cell acute lymphoblastic leukemia (B-ALL), and testing for MRD is known to be an important tool to help guide treatment decisions. The clinical value of MRD testing depends on the accuracy and reliability of results. Currently, there are no Canadian provincial or national guidelines for MRD testing in adult B-ALL, and consistent with the absence of such guidelines, there is no uniform Ontario MRD testing consensus. Moreover, there is great variability in Ontario in MRD testing with respect to where, when, and by which technique, MRD testing is performed, as well as in how the results are interpreted. To address these deficiencies, an expert multidisciplinary working group was convened to define consensus recommendations for improving the provision of such testing. The expert panel recommends that MRD testing should be implemented in a centralized manner to ensure expertise and accuracy in testing for this low volume indication, thereby to provide accurate, reliable results to clinicians and patients. All adult patients with B-ALL should receive MRD testing after induction chemotherapy. Philadelphia chromosome (Ph)-positive patients should have ongoing monitoring of MRD during treatment and thereafter, while samples from Ph-negative B-ALL patients should be tested at least once later during treatment, ideally at 12 to 16 weeks after treatment initiation. In Ph-negative adult B-ALL patients, standardized, ideally centralized, protocols must be used for MRD testing, including both flow cytometry and immunoglobulin (Ig) heavy chain and T-cell receptor (TCR) gene rearrangement analysis. For Ph-positive B-ALL patients, MRD testing using a standardized protocol for reverse transcription real-time quantitative PCR (RT-qPCR) for the BCR-ABL1 gene fusion transcript is recommended, with Ig/TCR gene rearrangement analysis done in parallel likely providing additional clinical information.

Bilinguals' inhibitory control and attentional processes in a visual perceptual task.

The aim was to examine theories of bilingual inhibitory control superiority in the visual domain. In an ambiguous figure task, the ability to reverse (switch) interpretations (e.g., duck-rabbit) was examined in 3-5-year-olds bilinguals and monolinguals (N = 67). Bilingualism was no performance predictor in conceptual tasks (Droodle task, false belief task, ambiguous figures production task) that did not pose inhibitory demands. Bilinguals outperformed monolinguals in the ability to reverse, suggesting superior inhibitory capacity per se. Once reversal was experienced there was no difference in the time it took to reverse or reversal frequency between bilinguals and monolinguals. Bayesian analyses confirmed statistical result patterns. Findings support the established view of bilinguals' superior domain-general inhibitory control. This might be brought to bear by attending the environment differently.