Gromov-Wasserstein unsupervised alignment reveals structural correspondences between the color similarity structures of humans and large language models.

Large Language Models (LLMs), such as the General Pre-trained Transformer (GPT), have shown remarkable performance in various cognitive tasks. However, it remains unclear whether these models have the ability to accurately infer human perceptual representations. Previous research has addressed this question by quantifying correlations between similarity response patterns of humans and LLMs. Correlation provides a measure of similarity, but it relies pre-defined item labels and does not distinguish category- and item- level similarity, falling short of characterizing detailed structural correspondence between humans and LLMs. To assess their structural equivalence in more detail, we propose the use of an unsupervised alignment method based on Gromov-Wasserstein optimal transport (GWOT). GWOT allows for the comparison of similarity structures without relying on pre-defined label correspondences and can reveal fine-grained structural similarities and differences that may not be detected by simple correlation analysis. Using a large dataset of similarity judgments of 93 colors, we compared the color similarity structures of humans (color-neurotypical and color-atypical participants) and two GPT models (GPT-3.5 and GPT-4). Our results show that the similarity structure of color-neurotypical participants can be remarkably well aligned with that of GPT-4 and, to a lesser extent, to that of GPT-3.5. These results contribute to the methodological advancements of comparing LLMs with human perception, and highlight the potential of unsupervised alignment methods to reveal detailed structural correspondences.

Image Perceptual Similarity Metrics for the Assessment of Basal Cell Carcinoma.

Efficient management of basal cell carcinomas (BCC) requires reliable assessments of both tumors and post-treatment scars. We aimed to estimate image similarity metrics that account for BCC's perceptual color and texture deviation from perilesional skin. In total, 176 clinical photographs of BCC were assessed by six physicians using a visual deviation scale. Internal consistency and inter-rater agreement were estimated using Cronbach's α, weighted Gwet's AC2, and quadratic Cohen's kappa. The mean visual scores were used to validate a range of similarity metrics employing different color spaces, distances, and image embeddings from a pre-trained VGG16 neural network. The calculated similarities were transformed into discrete values using ordinal logistic regression models. The Bray-Curtis distance in the YIQ color model and rectified embeddings from the 'fc6' layer minimized the mean squared error and demonstrated strong performance in representing perceptual similarities. Box plot analysis and the Wilcoxon rank-sum test were used to visualize and compare the levels of agreement, conducted on a random validation round between the two groups: 'Human-System' and 'Human-Human.' The proposed metrics were comparable in terms of internal consistency and agreement with human raters. The findings suggest that the proposed metrics offer a robust and cost-effective approach to monitoring BCC treatment outcomes in clinical settings.

Novel Method for Fetal and Maternal Heart Rate Measurements Using 2-D Ultrasound Color Doppler Flow Images.

Fetal heart rate (FHR) and maternal heart rate (MHR) are important indicators of fetal well-being during pregnancy. A common method in clinical examination is to estimate the FHR using the Doppler shift of echoes from umbilical artery blood flow based on an ultrasound pulsed-wave (PW) Doppler technique. Similarly, a sampling gate can be located at the maternal blood flow to measure MHR using PW Doppler. Ultrasound color Doppler flow imaging (CDFI) is one of the most commonly used imaging modes for clinical fetal examinations. Color coding is employed to display the blood flow velocity and direction in color grades according to the Doppler shift. Continuous CDF images contain dynamic changes characteristics of the blood flow. The periodic characteristics can be used to obtain heart rate information. Therefore, here we propose a novel method to measure FHR and MHR simultaneously using CDF images. The proposed method calculates the histogram of color similarity of CDF images to initially extract the periodic characteristics of the CDF image sequence. The histogram of color similarity function is then processed by a bandpass filter and autocorrelation operation to reduce noise and enhance periodicity. Finally, peak detection is performed on the processed signal to obtain the period and estimate the heart rate. The proposed method can measure the FHR and MHR in parallel after selecting two regions containing the umbilical artery and maternal blood flow, respectively. Thus, the method has high computational efficiency. The proposed method was evaluated on a Doppler flow phantom and clinical CDF images and then compared with the PW Doppler method. The correlation analysis and Bland-Altman plots reveal that the proposed method agrees well with the PW Doppler. It is a sanity check method for real-time clinical FHR and MHR measurements.

Influence of Similarity of the Sheet Appearance in Multiple-Specification Drug on Taking Error / 医薬品情報学

<b>Objective: </b>Similarity in drug appearance is one of the major environmental factors influencing dispensing errors, such as picking the wrong medication (picking error).  The purpose of this study is to verify if the index values of appearance similarity calculated objectively for multiple-specification drugs are the factors of picking error.<br><b>Methods: </b>Four variables (number of total prescription, deviation of prescriptions between the specifications, sheet size, and color similarity of the sheet surface) were calculated.  The number of total prescription and deviation of prescriptions were extracted from the dispensing system.  Sheet size and color similarity were calculated, respectively, from the area ratio and by the Histogram Intersection method using the press through package (PTP) sheet image.  To evaluate the relationship between the picking error rate and these four variables, univariate and multivariate analyses were performed.<br><b>Results: </b>The number of total prescription and the deviation of prescriptions were not significant factors.  In contrast, sheet size and color similarity significantly influenced the picking error rates.<br><b>Conclusion: </b>Similarity in appearance between multiple-specification drugs is a risk factor of picking error.  When the multiple-specification pair has the same sheet size or high color similarity, one needs to be caution of picking error.  Further, in the pharmaceutical industry, to reduce the risk of dispensing errors, it is desirable to carry out the devise to enhance the identity of each specification.