Tracking and mapping in medical computer vision: A review.

As computer vision algorithms increase in capability, their applications in clinical systems will become more pervasive. These applications include: diagnostics, such as colonoscopy and bronchoscopy; guiding biopsies, minimally invasive interventions, and surgery; automating instrument motion; and providing image guidance using pre-operative scans. Many of these applications depend on the specific visual nature of medical scenes and require designing algorithms to perform in this environment. In this review, we provide an update to the field of camera-based tracking and scene mapping in surgery and diagnostics in medical computer vision. We begin with describing our review process, which results in a final list of 515 papers that we cover. We then give a high-level summary of the state of the art and provide relevant background for those who need tracking and mapping for their clinical applications. After which, we review datasets provided in the field and the clinical needs that motivate their design. Then, we delve into the algorithmic side, and summarize recent developments. This summary should be especially useful for algorithm designers and to those looking to understand the capability of off-the-shelf methods. We maintain focus on algorithms for deformable environments while also reviewing the essential building blocks in rigid tracking and mapping since there is a large amount of crossover in methods. With the field summarized, we discuss the current state of the tracking and mapping methods along with needs for future algorithms, needs for quantification, and the viability of clinical applications. We then provide some research directions and questions. We conclude that new methods need to be designed or combined to support clinical applications in deformable environments, and more focus needs to be put into collecting datasets for training and evaluation.

Tracking the time-course of spoken word recognition of Cantonese Chinese in sentence context: Evidence from eye movements.

In this study, we conducted an eye-tracking experiment to investigate the effects of sentence context and tonal information on spoken word recognition processes in Cantonese Chinese. We recruited 60 native Cantonese listeners to participate in the eye-tracking experiment. The target words (phonologically similar words) were manipulated to either (1) a congruent context or (2) an incongruent context in the experiment. The resulting eye-movement patterns in the incongruent context condition clearly revealed that (1) sentence context produced a garden-path effect in the initial stage of the spoken word recognition processes and then (2) the lexical tone of the word (bottom-up information) overrode the contextual effects to help listeners to discriminate between different similar-sounding words during lexical access. In conclusion, the patterns of eye-tracking data show the interactive processes between the lexical tone (an acoustic cue within a Cantonese word) and sentence context played in different phases to the spoken word recognition of Cantonese Chinese.

Cross-situational word learning of Cantonese Chinese.

In this study, we recruited 60 native Cantonese speakers to participate in a standard cross-situational word-learning task to explore the cross-situational learning effects of minimal word pairs in Cantonese Chinese. In the cross-situational word-learning task, four different types of word pairs were used: (1) a non-minimal word pair [N]; (2) a consonant minimal word pair [C]; (3) a rime minimal word pair [R]; and (4) a tone minimal word pair [T]. The results showed that the participants could learn the word-referent mapping for all word-pair types, but they performed better on the N and T types than on the other two (i.e., C and R). Together with other previous evidence, these findings suggest that Cantonese language learners can learn and encode those phonetic details while they learn the word-referent co-occurrence probabilities. The results also suggested that the tonal information seemed to be more important than the other phonological components in Cantonese Chinese word learning.

The foreign language effects on strategic behavior games.

The present study examined foreign language effects on the decisions made in a series of strategic behavioral games (e.g., the Prisoner's Dilemma, the Oligopolistic Competition, and the Volunteer's Dilemma). We recruited 154 native Chinese-speaking university students, with English as their second language, as participants. They were asked to make decisions while playing four simple behavioral games in either Chinese or English language version and to complete a Language History Questionnaire. The results showed that 1) the participants in each language group performed differently in the Prisoner's Dilemma Game and in one condition of the Volunteer's Dilemma Game which involved a relatively high level of uncertainty; and 2) foreign language proficiency, frequency of application and cultural identity triggered by the corresponding foreign language moderated the foreign language effects. This pattern of results is consistent with the Cultural Accommodation Hypothesis and the risk-aversion preference to use one's native language.

Psychometric properties of the Chinese version of procrastination assessment scale for students.

The procrastination assessment scale for students (PASS) has been used widely in evaluating the patterns of university students' procrastination on academic tasks and their procrastination behavior. The present study validated the psychometric properties of a Chinese version of the PASS (PASS-C) by recruiting two representative independent sample of Hong Kong Chinese university students (S1 used in the EFA study: 506; S2 used in the CFA study: 506). The results confirmed that this modified Chinese version is a valid and appropriate tool to assess university students' procrastination tendencies in Chinese educational settings.

Remote telesurgery in humans: a systematic review.

BACKGROUND: Since the conception of robotic surgery, remote telesurgery has been a dream upon which incredible technological advances haven been built. Despite the considerable enthusiasm for, there have been few published studies of remote telesurgery on humans. METHODS: We performed a systematic review of the English literature (PubMed, EMbase, Inspec & Compendex and Web of Science) to report studies of remote telesurgery in humans. Keywords included telesurgery, remote surgery, long-distance surgery, and telerobotics. Subjects had to be human (live patients or cadavers). The operating surgeon had to be remote from the patient, separated by more than one kilometer. The article had to explicitly report the use of a long-distance telerobotic technique. Articles that focused on telepresence or tele-mentoring were excluded. RESULTS: The study included eight articles published from 2001 to 2020. One manuscript (1 subject) described remote surgery on a cadaver model, and the other seven were on live humans (72 subjects). Procedure types included percutaneous, endovascular, laparoscopic, and transoral. Communication methods varied, with the first report using a telephone line and the most recent studies using a 5G network. Six of the studies reported signal latency as a single value and it ranged from 28 ms to 280 ms. CONCLUSIONS: Few studies have described remote telesurgery in humans, and there is considerable variability in robotic and communication methods. Future efforts should work to improve reporting of signal latency and follow careful research methodology.

Cognitive Consequences of Bilingualism and Multilingualism: Cross-Linguistic Influences.

Bilingualism and multilingualism are common in almost all communities worldwide today. Research studies on the psycholinguistics of bilingualism and multilingualism in East Asia region has developed tremendously in the past 20 years. Along with the new methodologies, innovative approaches, and the development of those state-of-the-art technologies (Altarriba and Heredia (eds) in An introduction to bilingualism: principles and processes, Routledge, 2018), a lot of new research findings on this line of research have been reported.

Working memory and lexical ambiguity resolution in Cantonese Chinese.

The present study examined how working memory functions in the underlying mechanism of the lexical disambiguation process (in activation approach or in inhibition approach). We recruited sixty native Cantonese listeners to participate in two experimental tasks: (a) a Cantonese-version reading span task to measure their working memory (WM) capacity and (b) a standard cross-modal priming task to measure the lexical disambiguation time. The results revealed that (1) the underlying mechanism of the disambiguation process seemed favorable for an inhibition approach and (2) the frequency of the individual meanings of the ambiguous words and the numbers of their meanings might interact with the WM capacity during lexical access, particularly for the low-WM span group.

Stroke Encoding Processes of Chinese Character During Sentence Reading.

The present study was conducted to examine whether traditional and simplified Chinese readers (TCRs and SCRs) differed in stroke encoding in character processing by an eye-tracking experiment. We recruited 66 participants (32 TCRs and 34 SCRs) to read sentences comprising characters with different proportions and types of strokes removed in order to explore whether any visual complexity effect existed in their processing of simplified and traditional Chinese characters. The present study found a cross-script visual complexity effect and that SCRs were more influenced by visual complexity change in lexical access than were TCRs. In addition, the stroke-order effect appeared to be more salient for TCRs than for SCRs.

Psychometric properties of a Chinese version of the Brief Young Adult Alcohol Consequences Questionnaire (B-YAACQ).

AIM: This study evaluated the psychometric properties of the Chinese version of the Brief Young Adult Alcohol Consequences Questionnaire (B-YAACQ). METHOD: In this study, 1616 Chinese university students (male = 58.66%; Mage = 19.88) reporting past-year drinking experience voluntarily completed an anonymous questionnaire. Rasch analysis, reliability analysis, and linear modeling were performed to examine the psychometric properties of the Chinese version of B-YAACQ. RESULTS: Results of Rasch analysis and reliability analysis supported the assumption of uni-dimensionality, local independence, and internal consistency of the 24-item B-YAACQ in our Chinese sample. However, six items had marginal outfit statistics and/or potential gender bias; therefore, a model with 18 items was also tested after removing these items. The 18-item model showed excellent fit to the uni-dimensional model with no gender bias. However, the Pearson correlation between the 24-item and 18-item versions was r = 0.98, suggesting highly similar measurement. Both versions demonstrated concurrent validity through positive association with the Alcohol Use Disorder Identification Test (AUDIT) subscales, even after controlling for the effects of age and gender. CONCLUSION: This study is the first to validate a measurement tool for negative drinking consequences for university students in China. Despite some limitations, the original 24-item B-YAACQ was shown to have satisfactory psychometric properties when applied to Chinese university students. We recommend the shorter 18-item version without significant gender bias for testing gender differences.

Processing Homophones Interactively: Evidence from eye-movement data.

The question of how to process an ambiguous word in context has been long-studied in psycholinguistics and the present study examined this question further by investigating the spoken word recognition processes of Cantonese homophones (a common type of ambiguous word) in context. Sixty native Cantonese listeners were recruited to participate in an eye-tracking experiment. Listeners were instructed to listen carefully to a sentence ending with a Cantonese homophone and then look at different visual probes (either Chinese characters or line-drawing pictures) presented on the computer screen simultaneously. Two findings were observed. First, the results revealed that sentence context exerted an early effect on homophone processes. Second, visual probes that serve as phonological competitors only had a weak effect on the spoken word recognition processes. Consistent with previous studies, the patterns of eye-movement results appeared to support an interactive processing approach in homophone recognition.

Context Effects and Spoken Word Recognition of Chinese: An Eye-Tracking Study.

This study examined the time-course of context effects on spoken word recognition during Chinese sentence processing. We recruited 60 native Mandarin listeners to participate in an eye-tracking experiment. In this eye-tracking experiment, listeners were told to listen to a sentence carefully, which ended with a Chinese homophone, and look at different visual probes (Chinese characters or different line-drawing pictures) presented concurrently on the computer screen naturally. Different types of context and probe types were manipulated in the experiment. The results showed that (1) preceding sentence context had an early effect on spoken word recognition processes and (2) phonological information of the distracters had only a negligible effect on the spoken word recognition processes. Finally, the patterns of eye-tracking results seemed to favor an interactive approach in spoken word recognition.

Probabilistic Phonotactics as a Cue for Recognizing Spoken Cantonese Words in Speech.

Previous experimental psycholinguistic studies suggested that the probabilistic phonotactics information might likely to hint the locations of word boundaries in continuous speech and hence posed an interesting solution to the empirical question on how we recognize/segment individual spoken word in speech. We investigated this issue by using Cantonese language as a testing case in the present study. A word-spotting task was used in which listeners were instructed to spot any Cantonese word from a series of nonsense sound sequences. We found that it was easier for the native Cantonese listeners to spot the target word in the nonsense sound sequences with high transitional probability phoneme combinations than those with low transitional probability phoneme combinations. These results concluded that native Cantonese listeners did make use of the transitional probability information to recognize the spoken word in speech.

Phonotactics Constraints and the Spoken Word Recognition of Chinese Words in Speech.

Two word-spotting experiments were conducted to examine the question of whether native Cantonese listeners are constrained by phonotactics information in spoken word recognition of Chinese words in speech. Because no legal consonant clusters occurred within an individual Chinese word, this kind of categorical phonotactics information of Chinese word may be most likely to cue native Cantonese listeners the locations of possible word boundaries in speech. The observed results from the two word-spotting experiments confirmed this prediction. Together with other relevant studies, we suggest that phonotactics constraint is one of the useful sources of information in spoken word recognition processes of Chinese words in speech.

Spoken Word Recognition of Chinese Words in Continuous Speech.

The present study examined the role of positional probability of syllables played in recognition of spoken word in continuous Cantonese speech. Because some sounds occur more frequently at the beginning position or ending position of Cantonese syllables than the others, so these kinds of probabilistic information of syllables may cue the locations of syllable boundaries in speech. Two word-spotting experiments were conducted to investigate the role of positional probability in the spoken word recognition process of Cantonese speech. It was found that listeners indeed made use of the positional probability of a syllable's onset but not of a syllable's ending sound in the spoken word recognition process. Together with other relevant studies in different languages, we propose that probabilistic phonotactics are one useful source of information in the spoken word recognition and speech segmentation process.

Six Degree-of-Freedom Measurements of Human Mild Traumatic Brain Injury.

This preliminary study investigated whether direct measurement of head rotation improves prediction of mild traumatic brain injury (mTBI). Although many studies have implicated rotation as a primary cause of mTBI, regulatory safety standards use 3 degree-of-freedom (3DOF) translation-only kinematic criteria to predict injury. Direct 6DOF measurements of human head rotation (3DOF) and translation (3DOF) have not been previously available to examine whether additional DOFs improve injury prediction. We measured head impacts in American football, boxing, and mixed martial arts using 6DOF instrumented mouthguards, and predicted clinician-diagnosed injury using 12 existing kinematic criteria and 6 existing brain finite element (FE) criteria. Among 513 measured impacts were the first two 6DOF measurements of clinically diagnosed mTBI. For this dataset, 6DOF criteria were the most predictive of injury, more than 3DOF translation-only and 3DOF rotation-only criteria. Peak principal strain in the corpus callosum, a 6DOF FE criteria, was the strongest predictor, followed by two criteria that included rotation measurements, peak rotational acceleration magnitude and Head Impact Power (HIP). These results suggest head rotation measurements may improve injury prediction. However, more 6DOF data is needed to confirm this evaluation of existing injury criteria, and to develop new criteria that considers directional sensitivity to injury.