Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 82
Filter
1.
Res Sq ; 2024 Jun 20.
Article in English | MEDLINE | ID: mdl-38947043

ABSTRACT

Background: Coronary artery calcium (CAC) scans contain valuable information beyond the Agatston Score which is currently reported for predicting coronary heart disease (CHD) only. We examined whether new artificial intelligence (AI) algorithms applied to CAC scans may provide significant improvement in prediction of all cardiovascular disease (CVD) events in addition to CHD, including heart failure, atrial fibrillation, stroke, resuscitated cardiac arrest, and all CVD-related deaths. Methods: We applied AI-enabled automated cardiac chambers volumetry and automated calcified plaque characterization to CAC scans (AI-CAC) of 5830 individuals (52.2% women, age 61.7±10.2 years) without known CVD that were previously obtained for CAC scoring at the baseline examination of the Multi-Ethnic Study of Atherosclerosis (MESA). We used 15-year outcomes data and assessed discrimination using the time-dependent area under the curve (AUC) for AI-CAC versus the Agatston Score. Results: During 15 years of follow-up, 1773 CVD events accrued. The AUC at 1-, 5-, 10-, and 15-year follow up for AI-CAC vs Agatston Score was (0.784 vs 0.701), (0.771 vs. 0.709), (0.789 vs.0.712) and (0.816 vs. 0.729) (p<0.0001 for all), respectively. The category-free Net Reclassification Index of AI-CAC vs. Agatston Score at 1-, 5-, 10-, and 15-year follow up was 0.31, 0.24, 0.29 and 0.29 (p<.0001 for all), respectively. AI-CAC plaque characteristics including number, location, and density of plaque plus number of vessels significantly improved NRI for CAC 1-100 cohort vs. Agatston Score (0.342). Conclusion: In this multi-ethnic longitudinal population study, AI-CAC significantly and consistently improved the prediction of all CVD events over 15 years compared with the Agatston score.

2.
J Am Board Fam Med ; 37(2): 332-345, 2024.
Article in English | MEDLINE | ID: mdl-38740483

ABSTRACT

Primary care physicians are likely both excited and apprehensive at the prospects for artificial intelligence (AI) and machine learning (ML). Complexity science may provide insight into which AI/ML applications will most likely affect primary care in the future. AI/ML has successfully diagnosed some diseases from digital images, helped with administrative tasks such as writing notes in the electronic record by converting voice to text, and organized information from multiple sources within a health care system. AI/ML has less successfully recommended treatments for patients with complicated single diseases such as cancer; or improved diagnosing, patient shared decision making, and treating patients with multiple comorbidities and social determinant challenges. AI/ML has magnified disparities in health equity, and almost nothing is known of the effect of AI/ML on primary care physician-patient relationships. An intervention in Victoria, Australia showed promise where an AI/ML tool was used only as an adjunct to complex medical decision making. Putting these findings in a complex adaptive system framework, AI/ML tools will likely work when its tasks are limited in scope, have clean data that are mostly linear and deterministic, and fit well into existing workflows. AI/ML has rarely improved comprehensive care, especially in primary care settings, where data have a significant number of errors and inconsistencies. Primary care should be intimately involved in AI/ML development, and its tools carefully tested before implementation; and unlike electronic health records, not just assumed that AI/ML tools will improve primary care work life, quality, safety, and person-centered clinical decision making.


Subject(s)
Artificial Intelligence , Machine Learning , Primary Health Care , Humans , Primary Health Care/methods , Physician-Patient Relations , Electronic Health Records , Quality Improvement
3.
Front Big Data ; 6: 1206139, 2023.
Article in English | MEDLINE | ID: mdl-37609602

ABSTRACT

The foundations of Artificial Intelligence (AI), a field whose applications are of great use and concern for society, can be traced back to the early years of the second half of the 20th century. Since then, the field has seen increased research output and funding cycles followed by setbacks. The new millennium has seen unprecedented interest in AI progress and expectations with significant financial investments from the public and private sectors. However, the continual acceleration of AI capabilities and real-world applications is not guaranteed. Mainly, accountability of AI systems in the context of the interplay between AI and the broader society is essential for adopting AI systems via the trust placed in them. Continual progress in AI research and development (R&D) can help tackle humanity's most significant challenges to improve social good. The authors of this paper suggest that the careful design of forward-looking research policies serves a crucial function in avoiding potential future setbacks in AI research, development, and use. The United States (US) has kept its leading role in R&D, mainly shaping the global trends in the field. Accordingly, this paper presents a critical assessment of the US National AI R&D Strategic Plan and prescribes six recommendations to improve future research strategies in the US and around the globe.

4.
Ann Fam Med ; 20(6): 559-563, 2022.
Article in English | MEDLINE | ID: mdl-36443071

ABSTRACT

The artificial intelligence (AI) revolution has arrived for the health care sector and is finally penetrating the far-reaching but perpetually underfinanced primary care platform. While AI has the potential to facilitate the achievement of the Quintuple Aim (better patient outcomes, population health, and health equity at lower costs while preserving clinician well-being), inattention to primary care training in the use of AI-based tools risks the opposite effects, imposing harm and exacerbating inequalities. The impact of AI-based tools on these aims will depend heavily on the decisions and skills of primary care clinicians; therefore, appropriate medical education and training will be crucial to maximize potential benefits and minimize harms. To facilitate this training, we propose 6 domains of competency for the effective deployment of AI-based tools in primary care: (1) foundational knowledge (what is this tool?), (2) critical appraisal (should I use this tool?), (3) medical decision making (when should I use this tool?), (4) technical use (how do I use this tool?), (5) patient communication (how should I communicate with patients regarding the use of this tool?), and (6) awareness of unintended consequences (what are the "side effects" of this tool?). Integrating these competencies will not be straightforward because of the breadth of knowledge already incorporated into family medicine training and the constantly changing technological landscape. Nonetheless, even incremental increases in AI-relevant training may be beneficial, and the sooner these challenges are tackled, the sooner the primary care workforce and those served by it will begin to reap the benefits.


Subject(s)
Artificial Intelligence , Technology , Humans , Clinical Decision-Making , Communication , Primary Health Care
5.
Vaccines (Basel) ; 10(8)2022 Aug 09.
Article in English | MEDLINE | ID: mdl-36016170

ABSTRACT

Hispanic communities have been disproportionately affected by economic disparities. These inequalities have put Hispanics at an increased risk for preventable health conditions. In addition, the CDC reports Hispanics to have 1.5× COVID-19 infection rates and low vaccination rates. This study aims to identify the driving factors for COVID-19 vaccine hesitancy of Hispanic survey participants in the Rio Grande Valley. Our analysis used machine learning methods to identify significant associations between medical, economic, and social factors impacting the uptake and willingness to receive the COVID-19 vaccine. A combination of three classification methods (i.e., logistic regression, decision trees, and support vector machines) was used to classify observations based on the value of the targeted responses received and extract a robust subset of factors. Our analysis revealed different medical, economic, and social associations that correlate to other target population groups (i.e., males and females). According to the analysis performed on males, the Matthews correlation coefficient (MCC) value was 0.972. An MCC score of 0.805 was achieved by analyzing females, while the analysis of males and females achieved 0.797. Specifically, several medical, economic factors, and sociodemographic characteristics are more prevalent in vaccine-hesitant groups, such as asthma, hypertension, mental health problems, financial strain due to COVID-19, gender, lack of health insurance plans, and limited test availability.

6.
Healthc (Amst) ; 10(1): 100594, 2022 Mar.
Article in English | MEDLINE | ID: mdl-34954571

ABSTRACT

Primary care is the largest healthcare delivery platform in the US. Facing the Artificial Intelligence and Machine Learning technology (AI/ML) revolution, the primary care community would benefit from a roadmap revealing priority areas and opportunities for developing and integrating AI/ML-driven clinical tools. This article presents a framework that identifies five domains for AI/ML integration in primary care to support care delivery transformation and achieve the Quintuple Aims of the healthcare system. We concluded that primary care plays a critical role in developing, introducing, implementing, and monitoring AI/ML tools in healthcare and must not be overlooked as AI/ML transforms healthcare.


Subject(s)
Artificial Intelligence , Machine Learning , Delivery of Health Care , Health Facilities , Humans , Primary Health Care
8.
J Biomed Inform ; 119: 103818, 2021 07.
Article in English | MEDLINE | ID: mdl-34022420

ABSTRACT

OBJECTIVE: Study the impact of local policies on near-future hospitalization and mortality rates. MATERIALS AND METHODS: We introduce a novel risk-stratified SIR-HCD model that introduces new variables to model the dynamics of low-contact (e.g., work from home) and high-contact (e.g., work on-site) subpopulations while sharing parameters to control their respective R0(t) over time. We test our model on data of daily reported hospitalizations and cumulative mortality of COVID-19 in Harris County, Texas, from May 1, 2020, until October 4, 2020, collected from multiple sources (USA FACTS, U.S. Bureau of Labor Statistics, Southeast Texas Regional Advisory Council COVID-19 report, TMC daily news, and Johns Hopkins University county-level mortality reporting). RESULTS: We evaluated our model's forecasting accuracy in Harris County, TX (the most populated county in the Greater Houston area) during Phase-I and Phase-II reopening. Not only does our model outperform other competing models, but it also supports counterfactual analysis to simulate the impact of future policies in a local setting, which is unique among existing approaches. DISCUSSION: Mortality and hospitalization rates are significantly impacted by local quarantine and reopening policies. Existing models do not directly account for the effect of these policies on infection, hospitalization, and death rates in an explicit and explainable manner. Our work is an attempt to improve prediction of these trends by incorporating this information into the model, thus supporting decision-making. CONCLUSION: Our work is a timely effort to attempt to model the dynamics of pandemics under the influence of local policies.


Subject(s)
COVID-19 , Hospitalization , Humans , Pandemics , Policy , SARS-CoV-2 , United States
10.
J Vis Exp ; (155)2020 01 14.
Article in English | MEDLINE | ID: mdl-32009650

ABSTRACT

Dynamics of development can be followed by confocal time-lapse microscopy of live transgenic zebrafish embryos expressing fluorescence in specific tissues or cells. A difficulty with imaging whole embryo development is that zebrafish embryos grow substantially in length. When mounted as regularly done in 0.3-1% low melt agarose, the agarose imposes growth restriction, leading to distortions in the soft embryo body. Yet, to perform confocal time-lapse microscopy, the embryo must be immobilized. This article describes a layered mounting method for zebrafish embryos that restrict the motility of the embryos while allowing for the unrestricted growth. The mounting is performed in layers of agarose at different concentrations. To demonstrate the usability of this method, whole embryo vascular, neuronal and muscle development was imaged in transgenic fish for 55 consecutive hours. This mounting method can be used for easy, low-cost imaging of whole zebrafish embryos using inverted microscopes without requirements of molds or special equipment.


Subject(s)
Animals, Genetically Modified/growth & development , Embryonic Development/physiology , Microscopy, Confocal/methods , Time-Lapse Imaging/methods , Animals , Zebrafish
12.
IEEE Winter Conf Appl Comput Vis ; 2020 IEEE Winter Conference on Applications of Computer Vision: 2674-2683, 2020 May 14.
Article in English | MEDLINE | ID: mdl-38468706

ABSTRACT

Surveillance-related datasets that have been released in recent years focus only on one specific problem at a time (e.g., pedestrian detection, face detection, or face recognition), while most of them were collected using visible spectrum (VIS) cameras. Even though some cross-spectral datasets were presented in the past, they were acquired in a constrained setup, which limited the performance of methods for the aforementioned problems under a cross-spectral setting. This work introduces a new dataset, named EDGE19, that can be used in addressing the problems of pedestrian detection, face detection, and face recognition in images captured using trail cameras under the VIS and NIR spectra. Data acquisition was performed in an outdoor environment, during both day and night, under unconstrained acquisition conditions. The collection of images is accompanied by a rich set of annotations, consisting of person and facial bounding boxes, unique subject identifiers, and labels that characterize facial images as frontal, profile, or back faces. Moreover, the performance of several state-of-the-art methods was evaluated for each of the scenarios covered by our dataset. The baseline results we obtained highlight the difficulty of current methods in the tasks of cross-spectral pedestrian detection, face detection, and face recognition due to unconstrained conditions, including low resolution, pose variation, illumination variation, occlusions, and motion blur.

13.
Ethn Health ; 24(7): 754-766, 2019 10.
Article in English | MEDLINE | ID: mdl-28922931

ABSTRACT

Background: The study of physical activity in cancer survivors has been limited to one cause, one effect relationships. In this exploratory study, we used recursive partitioning to examine multiple correlates that influence physical activity compliance rates in cancer survivors. Methods: African American breast cancer survivors (N = 267, Mean age = 54 years) participated in an online survey that examined correlates of physical activity. Recursive partitioning (RP) was used to examine complex and nonlinear associations between sociodemographic, medical, cancer-related, theoretical, and quality of life indicators. Results: Recursive partitioning revealed five distinct groups. Compliance with physical activity guidelines was highest (82% met guidelines) among survivors who reported higher mean action planning scores (P < 0.001) and lower mean barriers to physical activity (P = 0.035). Compliance with physical activity guidelines was lowest (9% met guidelines) among survivors who reported lower mean action and coping (P = 0.002) planning scores. Similarly, lower mean action planning scores and poor advanced lower functioning (P = 0.034), even in the context of higher coping planning scores, resulted in low physical activity compliance rates (13% met guidelines). Subsequent analyses revealed that body mass index (P = 0.019) and number of comorbidities (P = 0.003) were lowest in those with the highest compliance rates. Conclusion: Our findings support the notion that multiple factors determine physical activity compliance rates in African American breast cancer survivors. Interventions that encourage action and coping planning and reduce barriers in the context of addressing function limitations may increase physical activity compliance rates.


Subject(s)
Breast Neoplasms/psychology , Cancer Survivors/psychology , Decision Trees , Exercise/psychology , Patient Compliance , Black or African American/psychology , Breast Neoplasms/ethnology , Female , Humans , Middle Aged , Patient Compliance/ethnology , Patient Compliance/psychology , Quality of Life
14.
J Am Heart Assoc ; 7(22): e009476, 2018 11 20.
Article in English | MEDLINE | ID: mdl-30571498

ABSTRACT

Background Studies have demonstrated that the current US guidelines based on American College of Cardiology/American Heart Association (ACC/AHA) Pooled Cohort Equations Risk Calculator may underestimate risk of atherosclerotic cardiovascular disease ( CVD ) in certain high-risk individuals, therefore missing opportunities for intensive therapy and preventing CVD events. Similarly, the guidelines may overestimate risk in low risk populations resulting in unnecessary statin therapy. We used Machine Learning ( ML ) to tackle this problem. Methods and Results We developed a ML Risk Calculator based on Support Vector Machines ( SVM s) using a 13-year follow up data set from MESA (the Multi-Ethnic Study of Atherosclerosis) of 6459 participants who were atherosclerotic CVD-free at baseline. We provided identical input to both risk calculators and compared their performance. We then used the FLEMENGHO study (the Flemish Study of Environment, Genes and Health Outcomes) to validate the model in an external cohort. ACC / AHA Risk Calculator, based on 7.5% 10-year risk threshold, recommended statin to 46.0%. Despite this high proportion, 23.8% of the 480 "Hard CVD " events occurred in those not recommended statin, resulting in sensitivity 0.76, specificity 0.56, and AUC 0.71. In contrast, ML Risk Calculator recommended only 11.4% to take statin, and only 14.4% of "Hard CVD " events occurred in those not recommended statin, resulting in sensitivity 0.86, specificity 0.95, and AUC 0.92. Similar results were found for prediction of "All CVD " events. Conclusions The ML Risk Calculator outperformed the ACC/AHA Risk Calculator by recommending less drug therapy, yet missing fewer events. Additional studies are underway to validate the ML model in other cohorts and to explore its ability in short-term CVD risk prediction.


Subject(s)
Cardiovascular Diseases/diagnosis , Machine Learning , Risk Assessment/methods , Aged , Cardiovascular Diseases/etiology , Cardiovascular Diseases/prevention & control , Coronary Artery Disease/diagnosis , Coronary Artery Disease/etiology , Coronary Artery Disease/prevention & control , Female , Humans , Hydroxymethylglutaryl-CoA Reductase Inhibitors/therapeutic use , Male , Middle Aged , Risk Factors , Sensitivity and Specificity , Support Vector Machine
15.
Anatol J Cardiol ; 20(2): 117-124, 2018 Aug.
Article in English | MEDLINE | ID: mdl-30088486

ABSTRACT

OBJECTIVE: Neoangiogenesis is pathophysiologically related to atherosclerotic plaque growth and vulnerability. We examined the in vivo performance of a computational method using contrast-enhanced intravascular ultrasound (CE-IVUS) to detect and quantify aortic wall neovascularization in rabbits. We also compared these findings with histological data. METHODS: Nine rabbits were fed with a hyperlipidemic diet. IVUS image sequences were continuously recorded before and after the injection of a contrast agent. Mean enhancement of intensity of a region of interest (MEIR) was calculated using differential imaging algorithm. The percent difference of MEIR before and after the injection of microbubbles (d_MEIR) was used as an index of the density of plaque or/and adventitial neovascularization. Aortic segments were excised for histological analysis. RESULTS: CE-IVUS and histological analysis were performed in 11 arterial segments. MEIR was significantly increased (~20%) after microbubble injection (from 8.1±0.9 to 9.7±1.8, p=0.016). Segments with increased VV/neovessels in the tunica adventitia (histological scores 2 and 3) had significantly higher d_MEIR compared with segments with low presence of VV/neovessels (score 1); 40.5±22.9 vs. 8±14.6, p=0.024, respectively. CONCLUSION: It is possible to detect VV or neovessels in vivo using computational analysis of CE-IVUS images, which is in agreement with histological data. These findings may have critical implications on vulnerable plaque assessment and risk stratification.


Subject(s)
Neovascularization, Pathologic/diagnostic imaging , Plaque, Atherosclerotic/diagnostic imaging , Vasa Vasorum/diagnostic imaging , Animals , Contrast Media , Disease Models, Animal , Male , Neovascularization, Pathologic/physiopathology , Plaque, Atherosclerotic/physiopathology , Rabbits , Ultrasonography , Vasa Vasorum/physiopathology
16.
IEEE Trans Cybern ; 47(3): 612-625, 2017 Mar.
Article in English | MEDLINE | ID: mdl-26890943

ABSTRACT

In this paper, we first offer an overview of advances in the field of distance metric learning. Then, we empirically compare selected methods using a common experimental protocol. The number of distance metric learning algorithms proposed keeps growing due to their effectiveness and wide application. However, existing surveys are either outdated or they focus only on a few methods. As a result, there is an increasing need to summarize the obtained knowledge in a concise, yet informative manner. Moreover, existing surveys do not conduct comprehensive experimental comparisons. On the other hand, individual distance metric learning papers compare the performance of the proposed approach with only a few related methods and under different settings. This highlights the need for an experimental evaluation using a common and challenging protocol. To this end, we conduct face verification experiments, as this task poses significant challenges due to varying conditions during data acquisition. In addition, face verification is a natural application for distance metric learning because the encountered challenge is to define a distance function that: 1) accurately expresses the notion of similarity for verification; 2) is robust to noisy data; 3) generalizes well to unseen subjects; and 4) scales well with the dimensionality and number of training samples. In particular, we utilize well-tested features to assess the performance of selected methods following the experimental protocol of the state-of-the-art database labeled faces in the wild. A summary of the results is presented along with a discussion of the insights obtained and lessons learned by employing the corresponding algorithms.

17.
Comput Biol Med ; 75: 19-29, 2016 08 01.
Article in English | MEDLINE | ID: mdl-27235803

ABSTRACT

Intravascular ultrasound (IVUS) refers to the medical imaging technique consisting of a miniaturized ultrasound transducer located at the tip of a catheter that can be introduced in the blood vessels providing high-resolution, cross-sectional images of their interior. Current methods for the generation of an IVUS image reconstruction from radio frequency (RF) data do not account for the physics involved in the interaction between the IVUS ultrasound signal and the tissues of the vessel. In this paper, we present a novel method to generate an IVUS image reconstruction based on the use of a scattering model that considers the tissues of the vessel as a distribution of three-dimensional point scatterers. We evaluated the impact of employing the proposed IVUS image reconstruction method in the segmentation of the lumen/wall interface on 40MHz IVUS data using an existing automatic lumen segmentation method. We compared the results with those obtained using the B-mode reconstruction on 600 randomly selected frames from twelve pullback sequences acquired from rabbit aortas and different arteries of swine. Our results indicate the feasibility of employing the proposed IVUS image reconstruction for the segmentation of the lumen.


Subject(s)
Aorta/diagnostic imaging , Image Processing, Computer-Assisted/methods , Models, Theoretical , Ultrasonography/methods , Animals , Humans , Rabbits , Swine
18.
J Neurosci Methods ; 266: 94-106, 2016 06 15.
Article in English | MEDLINE | ID: mdl-27038663

ABSTRACT

BACKGROUND: High resolution multiphoton and confocal microscopy has allowed the acquisition of large amounts of data to be analyzed by neuroscientists. However, manual processing of these images has become infeasible. Thus, there is a need to create automatic methods for the morphological reconstruction of 3D neuronal image stacks. NEW METHOD: An algorithm to extract the 3D morphology from a neuron is presented. The main contribution of the paper is the segmentation of the neuron from the background. Our segmentation method is based on one-class classification where the 3D image stack is analyzed at different scales. First, a multi-scale approach is proposed to compute the Laplacian of the 3D image stack. The Laplacian is used to select a training set consisting of background points. A decision function is learned for each scale from the training set that allows determining how similar an unlabeled point is to the points in the background class. Foreground points (dendrites and axons) are assigned as those points that are rejected as background. Finally, the morphological reconstruction of the neuron is extracted by applying a state-of-the-art centerline tracing algorithm on the segmentation. RESULTS: Quantitative and qualitative results on several datasets demonstrate the ability of our algorithm to accurately and robustly segment and trace neurons. COMPARISON WITH EXISTING METHOD(S): Our method was compared to state-of-the-art neuron tracing algorithms. CONCLUSIONS: Our approach allows segmentation of thin and low contrast dendrites that are usually difficult to segment. Compared to our previous approach, this algorithm is more accurate and much faster.


Subject(s)
Algorithms , Imaging, Three-Dimensional/methods , Microscopy/methods , Neurons/cytology , Animals , Anura , Brain/cytology , Chickens , Drosophila , Humans , Mice , Models, Theoretical
19.
Anaerobe ; 40: 10-4, 2016 Aug.
Article in English | MEDLINE | ID: mdl-27108094

ABSTRACT

Clostridium difficile is a significant cause of nosocomial-acquired infection that results in severe diarrhea and can lead to mortality. Treatment options for C. difficile infection (CDI) are limited, however, new antibiotics are being developed. Current methods for determining efficacy of experimental antibiotics on C. difficile involve antibiotic killing rates and do not give insight into the drug's pharmacologic effects. Considering this, we hypothesized that by using scanning electron microscopy (SEM) in tandem to drug killing curves, we would be able to determine efficacy and visualize the phenotypic response to drug treatment. To test this hypothesis, supraMIC kill curves were conducted using vancomycin, metronidazole, fidaxomicin, and ridinilazole. Following collection, cells were either plated or imaged using a scanning electron microscope (SEM). Consistent with previous reports, we found that the tested antibiotics had significant bactericidal activity at supraMIC concentrations. By SEM imaging and using a semi-automatic pipeline for image analysis, we were able to determine that vancomycin and to a lesser extent fidaxomicin and ridinilazole significantly affected the cell wall, whereas metronidazole, fidaxomicin, and ridinilazole had significant effects on cell length suggesting a metabolic effect. While the phenotypic response to drug treatment has not been documented previously in this manner, the results observed are consistent with the drug's mechanism of action. These techniques demonstrate the versatility and reliability of imaging and measurements that could be applied to other experimental compounds. We believe the strategies laid out here are vital for characterizing new antibiotics in development for treating CDI.


Subject(s)
Anti-Bacterial Agents/pharmacology , Cell Wall/drug effects , Clostridioides difficile/drug effects , Optical Imaging/methods , Agar/chemistry , Aminoglycosides/pharmacology , Cell Wall/ultrastructure , Clostridioides difficile/ultrastructure , Culture Media/chemistry , Fidaxomicin , Metronidazole/pharmacology , Microbial Sensitivity Tests , Microscopy, Electron, Scanning , Vancomycin/pharmacology
20.
IEEE Trans Cybern ; 46(9): 2042-55, 2016 Sep.
Article in English | MEDLINE | ID: mdl-26316289

ABSTRACT

People with low vision, Alzheimer's disease, and autism spectrum disorder experience difficulties in perceiving or interpreting facial expression of emotion in their social lives. Though automatic facial expression recognition (FER) methods on 2-D videos have been extensively investigated, their performance was constrained by challenges in head pose and lighting conditions. The shape information in 3-D facial data can reduce or even overcome these challenges. However, high expenses of 3-D cameras prevent their widespread use. Fortunately, 2.5-D facial data from emerging portable RGB-D cameras provide a good balance for this dilemma. In this paper, we propose an automatic emotion annotation solution on 2.5-D facial data collected from RGB-D cameras. The solution consists of a facial landmarking method and a FER method. Specifically, we propose building a deformable partial face model and fit the model to a 2.5-D face for localizing facial landmarks automatically. In FER, a novel action unit (AU) space-based FER method has been proposed. Facial features are extracted using landmarks and further represented as coordinates in the AU space, which are classified into facial expressions. Evaluated on three publicly accessible facial databases, namely EURECOM, FRGC, and Bosphorus databases, the proposed facial landmarking and expression recognition methods have achieved satisfactory results. Possible real-world applications using our algorithms have also been discussed.


Subject(s)
Anatomic Landmarks , Emotions , Facial Expression , Pattern Recognition, Automated/methods , Self-Help Devices , Anatomic Landmarks/anatomy & histology , Anatomic Landmarks/physiology , Databases, Factual , Emotions/classification , Emotions/physiology , Equipment Design , Eyeglasses , Face/anatomy & histology , Face/physiology , Female , Humans , Interpersonal Relations , Male , Video Recording/instrumentation
SELECTION OF CITATIONS
SEARCH DETAIL
...