Development of a compressed FCN architecture for semantic segmentation using Particle Swarm Optimization.

Researchers have adapted the conventional deep learning classification networks to generate Fully Conventional Networks (FCN) for carrying out accurate semantic segmentation. However, such models are expensive both in terms of storage and inference time and not readily employable on edge devices. In this paper, a compressed version of VGG16-based Fully Convolution Network (FCN) has been developed using Particle Swarm Optimization. It has been shown that the developed model can offer tremendous saving in storage space and also faster inference time, and can be implemented on edge devices. The efficacy of the proposed approach has been tested using potato late blight leaf images from publicly available PlantVillage dataset, street scene image dataset and lungs X-Ray dataset and it has been shown that it approaches the accuracies offered by standard FCN even after 851× compression.

NeoAI 1.0: Machine learning-based paradigm for prediction of neonatal and infant risk of death.

BACKGROUND: The Neonatal mortality rate in the United States is 3.8 deaths per 1000 live births, which is comparably higher than other nations. PURPOSE: The aim of the proposed study is to design and develop Artificial Intelligence (AI) models (NeoAI 1.0, Global Biomedical Technologies, Inc., Roseville, CA, USA) on risk variables extracted from the National Center for Health Statistics (NCHS) data from 2014 to 2017 duration, consisting of birth-death infant files to predict neonatal and infant deaths. METHODOLOGY: The NCHS data consisted of 15.8 million live birth records, including 91,773 infant deaths, out of which 61,222 were neonatal (life <28 days) and the rest were non-deaths. We designed and developed two different kinds of systems, labelled as neonatal and infant death systems. The data preparation consisted of balancing the two classes using the Adaptive Synthetic oversampling technique (ADASYN) paradigm. The best features were extracted using mutual information followed by 5-fold cross-validation using four different models, namely AdaBoost, XGBoost, Random Forest, and Logistic Regression based on balanced and unbalanced paradigms. RESULTS: XGBoost gave the best results for the neonatal system with AUC of 0.97 and 0.99 (p < 0.0001), while for the infant system, the scores were 0.91 and 0.99, both systems, without/with ADASYN integration, respectively. Further, there was a 60% increase in F1-score and sensitivity with ADASYN integration. The most important risk factors for classifier models along with feature extraction were maternal age and maternal race by Hispanic classification. Further, gestational age, labour aid and newborn condition were also part of the top five risk factors for these models. CONCLUSIONS: NoeAI showed two independent powerful machine learning (ML) systems and selected the best risk predictors combined with classification models for neonatal and infant deaths. The response time of the online platform was less than a second.

Cardiovascular disease detection using machine learning and carotid/femoral arterial imaging frameworks in rheumatoid arthritis patients.

The study proposes a novel machine learning (ML) paradigm for cardiovascular disease (CVD) detection in individuals at medium to high cardiovascular risk using data from a Greek cohort of 542 individuals with rheumatoid arthritis, or diabetes mellitus, and/or arterial hypertension, using conventional or office-based, laboratory-based blood biomarkers and carotid/femoral ultrasound image-based phenotypes. Two kinds of data (CVD risk factors and presence of CVD-defined as stroke, or myocardial infarction, or coronary artery syndrome, or peripheral artery disease, or coronary heart disease) as ground truth, were collected at two-time points: (i) at visit 1 and (ii) at visit 2 after 3 years. The CVD risk factors were divided into three clusters (conventional or office-based, laboratory-based blood biomarkers, carotid ultrasound image-based phenotypes) to study their effect on the ML classifiers. Three kinds of ML classifiers (Random Forest, Support Vector Machine, and Linear Discriminant Analysis) were applied in a two-fold cross-validation framework using the data augmented by synthetic minority over-sampling technique (SMOTE) strategy. The performance of the ML classifiers was recorded. In this cohort with overall 46 CVD risk factors (covariates) implemented in an online cardiovascular framework, that requires calculation time less than 1 s per patient, a mean accuracy and area-under-the-curve (AUC) of 98.40% and 0.98 (p < 0.0001) for CVD presence detection at visit 1, and 98.39% and 0.98 (p < 0.0001) at visit 2, respectively. The performance of the cardiovascular framework was significantly better than the classical CVD risk score. The ML paradigm proved to be powerful for CVD prediction in individuals at medium to high cardiovascular risk.

Human activity recognition in artificial intelligence framework: a narrative review.

Human activity recognition (HAR) has multifaceted applications due to its worldly usage of acquisition devices such as smartphones, video cameras, and its ability to capture human activity data. While electronic devices and their applications are steadily growing, the advances in Artificial intelligence (AI) have revolutionized the ability to extract deep hidden information for accurate detection and its interpretation. This yields a better understanding of rapidly growing acquisition devices, AI, and applications, the three pillars of HAR under one roof. There are many review articles published on the general characteristics of HAR, a few have compared all the HAR devices at the same time, and few have explored the impact of evolving AI architecture. In our proposed review, a detailed narration on the three pillars of HAR is presented covering the period from 2011 to 2021. Further, the review presents the recommendations for an improved HAR design, its reliability, and stability. Five major findings were: (1) HAR constitutes three major pillars such as devices, AI and applications; (2) HAR has dominated the healthcare industry; (3) Hybrid AI models are in their infancy stage and needs considerable work for providing the stable and reliable design. Further, these trained models need solid prediction, high accuracy, generalization, and finally, meeting the objectives of the applications without bias; (4) little work was observed in abnormality detection during actions; and (5) almost no work has been done in forecasting actions. We conclude that: (a) HAR industry will evolve in terms of the three pillars of electronic devices, applications and the type of AI. (b) AI will provide a powerful impetus to the HAR industry in future. Supplementary Information: The online version contains supplementary material available at 10.1007/s10462-021-10116-x.

A hybrid deep learning paradigm for carotid plaque tissue characterization and its validation in multicenter cohorts using a supercomputer framework.

BACKGROUND: Early and automated detection of carotid plaques prevents strokes, which are the second leading cause of death worldwide according to the World Health Organization. Artificial intelligence (AI) offers automated solutions for plaque tissue characterization. Recently, solo deep learning (SDL) models have been used, but they do not take advantage of the tandem connectivity offered by AI's hybrid nature. Therefore, this study explores the use of hybrid deep learning (HDL) models in a multicenter framework, making this study the first of its kind. METHODS: We hypothesize that HDL techniques perform better than SDL and transfer learning (TL) techniques. We propose two kinds of HDL frameworks: (i) the fusion of two SDLs (Inception with ResNet) or (ii) 10 other kinds of tandem models that fuse SDL with ML. The system Atheromatic™ 2.0HDL (AtheroPoint, CA, USA) was designed on an augmentation framework and three kinds of loss functions (cross-entropy, hinge, and mean-square-error) during training to determine the best optimization paradigm. These 11 combined HDL models were then benchmarked against one SDL model and five types of TL models; thus, this study considers a total of 17 AI models. RESULTS: Among the 17 AI models, the best performing HDL system was that comprising CNN and decision tree (DT), as its accuracy and area-under-the-curve were 99.78 ± 1.05% and 0.99 (p<0.0001), respectively. These values are 6.4% and 3.2% better than those recorded for the SDL and TL models, respectively. We validated the performance of the HDL models with diagnostics odds ratio (DOR) and Cohen and Kappa statistics; here, HDL outperformed DL and TL by 23% and 7%, respectively. The online system ran in <2 s. CONCLUSION: HDL is a fast, reliable, and effective tool for characterizing the carotid plaque for early stroke risk stratification.

Inter-Variability Study of COVLIAS 1.0: Hybrid Deep Learning Models for COVID-19 Lung Segmentation in Computed Tomography.

Background: For COVID-19 lung severity, segmentation of lungs on computed tomography (CT) is the first crucial step. Current deep learning (DL)-based Artificial Intelligence (AI) models have a bias in the training stage of segmentation because only one set of ground truth (GT) annotations are evaluated. We propose a robust and stable inter-variability analysis of CT lung segmentation in COVID-19 to avoid the effect of bias. Methodology: The proposed inter-variability study consists of two GT tracers for lung segmentation on chest CT. Three AI models, PSP Net, VGG-SegNet, and ResNet-SegNet, were trained using GT annotations. We hypothesized that if AI models are trained on the GT tracings from multiple experience levels, and if the AI performance on the test data between these AI models is within the 5% range, one can consider such an AI model robust and unbiased. The K5 protocol (training to testing: 80%:20%) was adapted. Ten kinds of metrics were used for performance evaluation. Results: The database consisted of 5000 CT chest images from 72 COVID-19-infected patients. By computing the coefficient of correlations (CC) between the output of the two AI models trained corresponding to the two GT tracers, computing their differences in their CC, and repeating the process for all three AI-models, we show the differences as 0%, 0.51%, and 2.04% (all < 5%), thereby validating the hypothesis. The performance was comparable; however, it had the following order: ResNet-SegNet > PSP Net > VGG-SegNet. Conclusions: The AI models were clinically robust and stable during the inter-variability analysis on the CT lung segmentation on COVID-19 patients.

Ten Fast Transfer Learning Models for Carotid Ultrasound Plaque Tissue Characterization in Augmentation Framework Embedded with Heatmaps for Stroke Risk Stratification.

Background and Purpose: Only 1-2% of the internal carotid artery asymptomatic plaques are unstable as a result of >80% stenosis. Thus, unnecessary efforts can be saved if these plaques can be characterized and classified into symptomatic and asymptomatic using non-invasive B-mode ultrasound. Earlier plaque tissue characterization (PTC) methods were machine learning (ML)-based, which used hand-crafted features that yielded lower accuracy and unreliability. The proposed study shows the role of transfer learning (TL)-based deep learning models for PTC. Methods: As pertained weights were used in the supercomputer framework, we hypothesize that transfer learning (TL) provides improved performance compared with deep learning. We applied 11 kinds of artificial intelligence (AI) models, 10 of them were augmented and optimized using TL approaches-a class of Atheromatic™ 2.0 TL (AtheroPoint™, Roseville, CA, USA) that consisted of (i-ii) Visual Geometric Group-16, 19 (VGG16, 19); (iii) Inception V3 (IV3); (iv-v) DenseNet121, 169; (vi) XceptionNet; (vii) ResNet50; (viii) MobileNet; (ix) AlexNet; (x) SqueezeNet; and one DL-based (xi) SuriNet-derived from UNet. We benchmark 11 AI models against our earlier deep convolutional neural network (DCNN) model. Results: The best performing TL was MobileNet, with accuracy and area-under-the-curve (AUC) pairs of 96.10 ± 3% and 0.961 (p < 0.0001), respectively. In DL, DCNN was comparable to SuriNet, with an accuracy of 95.66% and 92.7 ± 5.66%, and an AUC of 0.956 (p < 0.0001) and 0.927 (p < 0.0001), respectively. We validated the performance of the AI architectures with established biomarkers such as greyscale median (GSM), fractal dimension (FD), higher-order spectra (HOS), and visual heatmaps. We benchmarked against previously developed Atheromatic™ 1.0 ML and showed an improvement of 12.9%. Conclusions: TL is a powerful AI tool for PTC into symptomatic and asymptomatic plaques.

Multimodality carotid plaque tissue characterization and classification in the artificial intelligence paradigm: a narrative review for stroke application.

Cardiovascular disease (CVD) is one of the leading causes of morbidity and mortality in the United States of America and globally. Carotid arterial plaque, a cause and also a marker of such CVD, can be detected by various non-invasive imaging modalities such as magnetic resonance imaging (MRI), computer tomography (CT), and ultrasound (US). Characterization and classification of carotid plaque-type in these imaging modalities, especially into symptomatic and asymptomatic plaque, helps in the planning of carotid endarterectomy or stenting. It can be challenging to characterize plaque components due to (I) partial volume effect in magnetic resonance imaging (MRI) or (II) varying Hausdorff values in plaque regions in CT, and (III) attenuation of echoes reflected by the plaque during US causing acoustic shadowing. Artificial intelligence (AI) methods have become an indispensable part of healthcare and their applications to the non-invasive imaging technologies such as MRI, CT, and the US. In this narrative review, three main types of AI models (machine learning, deep learning, and transfer learning) are analyzed when applied to MRI, CT, and the US. A link between carotid plaque characteristics and the risk of coronary artery disease is presented. With regard to characterization, we review tools and techniques that use AI models to distinguish carotid plaque types based on signal processing and feature strengths. We conclude that AI-based solutions offer an accurate and robust path for tissue characterization and classification for carotid artery plaque imaging in all three imaging modalities. Due to cost, user-friendliness, and clinical effectiveness, AI in the US has dominated the most.

COVLIAS 1.0: Lung Segmentation in COVID-19 Computed Tomography Scans Using Hybrid Deep Learning Artificial Intelligence Models.

BACKGROUND: COVID-19 lung segmentation using Computed Tomography (CT) scans is important for the diagnosis of lung severity. The process of automated lung segmentation is challenging due to (a) CT radiation dosage and (b) ground-glass opacities caused by COVID-19. The lung segmentation methodologies proposed in 2020 were semi- or automated but not reliable, accurate, and user-friendly. The proposed study presents a COVID Lung Image Analysis System (COVLIAS 1.0, AtheroPoint™, Roseville, CA, USA) consisting of hybrid deep learning (HDL) models for lung segmentation. METHODOLOGY: The COVLIAS 1.0 consists of three methods based on solo deep learning (SDL) or hybrid deep learning (HDL). SegNet is proposed in the SDL category while VGG-SegNet and ResNet-SegNet are designed under the HDL paradigm. The three proposed AI approaches were benchmarked against the National Institute of Health (NIH)-based conventional segmentation model using fuzzy-connectedness. A cross-validation protocol with a 40:60 ratio between training and testing was designed, with 10% validation data. The ground truth (GT) was manually traced by a radiologist trained personnel. For performance evaluation, nine different criteria were selected to perform the evaluation of SDL or HDL lung segmentation regions and lungs long axis against GT. RESULTS: Using the database of 5000 chest CT images (from 72 patients), COVLIAS 1.0 yielded AUC of ~0.96, ~0.97, ~0.98, and ~0.96 (p-value < 0.001), respectively within 5% range of GT area, for SegNet, VGG-SegNet, ResNet-SegNet, and NIH. The mean Figure of Merit using four models (left and right lung) was above 94%. On benchmarking against the National Institute of Health (NIH) segmentation method, the proposed model demonstrated a 58% and 44% improvement in ResNet-SegNet, 52% and 36% improvement in VGG-SegNet for lung area, and lung long axis, respectively. The PE statistics performance was in the following order: ResNet-SegNet > VGG-SegNet > NIH > SegNet. The HDL runs in <1 s on test data per image. CONCLUSIONS: The COVLIAS 1.0 system can be applied in real-time for radiology-based clinical settings.

Six artificial intelligence paradigms for tissue characterisation and classification of non-COVID-19 pneumonia against COVID-19 pneumonia in computed tomography lungs.

BACKGROUND: COVID-19 pandemic has currently no vaccines. Thus, the only feasible solution for prevention relies on the detection of COVID-19-positive cases through quick and accurate testing. Since artificial intelligence (AI) offers the powerful mechanism to automatically extract the tissue features and characterise the disease, we therefore hypothesise that AI-based strategies can provide quick detection and classification, especially for radiological computed tomography (CT) lung scans. METHODOLOGY: Six models, two traditional machine learning (ML)-based (k-NN and RF), two transfer learning (TL)-based (VGG19 and InceptionV3), and the last two were our custom-designed deep learning (DL) models (CNN and iCNN), were developed for classification between COVID pneumonia (CoP) and non-COVID pneumonia (NCoP). K10 cross-validation (90% training: 10% testing) protocol on an Italian cohort of 100 CoP and 30 NCoP patients was used for performance evaluation and bispectrum analysis for CT lung characterisation. RESULTS: Using K10 protocol, our results showed the accuracy in the order of DL > TL > ML, ranging the six accuracies for k-NN, RF, VGG19, IV3, CNN, iCNN as 74.58 ± 2.44%, 96.84 ± 2.6, 94.84 ± 2.85%, 99.53 ± 0.75%, 99.53 ± 1.05%, and 99.69 ± 0.66%, respectively. The corresponding AUCs were 0.74, 0.94, 0.96, 0.99, 0.99, and 0.99 (p-values < 0.0001), respectively. Our Bispectrum-based characterisation system suggested CoP can be separated against NCoP using AI models. COVID risk severity stratification also showed a high correlation of 0.7270 (p < 0.0001) with clinical scores such as ground-glass opacities (GGO), further validating our AI models. CONCLUSIONS: We prove our hypothesis by demonstrating that all the six AI models successfully classified CoP against NCoP due to the strong presence of contrasting features such as ground-glass opacities (GGO), consolidations, and pleural effusion in CoP patients. Further, our online system takes < 2 s for inference.

A narrative review on characterization of acute respiratory distress syndrome in COVID-19-infected lungs using artificial intelligence.

COVID-19 has infected 77.4 million people worldwide and has caused 1.7 million fatalities as of December 21, 2020. The primary cause of death due to COVID-19 is Acute Respiratory Distress Syndrome (ARDS). According to the World Health Organization (WHO), people who are at least 60 years old or have comorbidities that have primarily been targeted are at the highest risk from SARS-CoV-2. Medical imaging provides a non-invasive, touch-free, and relatively safer alternative tool for diagnosis during the current ongoing pandemic. Artificial intelligence (AI) scientists are developing several intelligent computer-aided diagnosis (CAD) tools in multiple imaging modalities, i.e., lung computed tomography (CT), chest X-rays, and lung ultrasounds. These AI tools assist the pulmonary and critical care clinicians through (a) faster detection of the presence of a virus, (b) classifying pneumonia types, and (c) measuring the severity of viral damage in COVID-19-infected patients. Thus, it is of the utmost importance to fully understand the requirements of for a fast and successful, and timely lung scans analysis. This narrative review first presents the pathological layout of the lungs in the COVID-19 scenario, followed by understanding and then explains the comorbid statistical distributions in the ARDS framework. The novelty of this review is the approach to classifying the AI models as per the by school of thought (SoTs), exhibiting based on segregation of techniques and their characteristics. The study also discusses the identification of AI models and its extension from non-ARDS lungs (pre-COVID-19) to ARDS lungs (post-COVID-19). Furthermore, it also presents AI workflow considerations of for medical imaging modalities in the COVID-19 framework. Finally, clinical AI design considerations will be discussed. We conclude that the design of the current existing AI models can be improved by considering comorbidity as an independent factor. Furthermore, ARDS post-processing clinical systems must involve include (i) the clinical validation and verification of AI-models, (ii) reliability and stability criteria, and (iii) easily adaptable, and (iv) generalization assessments of AI systems for their use in pulmonary, critical care, and radiological settings.

Wilson disease tissue classification and characterization using seven artificial intelligence models embedded with 3D optimization paradigm on a weak training brain magnetic resonance imaging datasets: a supercomputer application.

Wilson's disease (WD) is caused by copper accumulation in the brain and liver, and if not treated early, can lead to severe disability and death. WD has shown white matter hyperintensity (WMH) in the brain magnetic resonance scans (MRI) scans, but the diagnosis is challenging due to (i) subtle intensity changes and (ii) weak training MRI when using artificial intelligence (AI). Design and validate seven types of high-performing AI-based computer-aided design (CADx) systems consisting of 3D optimized classification, and characterization of WD against controls. We propose a "conventional deep convolution neural network" (cDCNN) and an "improved DCNN" (iDCNN) where rectified linear unit (ReLU) activation function was modified ensuring "differentiable at zero." Three-dimensional optimization was achieved by recording accuracy while changing the CNN layers and augmentation by several folds. WD was characterized using (i) CNN-based feature map strength and (ii) Bispectrum strengths of pixels having higher probabilities of WD. We further computed the (a) area under the curve (AUC), (b) diagnostic odds ratio (DOR), (c) reliability, and (d) stability and (e) benchmarking. Optimal results were achieved using 9 layers of CNN, with 4-fold augmentation. iDCNN yields superior performance compared to cDCNN with accuracy and AUC of 98.28 ± 1.55, 0.99 (p < 0.0001), and 97.19 ± 2.53%, 0.984 (p < 0.0001), respectively. DOR of iDCNN outperformed cDCNN fourfold. iDCNN also outperformed (a) transfer learning-based "Inception V3" paradigm by 11.92% and (b) four types of "conventional machine learning-based systems": k-NN, decision tree, support vector machine, and random forest by 55.13%, 28.36%, 15.35%, and 14.11%, respectively. The AI-based systems can potentially be useful in the early WD diagnosis. Graphical Abstract.

A Novel Block Imaging Technique Using Nine Artificial Intelligence Models for COVID-19 Disease Classification, Characterization and Severity Measurement in Lung Computed Tomography Scans on an Italian Cohort.

Computer Tomography (CT) is currently being adapted for visualization of COVID-19 lung damage. Manual classification and characterization of COVID-19 may be biased depending on the expert's opinion. Artificial Intelligence has recently penetrated COVID-19, especially deep learning paradigms. There are nine kinds of classification systems in this study, namely one deep learning-based CNN, five kinds of transfer learning (TL) systems namely VGG16, DenseNet121, DenseNet169, DenseNet201 and MobileNet, three kinds of machine-learning (ML) systems, namely artificial neural network (ANN), decision tree (DT), and random forest (RF) that have been designed for classification of COVID-19 segmented CT lung against Controls. Three kinds of characterization systems were developed namely (a) Block imaging for COVID-19 severity index (CSI); (b) Bispectrum analysis; and (c) Block Entropy. A cohort of Italian patients with 30 controls (990 slices) and 30 COVID-19 patients (705 slices) was used to test the performance of three types of classifiers. Using K10 protocol (90% training and 10% testing), the best accuracy and AUC was for DCNN and RF pairs were 99.41 ± 5.12%, 0.991 (p < 0.0001), and 99.41 ± 0.62%, 0.988 (p < 0.0001), respectively, followed by other ML and TL classifiers. We show that diagnostics odds ratio (DOR) was higher for DL compared to ML, and both, Bispecturm and Block Entropy shows higher values for COVID-19 patients. CSI shows an association with Ground Glass Opacities (0.9146, p < 0.0001). Our hypothesis holds true that deep learning shows superior performance compared to machine learning models. Block imaging is a powerful novel approach for pinpointing COVID-19 severity and is clinically validated.

Ultrasound-based internal carotid artery plaque characterization using deep learning paradigm on a supercomputer: a cardiovascular disease/stroke risk assessment system.

Visual or manual characterization and classification of atherosclerotic plaque lesions are tedious, error-prone, and time-consuming. The purpose of this study is to develop and design an automated carotid plaque characterization and classification system into binary classes, namely symptomatic and asymptomatic types via the deep learning (DL) framework implemented on a supercomputer. We hypothesize that on ultrasound images, symptomatic carotid plaques have (a) a low grayscale median because of a histologically large lipid core and relatively little collagen and calcium, and (b) a higher chaotic (heterogeneous) grayscale distribution due to the composition. The methodology consisted of building a DL model of Artificial Intelligence (called Atheromatic 2.0, AtheroPoint, CA, USA) that used a classic convolution neural network consisting of 13 layers and implemented on a supercomputer. The DL model used a cross-validation protocol for estimating the classification accuracy (ACC) and area-under-the-curve (AUC). A sample of 346 carotid ultrasound-based delineated plaques were used (196 symptomatic and 150 asymptomatic, mean age 69.9 ± 7.8 years, with 39% females). This was augmented using geometric transformation yielding 2312 plaques (1191 symptomatic and 1120 asymptomatic plaques). K10 (90% training and 10% testing) cross-validation DL protocol was implemented and showed an (i) accuracy and (ii) AUC without and with augmentation of 86.17%, 0.86 (p-value < 0.0001), and 89.7%, 0.91 (p-value < 0.0001), respectively. The DL characterization system consisted of validation of the two hypotheses: (a) mean feature strength (MFS) and (b) Mandelbrot's fractal dimension (FD) for measuring chaotic behavior. We demonstrated that both MFS and FD were higher in symptomatic plaques compared to asymptomatic plaques by 64.15 ± 0.73% (p-value < 0.0001) and 6 ± 0.13% (p-value < 0.0001), respectively. The benchmarking results show that DL with augmentation (ACC: 89.7%, AUC: 0.91 (p-value < 0.0001)) is superior to previously published machine learning (ACC: 83.7%) by 6.0%. The Atheromatic runs the test patient in < 2 s. Deep learning can be a useful tool for carotid ultrasound-based characterization and classification of symptomatic and asymptomatic plaques.

3-D optimized classification and characterization artificial intelligence paradigm for cardiovascular/stroke risk stratification using carotid ultrasound-based delineated plaque: Atheromatic™ 2.0.

BACKGROUND AND PURPOSE: Atherosclerotic plaque tissue rupture is one of the leading causes of strokes. Early carotid plaque monitoring can help reduce cardiovascular morbidity and mortality. Manual ultrasound plaque classification and characterization methods are time-consuming and can be imprecise due to significant variations in tissue characteristics. We report a novel artificial intelligence (AI)-based plaque tissue classification and characterization system. METHODS: We hypothesize that symptomatic plaque is hypoechoic due to its large lipid core and minimal collagen, as well as its heterogeneous makeup. Meanwhile, asymptomatic plaque is hyperechoic due to its small lipid core, abundant collagen, and the fact that it is often calcified. We designed a computer-aided diagnosis (CADx) system consisting of three kinds of deep learning (DL) classification paradigms: Deep Convolutional Neural Network (DCNN), Visual Geometric Group-16 (VGG16), and transfer learning, (tCNN). DCNN was 3-D optimized by varying the number of CNN layers and data augmentation frameworks. The DL systems were benchmarked against four types of machine learning (ML) classification systems, and the CADx system was characterized using two novel strategies consisting of DL mean feature strength (MFS) and a bispectrum model using higher-order spectra. RESULTS: After balancing symptomatic and asymptomatic plaque classes, a five-fold augmentation process was applied, yielding 1000 carotid scans in each class. Then, using a K10 protocol (trained to test the ratio of 90%-10%), tCNN and DCNN yielded accuracy (area under the curve (AUC)) pairs of 83.33%, 0.833 (p < 0.0001) and 95.66%, 0.956 (p < 0.0001), respectively. DCNN was superior to ML by 7.01%. As part of the characterization process, the MFS of the symptomatic plaque was found to be higher compared to the asymptomatic plaque by 17.5% (p < 0.0001). A similar pattern was seen in the bispectrum, which was higher for symptomatic plaque by 5.4% (p < 0.0001). It took <2 s to perform the online CADx process on a supercomputer. CONCLUSIONS: The performance order of the three AI systems was DCNN > tCNN > ML. Bispectrum-based on higher-order spectra proved a powerful paradigm for plaque tissue characterization. Overall, the AI-based systems offer a powerful solution for plaque tissue classification and characterization.