Deep learning of movement behavior profiles and their association with markers of cardiometabolic health.

BACKGROUND: Traditionally, existing studies assessing the health associations of accelerometer-measured movement behaviors have been performed with few averaged values, mainly representing the duration of physical activities and sedentary behaviors. Such averaged values cannot naturally capture the complex interplay between the duration, timing, and patterns of accumulation of movement behaviors, that altogether may be codependently related to health outcomes in adults. In this study, we introduce a novel approach to visually represent recorded movement behaviors as images using original accelerometer outputs. Subsequently, we utilize these images for cluster analysis employing deep convolutional autoencoders. METHODS: Our method involves converting minute-by-minute accelerometer outputs (activity counts) into a 2D image format, capturing the entire spectrum of movement behaviors performed by each participant. By utilizing convolutional autoencoders, we enable the learning of these image-based representations. Subsequently, we apply the K-means algorithm to cluster these learned representations. We used data from 1812 adult (20-65 years) participants in the National Health and Nutrition Examination Survey (NHANES, 2003-2006 cycles) study who worn a hip-worn accelerometer for 7 seven consecutive days and provided valid accelerometer data. RESULTS: Deep convolutional autoencoders were able to learn the image representation, encompassing the entire spectrum of movement behaviors. The images were encoded into 32 latent variables, and cluster analysis based on these learned representations for the movement behavior images resulted in the identification of four distinct movement behavior profiles characterized by varying levels, timing, and patterns of accumulation of movement behaviors. After adjusting for potential covariates, the movement behavior profile characterized as "Early-morning movers" and the profile characterized as "Highest activity" both had lower levels of insulin (P < 0.01 for both), triglycerides (P < 0.05 and P < 0.01, respectively), HOMA-IR (P < 0.01 for both), and plasma glucose (P < 0.05 and P < 0.1, respectively) compared to the "Lowest activity" profile. No significant differences were observed for the "Least sedentary movers" profile compared to the "Lowest activity" profile. CONCLUSIONS: Deep learning of movement behavior profiles revealed that, in addition to duration and patterns of movement behaviors, the timing of physical activity may also be crucial for gaining additional health benefits.

A novel physical activity recognition approach using deep ensemble optimized transformers and reinforcement learning.

In recent years, human physical activity recognition has increasingly attracted attention from different research fields such as healthcare, computer-human interaction, lifestyle monitoring, and athletics. Deep learning models have been extensively employed in developing physical activity recognition systems. To improve these models, their hyperparameters need to be initialized with optimal values. However, tuning these hyperparameters manually is time-consuming and may lead to inaccurate results. Moreover, the application of these models to different data resources and the integration of their results into the overall data processing pipeline are challenging issues in physical activity recognition systems. In this paper, we propose a novel ensemble method for physical activity recognition based on a deep transformer-based time-series classification model that uses heart rate, speed, and distance time-series data to recognize physical activities. In particular, we develop a modified arithmetic optimization algorithm to automatically adjust the optimal values of the classification models' hyperparameters. Moreover, a reinforcement learning-based ensemble approach is proposed to optimally integrate the results of the classification models obtained using heart rate, speed, and distance time-series data and, subsequently, recognize the physical activities. Experiments performed on a real-world dataset demonstrated that the proposed method achieves promising efficiency in comparison to other state-of-the-art models. More specifically, the proposed method increases the performance compared to the second-best performer by around 3.44 %, 9.45 %, 5.43 %, 2.54 %, and 7.53 % based on accuracy, precision, recall, specificity, and F1-score evaluation metrics, respectively.

AccNet24: A deep learning framework for classifying 24-hour activity behaviours from wrist-worn accelerometer data under free-living environments.

OBJECTIVE: Although machine learning techniques have been repeatedly used for activity prediction from wearable devices, accurate classification of 24-hour activity behaviour categories from accelerometry data remains a challenge. We developed and validated a deep learning-based framework for classifying 24-hour activity behaviours from wrist-worn accelerometers. METHODS: Using an openly available dataset with free-living wrist-based raw accelerometry data from 151 participants (aged 18-91 years), we developed a deep learning framework named AccNet24 to classify 24-hour activity behaviours. First, the acceleration signal (x, y, and z-axes) was segmented into 30-second nonoverlapping windows, and signal-to-image conversion was performed for each segment. Deep features were automatically extracted from the signal images using transfer learning and transformed into a lower-dimensional feature space. These transformed features were then employed to classify the activity behaviours as sleep, sedentary behaviour, and light-intensity (LPA) and moderate-to-vigorous physical activity (MVPA) using a bidirectional long short-term memory (BiLSTM) recurrent neural network. AccNet24 was trained and validated with data from 101 and 25 randomly selected participants and tested with the remaining unseen 25 participants. We also extracted 112 hand-crafted time and frequency domain features from 30-second windows and used them as inputs to five commonly used machine learning classifiers, including random forest, support vector machines, artificial neural networks, decision tree, and naïve Bayes to classify the 24-hour activity behaviour categories. RESULTS: Using the same training, validation, and test data and window size, the classification accuracy of AccNet24 outperformed the accuracy of the other five machine learning classification algorithms by 16%-30% on unseen data. CONCLUSION: AccNet24, relying on signal-to-image conversion, deep feature extraction, and BiLSTM achieved consistently high accuracy (>95 %) in classifying the 24-hour activity behaviour categories as sleep, sedentary, LPA, and MVPA. The next generation accelerometry analytics may rely on deep learning techniques for activity prediction.

Replacing sedentary time with physical activity and sleep: Associations with cardiometabolic health markers in adults.

This study aimed to examine the associations of sedentary time, and substituting sedentary time with physical activity and sleep, with cardiometabolic health markers while accounting for a full 24 h of movement and non-movement behaviors, cardiorespiratory fitness (CRF), and other potential confounders. The participants were 4585 members of the Northern Finland Birth Cohort 1966, who wore a hip-worn accelerometer at the age of 46 years for 14 consecutive days. Time spent in sedentary behaviors, light-intensity physical activity (LPA), and moderate-to-vigorous-intensity physical activity (MVPA) were determined from the accelerometer and combined with self-reported sleep duration to obtain the 24-h time use. CRF was estimated from the peak heart rate in a submaximal step test. An isotemporal substitution paradigm was used to examine how sedentary time and substituting sedentary time with an equal amount of LPA, MVPA, or sleep were associated with adiposity markers, blood lipid levels, and fasting glucose and insulin. Sedentary time was independently and adversely associated with the markers of cardiometabolic health, even after adjustment for CRF, but not in partition models including LPA, MVPA, sleep, and CRF. Substituting 60, 45, 30, and 15 min/day of sedentary time with LPA or MVPA was associated with 0.2%-13.7% favorable differences in the cardiometabolic health markers after accounting for LPA, MVPA, sleep, CRF, and other confounders. After adjustment for movement and non-movement behaviors within the 24-h cycle, reallocating additional time to both LPA and MVPA was beneficially associated with markers of cardiometabolic health in middle-aged adults regardless of their CRF level.

Automatic captioning for medical imaging (MIC): a rapid review of literature.

Automatically understanding the content of medical images and delivering accurate descriptions is an emerging field of artificial intelligence that combines skills in both computer vision and natural language processing fields. Medical image captioning is involved in various applications related to diagnosis, treatment, report generation and computer-aided diagnosis to facilitate the decision making and clinical workflows. Unlike generic image captioning, medical image captioning highlights the relationships between image objects and clinical findings, which makes it a very challenging task. Although few review papers have already been published in this field, their coverage is still quite limited and only particular problems are addressed. This motivates the current paper where a rapid review protocol was adopted to review the latest achievements in automatic medical image captioning from the medical domain perspective. We aim through this review to provide the reader with an up-to-date literature in this field by summarizing the key findings and approaches in this field, including the related datasets, applications and limitations as well as highlighting the main competitions, challenges and future directions.

Joint Profiles of Sedentary Time and Physical Activity in Adults and Their Associations with Cardiometabolic Health.

PURPOSE: This study aimed to identify and characterize joint profiles of sedentary time and physical activity among adults and to investigate how these profiles are associated with markers of cardiometabolic health. METHODS: The participants included 3702 of the Northern Finland Birth Cohort 1966 at age 46 yr, who wore a hip-worn accelerometer during waking hours and provided seven consecutive days of valid data. Sedentary time, light-intensity physical activity, and moderate- to vigorous-intensity physical activity on each valid day were obtained, and a data-driven clustering approach ("KmL3D") was used to characterize distinct joint profiles of sedentary time and physical activity intensities. Participants self-reported their sleep duration and performed a submaximal step test with continuous heart rate measurement to estimate their cardiorespiratory fitness (peak heart rate). Linear regression was used to determine the association between joint profiles of sedentary time and physical activities with cardiometabolic health markers, including adiposity markers and blood lipid, glucose, and insulin levels. RESULTS: Four distinct groups were identified: "active couch potatoes" ( n = 1173), "sedentary light movers" ( n = 1199), "sedentary exercisers" ( n = 694), and "movers" ( n = 636). Although sufficiently active, active couch potatoes had the highest daily sedentary time (>10 h) and lowest light-intensity physical activity. Compared with active couch potatoes, sedentary light movers, sedentary exercisers, and movers spent less time in sedentary by performing more physical activity at light-intensity upward and had favorable differences in their cardiometabolic health markers after accounting for potential confounders (1.1%-25.0% lower values depending on the health marker and profile). CONCLUSIONS: After accounting for sleep duration and cardiorespiratory fitness, waking activity profiles characterized by performing more physical activity at light-intensity upward, resulting in less time spent in sedentary, were associated with better cardiometabolic health.

Graph-based relevancy-redundancy gene selection method for cancer diagnosis.

Nowadays, microarray data processing is one of the most important applications in molecular biology for cancer diagnosis. A major task in microarray data processing is gene selection, which aims to find a subset of genes with the least inner similarity and most relevant to the target class. Removing unnecessary, redundant, or noisy data reduces the data dimensionality. This research advocates a graph theoretic-based gene selection method for cancer diagnosis. Both unsupervised and supervised modes use well-known and successful social network approaches such as the maximum weighted clique criterion and edge centrality to rank genes. The suggested technique has two goals: (i) to maximize the relevancy of the chosen genes with the target class and (ii) to reduce their inner redundancy. A maximum weighted clique is chosen in a repetitive way in each iteration of this procedure. The appropriate genes are then chosen from among the existing features in this maximum clique using edge centrality and gene relevance. In the experiment, several datasets consisting of Colon, Leukemia, SRBCT, Prostate Tumor, and Lung Cancer, with different properties, are used to demonstrate the efficacy of the developed model. Our performance is compared to that of renowned filter-based gene selection approaches for cancer diagnosis whose results demonstrate a clear superiority.

Social media analysis of car parking behavior using similarity based clustering.

This paper investigates car parking users' behaviors from social media perspective using social network based analysis of online communities revealed by mining the associated hashtags in Twitter. We propose a new interpretable community detection approach for mapping user's car parking behavior by combining Clique, K-core and Girvan-Newman community detection algorithms together with a content-based analysis that exploits polarity, relative frequency and dominant topics. Twitter API was used to collect relevant data by tracking popular car-parking hashtags. A social network graph is constructed using a similarity-based analysis. Finally, interpretable communities are inferred by monitoring the outcomes of clique, K-core and Girvan-Newman community detection algorithms. This interpretability is linked to the aggregation of keywords, hashtags and/or location attributes of the tweet messages as well as a visualization module that enables interaction with users. In parallel, a global trend analysis investigates parking types and Twitter influence with respect to both sentiment polarity and dominant trends (extracted using KeyBERT based approach) is performed. The implementation of this social media analytics has uncovered several aspects associated to car-parking behaviors. A comparison with some state-of-the-art community detection methods has also been carried out and revealed some similarities with our developed approach.

Attention-based hybrid CNN-LSTM and spectral data augmentation for COVID-19 diagnosis from cough sound.

COVID-19 pandemic has fueled the interest in artificial intelligence tools for quick diagnosis to limit virus spreading. Over 60% of people who are infected complain of a dry cough. Cough and other respiratory sounds were used to build diagnosis models in much recent research. We propose in this work, an augmentation pipeline which is applied on the pre-filtered data and uses i) pitch-shifting technique to augment the raw signal and, ii) spectral data augmentation technique SpecAugment to augment the computed mel-spectrograms. A deep learning based architecture that hybridizes convolution neural networks and long-short term memory with an attention mechanism is proposed for building the classification model. The feasibility of the proposed is demonstrated through a set of testing scenarios using the large-scale COUGHVID cough dataset and through a comparison with three baselines models. We have shown that our classification model achieved 91.13% of testing accuracy, 90.93% of sensitivity and an area under the curve of receiver operating characteristic of 91.13%.

A novel explainable COVID-19 diagnosis method by integration of feature selection with random forest.

Several Artificial Intelligence-based models have been developed for COVID-19 disease diagnosis. In spite of the promise of artificial intelligence, there are very few models which bridge the gap between traditional human-centered diagnosis and the potential future of machine-centered disease diagnosis. Under the concept of human-computer interaction design, this study proposes a new explainable artificial intelligence method that exploits graph analysis for feature visualization and optimization for the purpose of COVID-19 diagnosis from blood test samples. In this developed model, an explainable decision forest classifier is employed to COVID-19 classification based on routinely available patient blood test data. The approach enables the clinician to use the decision tree and feature visualization to guide the explainability and interpretability of the prediction model. By utilizing this novel feature selection phase, the proposed diagnosis model will not only improve diagnosis accuracy but decrease the execution time as well.

Gene selection for microarray data classification via multi-objective graph theoretic-based method.

In recent decades, the improvement of computer technology has increased the growth of high-dimensional microarray data. Thus, data mining methods for DNA microarray data classification usually involve samples consisting of thousands of genes. One of the efficient strategies to solve this problem is gene selection, which improves the accuracy of microarray data classification and also decreases computational complexity. In this paper, a novel social network analysis-based gene selection approach is proposed. The proposed method has two main objectives of the relevance maximization and redundancy minimization of the selected genes. In this method, on each iteration, a maximum community is selected repetitively. Then among the existing genes in this community, the appropriate genes are selected by using the node centrality-based criterion. The reported results indicate that the developed gene selection algorithm while increasing the classification accuracy of microarray data, will also decrease the time complexity.

SAM: Self-augmentation mechanism for COVID-19 detection using chest X-ray images.

COVID-19 is a rapidly spreading viral disease and has affected over 100 countries worldwide. The numbers of casualties and cases of infection have escalated particularly in countries with weakened healthcare systems. Recently, reverse transcription-polymerase chain reaction (RT-PCR) is the test of choice for diagnosing COVID-19. However, current evidence suggests that COVID-19 infected patients are mostly stimulated from a lung infection after coming in contact with this virus. Therefore, chest X-ray (i.e., radiography) and chest CT can be a surrogate in some countries where PCR is not readily available. This has forced the scientific community to detect COVID-19 infection from X-ray images and recently proposed machine learning methods offer great promise for fast and accurate detection. Deep learning with convolutional neural networks (CNNs) has been successfully applied to radiological imaging for improving the accuracy of diagnosis. However, the performance remains limited due to the lack of representative X-ray images available in public benchmark datasets. To alleviate this issue, we propose a self-augmentation mechanism for data augmentation in the feature space rather than in the data space using reconstruction independent component analysis (RICA). Specifically, a unified architecture is proposed which contains a deep convolutional neural network (CNN), a feature augmentation mechanism, and a bidirectional LSTM (BiLSTM). The CNN provides the high-level features extracted at the pooling layer where the augmentation mechanism chooses the most relevant features and generates low-dimensional augmented features. Finally, BiLSTM is used to classify the processed sequential information. We conducted experiments on three publicly available databases to show that the proposed approach achieves the state-of-the-art results with accuracy of 97%, 84% and 98%. Explainability analysis has been carried out using feature visualization through PCA projection and t-SNE plots.

Vegetation height estimation using ubiquitous foot-based wearable platform.

Vegetation height plays a key role in many environmental applications such as landscape characterization, conservation planning and disaster management, and biodiversity assessment and monitoring. Traditionally, in situ measurements and airborne Light Detection and Ranging (LiDAR) sensors are among the commonly employed methods for vegetation height estimation. However, such methods are known for their high incurred labor, time, and infrastructure cost. The emergence of wearable technology offers a promising alternative, especially in rural environments and underdeveloped countries. A method for a locally designed data acquisition ubiquitous wearable platform has been put forward and implemented. Next, a regression model to learn vegetation height on the basis of attributes associated with a pressure sensor has been developed and tested. The proposed method has been tested in Oulu region. The results have proven particularly effective in a region where the land has a forestry structure. The linear regression model yields (r2 = 0.81 and RSME = 16.73 cm), while the use of a multi-regression model yields (r2 = 0.82 and RSME = 15.73 cm). The developed approach indicates a promising alternative in vegetation height estimation where in situ measurement, LiDAR data, or wireless sensor network is either not available or not affordable, thus facilitating and reducing the cost of ecological monitoring and environmental sustainability planning tasks.

Prostate contours delineation using interactive directional active contours model and parametric shape prior model.

Prostate contours delineation on Magnetic Resonance (MR) images is a challenging and important task in medical imaging with applications of guiding biopsy, surgery and therapy. While a fully automated method is highly desired for this application, it can be a very difficult task due to the structure and surrounding tissues of the prostate gland. Traditional active contours-based delineation algorithms are typically quite successful for piecewise constant images. Nevertheless, when MR images have diffuse edges or multiple similar objects (e.g. bladder close to prostate) within close proximity, such approaches have proven to be unsuccessful. In order to mitigate these problems, we proposed a new framework for bi-stage contours delineation algorithm based on directional active contours (DAC) incorporating prior knowledge of the prostate shape. We first explicitly addressed the prostate contour delineation problem based on fast globally DAC that incorporates both statistical and parametric shape prior model. In doing so, we were able to exploit the global aspects of contour delineation problem by incorporating a user feedback in contours delineation process where it is shown that only a small amount of user input can sometimes resolve ambiguous scenarios raised by DAC. In addition, once the prostate contours have been delineated, a cost functional is designed to incorporate both user feedback interaction and the parametric shape prior model. Using data from publicly available prostate MR datasets, which includes several challenging clinical datasets, we highlighted the effectiveness and the capability of the proposed algorithm. Besides, the algorithm has been compared with several state-of-the-art methods.