More Arrows in the Quiver: Investigating the Use of Auxiliary Models to Localize In-View Components with Augmented Reality.

The creation and management of content are among the main open issues for the spread of Augmented Reality. In Augmented Reality interfaces for procedural tasks, a key authoring strategy is chunking instructions and using optimized visual cues, i.e., tailored to the specific information to convey. Nevertheless, research works rarely present rationales behind their choice. This work aims to provide design guidelines for the localization of in-view and not occluded components, which is recurrent information in technical documentation. Previous studies revealed that the most suited visual cues to convey this information are auxiliary models, i.e., abstract shapes that highlight the space region where the component is located. Among them, 3D arrows are widely used, but they may produce ambiguity of information. Furthermore, from the literature, it is unclear how to design auxiliary model shapes and if they are affected by the component shapes. To fill this gap, we conducted two user studies. In the first study, we collected the preference of 45 users regarding the shape, color, and animation of auxiliary models for the localization of various component shapes. According to the results of this study, we defined guidelines for designing optimized auxiliary models based on the component shapes. In the second user study, we validated these guidelines by evaluating the performance (localization time and recognition accuracy) and user experience of 24 users. The results of this study allowed us to confirm that designing auxiliary models following our guidelines leads to a higher recognition accuracy and user experience than using 3D arrows.

Minimal AR: visual asset optimization for the authoring of augmented reality work instructions in manufacturing.

This work investigates the possibility of using a novel "minimal AR" authoring approach to optimize the visual assets used in augmented reality (AR) interfaces to convey work instructions in manufacturing. In the literature, there are no widely supported guidelines for the optimal choice of visual assets (e.g., CAD models, drawings, and videos). Therefore, to avoid the risk of having AR technical documentation based only on the author's preference, our work proposes a novel authoring approach that enforces the minimal amount of information to accomplish a task. Minimal AR was tested through a simulated AR LEGO-based assembly task. The performance (completion time, mental workload, errors) of 40 users was evaluated with 4 combinations of visual assets in 4 tasks with an increasing amount of information needed. The main result is that visual assets with an excess of information do not significantly increase performance. Therefore, the location of a specified object should be "minimally" authored by an auxiliary model (e.g., a circle and an arrow). For identifying an object within a couple, color coding is preferred to using additional visual assets. If more than two objects must be identified, a drawing visual asset is also needed. Only when the orientation of a selected object must be conveyed, animated product models are required. These insights could be helpful for an optimal design of AR work instructions in a wide range of industrial fields. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s00170-021-08449-6.

What, How, and Why are Visual Assets Used in Industrial Augmented Reality? A Systematic Review and Classification in Maintenance, Assembly, and Training (From 1997 to 2019).

Industrial Augmented Reality (iAR) has demonstrated its advantages to communicate technical information in the fields of maintenance, assembly, and training. However, literature is scattered among different visual assets (i.e., AR visual user interface elements associated with a real scene). In this work, we present a systematic literature review of visual assets used in these industrial fields. We searched five databases, initially finding 1757 papers. Then, we selected 122 iAR papers from 1997 to 2019 and extracted 348 visual assets. We propose a classification for visual assets according to (i) what is displayed, (ii) how it conveys information (frame of reference, color coding, animation), and, (iii) why it is used. Our review shows that product models, text and auxiliary models are, in order, the most common, with each most often used to support operating, checking and locating tasks respectively. Other visual assets are scarcely used. Product and auxiliary models are commonly rendered world-fixed, color coding is not used as often as expected, while animations are limited to product and auxiliary model. This survey provides a snapshot of over 20 years of literature in iAR, useful to understand established practices to orientate in iAR interface design and to present future research directions.

Nanoindentation of mesenchymal stem cells using atomic force microscopy: effect of adhesive cell-substrate structures.

The procedure commonly adopted to characterize cell materials using atomic force microscopy neglects the stress state induced in the cell by the adhesion structures that anchor it to the substrate. In several studies, the cell is considered as made from a single material and no specific information is provided regarding the mechanical properties of subcellular components. Here we present an optimization algorithm to determine separately the material properties of subcellular components of mesenchymal stem cells subjected to nanoindentation measurements. We assess how these properties change if the adhesion structures at the cell-substrate interface are considered or not in the algorithm. In particular, among the adhesion structures, the focal adhesions and the stress fibers were simulated. We found that neglecting the adhesion structures leads to underestimate the cell mechanical properties thus making errors up to 15%. This result leads us to conclude that the action of adhesion structures should be taken into account in nanoindentation measurements especially for cells that include a large number of adhesions to the substrate.

A Body Tracking-Based Low-Cost Solution for Monitoring Workers' Hygiene Best Practices during Pandemics.

Since its beginning at the end of 2019, the pandemic spread of the severe acute respiratory syndrome coronavirus 2 (Sars-CoV-2) caused more than one million deaths in only nine months. The threat of emerging and re-emerging infectious diseases exists as an imminent threat to human health. It is essential to implement adequate hygiene best practices to break the contagion chain and enhance society preparedness for such critical scenarios and understand the relevance of each disease transmission route. As the unconscious hand-face contact gesture constitutes a potential pathway of contagion, in this paper, the authors present a prototype system based on low-cost depth sensors able to monitor in real-time the attitude towards such a habit. The system records people's behavior to enhance their awareness by providing real-time warnings, providing for statistical reports for designing proper hygiene solutions, and better understanding the role of such route of contagion. A preliminary validation study measured an overall accuracy of 91%. A Cohen's Kappa equal to 0.876 supports rejecting the hypothesis that such accuracy is accidental. Low-cost body tracking technologies can effectively support monitoring compliance with hygiene best practices and training people in real-time. By collecting data and analyzing them with respect to people categories and contagion statistics, it could be possible to understand the importance of this contagion pathway and identify for which people category such a behavioral attitude constitutes a significant risk.

An Algorithm to Optimize the Micro-Geometrical Dimensions of Scaffolds with Spherical Pores.

Despite the wide use of scaffolds with spherical pores in the clinical context, no studies are reported in the literature that optimize the micro-architecture dimensions of such scaffolds to maximize the amounts of neo-formed bone. In this study, a mechanobiology-based optimization algorithm was implemented to determine the optimal geometry of scaffolds with spherical pores subjected to both compression and shear loading. We found that these scaffolds are particularly suited to bear shear loads; the amounts of bone predicted to form for this load type are, in fact, larger than those predicted in other scaffold geometries. Knowing the anthropometric characteristics of the patient, one can hypothesize the possible value of load acting on the scaffold that will be implanted and, through the proposed algorithm, determine the optimal dimensions of the scaffold that favor the formation of the largest amounts of bone. The proposed algorithm can guide and support the surgeon in the choice of a "personalized" scaffold that better suits the anthropometric characteristics of the patient, thus allowing to achieve a successful follow-up in the shortest possible time.

Improving the "real life" management of schizophrenia spectrum disorders by LAI antipsychotics: A one-year mirror-image retrospective study in community mental health services.

Schizophrenia poses a significant economic burden on the healthcare system as well as it has a significant impact on society at large. Reasons for such a high economic burden of schizophrenia include the frequent relapses and hospitalizations occurring in this disorder. We analyze the effectiveness of long-acting injectable antipsychotics (LAIs) compared to oral medications, in terms of "clinical process management" in a sample of patients with a diagnosis of schizophrenia spectrum disorder treated in community mental health centers. An observational, retrospective, mirror-image study was carried out to evaluate the effectiveness of LAIs compared to oral medications in terms of number of hospitalizations, emergency visits and planned visits on a 10-year period (from July 2007 to June 2017). Differences between first and second generation LAIs were also explored. Our findings show that hospitalization and emergency visits are significantly decreased with the use of LAIs, while planned visits are increased in patients treated with LAIs. Our results suggest that LAIs, in particular, second generation ones, reduce hospitalization rates and emergency visits, improving the economic burden of schizophrenia. Therefore, LAIs should be considered a cost-effective treatment in the management of schizophrenia under routine conditions.

Mechanobiological Approach to Design and Optimize Bone Tissue Scaffolds 3D Printed with Fused Deposition Modeling: A Feasibility Study.

In spite of the rather large use of the fused deposition modeling (FDM) technique for the fabrication of scaffolds, no studies are reported in the literature that optimize the geometry of such scaffold types based on mechanobiological criteria. We implemented a mechanobiology-based optimization algorithm to determine the optimal distance between the strands in cylindrical scaffolds subjected to compression. The optimized scaffolds were then 3D printed with the FDM technique and successively measured. We found that the difference between the optimized distances and the average measured ones never exceeded 8.27% of the optimized distance. However, we found that large fabrication errors are made on the filament diameter when the filament diameter to be realized differs significantly with respect to the diameter of the nozzle utilized for the extrusion. This feasibility study demonstrated that the FDM technique is suitable to build accurate scaffold samples only in the cases where the strand diameter is close to the nozzle diameter. Conversely, when a large difference exists, large fabrication errors can be committed on the diameter of the filaments. In general, the scaffolds realized with the FDM technique were predicted to stimulate the formation of amounts of bone smaller than those that can be obtained with other regular beam-based scaffolds.

Irregular Load Adapted Scaffold Optimization: A Computational Framework Based on Mechanobiological Criteria.

By combining load adaptive algorithms with mechanobiological algorithms, a computational framework was developed to design and optimize the microarchitecture of irregular load adapted scaffolds for bone tissue engineering. Skeletonized cancellous bone-inspired lattice structures were built including linear fibers oriented along the internal flux of forces induced by the hypothesized boundary conditions. These structures were then converted into solid finite element models, which were optimized with mechanobiology-based optimization algorithms. The design variable was the diameter of the beams included in the scaffold, while the design objective was the maximization of the fraction of the scaffold volume predicted to be occupied by neo-formed bony tissue. The performance of the designed irregular scaffolds, intended as the capability to favor the formation of bone, was compared with that of the regular ones based on different unit cell geometries. Three different boundary and loading conditions were hypothesized, and for all of them, it was found that the irregular load adapted scaffolds perform better than the regular ones. Interestingly, the numerical predictions of the proposed framework are consistent with the results of experimental studies reported in the literature. The proposed framework appears to be a powerful tool that can be utilized to design high-performance irregular load adapted scaffolds capable of bearing complex load distributions.

Comparison of the mechanobiological performance of bone tissue scaffolds based on different unit cell geometries.

Enhancing the performance of scaffolds for bone regeneration requires a multidisciplinary approach involving competences in the fields of Biology, Medicine and Engineering. A number of studies have been conducted to investigate the influence of scaffolds design parameters on their mechanical and biological response. The possibilities offered by the additive manufacturing techniques to fabricate sophisticated and very complex microgeometries that until few years ago were just a geometrical abstraction, led many researchers to design scaffolds made from different unit cell geometries. The aim of this work is to find, based on mechanobiological criteria and for different load regimes, the optimal geometrical parameters of scaffolds made from beam-based repeating unit cells, namely, truncated cuboctahedron, truncated cube, rhombic dodecahedron and diamond. The performance, -expressed in terms of percentage of the scaffold volume occupied by bone-, of the scaffolds based on these unit cells was compared with that of scaffolds based on other unit cell geometries such as: hexahedron and rhombicuboctahedron. A very intriguing behavior was predicted for the truncated cube unit cell that allows the formation of large amounts of bone for low load values and of very small amounts for the medium-high ones. For high values of load, scaffolds made from hexahedron unit cells were predicted to favor the formation of the largest amounts of bone. In a clinical context where medical solutions become more and more customized, this study offers a support to the surgeon in the choice of the best scaffold to be implanted in a patient-specific anatomic region.

Experiencing the Sights, Smells, Sounds, and Climate of Southern Italy in VR.

This article explores what it takes to make interactive computer graphics and VR attractive as a promotional vehicle, from the points of view of tourism agencies and the tourists themselves. The authors exploited current VR and human-machine interface (HMI) technologies to develop an interactive, innovative, and attractive user experience called the Multisensory Apulia Touristic Experience (MATE). The MATE system implements a natural gesture-based interface and multisensory stimuli, including visuals, audio, smells, and climate effects.

Effect of Text Outline and Contrast Polarity on AR Text Readability in Industrial Lighting.

Text readability with augmented reality head-worn displays is critical and at present time, there are no standard guidelines to follow. The readability depends mainly on background lighting, display technology (i.e., OST: optical see-through or VST: video see-through), and text style (e.g., plain text, outline or billboard). In this work, we addressed the readability limits for industrial activities. We experimented the effects of two background illuminances levels (1,000 lx for very fine basic industrial tasks and 4,000 lx for fine machining), two commercially available head-worn display technologies, variable outline widths and contrast polarity of text. We analyzed the performance of 12 subjects by collecting about 3,400 measurements using a specific test application and followed by qualitative interviews. With high illuminances, VST performed better than OST, regardless of contrast polarity and outline width. We found that negative contrast polarity is preferable with VST, and that just a minimum outline (1 px) around black text is optimal. On the contrary, positive contrast polarity should be used with OST and outline is not effective. Therefore, we evaluated the usage limits of the OST by sampling its contrast sensitivity function.

Text readability in head-worn displays: color and style optimization in video versus optical see-through devices.

Efficient text visualization in head-worn augmented reality (AR) displays is critical because it is sensitive to display technology, text style and color, ambient illumination and so on. The main problem for the developer is to know the optimal text style for the specific display and for applications where color coding must be strictly followed because it is regulated by laws or internal practices. In this work, we experimented the effects on readability of two head-worn devices (optical and video see-through), two backgrounds (light and dark), five colors (white, black, red, green, and blue), and two text styles (plain text and billboarded text). Font type and size were kept constant. We measured the performance of 15 subjects by collecting about 5,000 measurements using a specific test application and followed by qualitative interviews. Readability turned out to be quicker on the optical see-through device. For the video see-through device, background affects readability only in case of text without billboard. Finally, our tests suggest that a good combination for indoor augmented reality applications, regardless of device and background, could be white text and blue billboard, while a mandatory color should be displayed as billboard with a white text message.