Multi-dimensional information sensing of complex surfaces based on fringe projection profilometry.

Multi-dimensional and high-resolution information sensing of complex surface profiles is critical for investigating various structures and analyzing their mechanical properties. This information is currently accessed separately through different technologies and devices. Fringe projection profilometry (FPP) has been widely applied in shape measurement of complex surfaces. Since structured light information is projected instead of being attached onto the surface, it holds back accurately tracking corresponding points and fails to further analyze deformation and strain. To address this issue, we propose a multi-dimensional information sensing method based on digital image correction (DIC)-assisted FPP. Firstly, colorful fluorescent markers are introduced to produce modulated information with both high-intensity reflectivity and color difference. And then, the general information separation method is presented to simultaneously acquire speckle-free texture, fringe patterns and high-contrast speckle patterns for multi-dimensional information sensing. To the best of our knowledge, this proposed method, for the first time, simultaneously realizes accurate and high-resolution 2D texture (T), 4D shape (x, y, z, t) and analytical dimensional mechanical parameters (deformation (d), strain (s)) information sensing based on the FPP system. Experimental results demonstrate the proposed method can measure and analyze 3D geometry and mechanical state of complex surfaces, expanding the measuring dimension of the off-the-shelf FPP system without any extra hardware cost.

Serological analysis of allergic components of house dust mite provides more insight in epidemiological characteristics and clinical symptom development in North China.

Background: House dust mite (HDM) is the most common airborne source causing complex allergy symptoms. There are geographic differences in the allergen molecule sensitization profiles. Serological testing with allergen components may provide more clues for diagnosis and clinical management. Objective: This study aims to investigate the sensitization profile of eight HDM allergen components in a large number of patients enrolled in the clinic and to analyze the relation of gender, age, and clinical symptoms in North China. Methods: The 548 serum samples of HDM-allergic patients (ImmunoCAP® d1 or d2 IgE ≥0.35) were collected in Beijing City and divided in four different age groups and three allergic symptoms. The specific IgE of HDM allergenic components, Der p 1/Der f 1, Der p 2/Der f 2, Der p 7, Der p 10, Der p 21, and Der p 23, was measured using the micro-arrayed allergen test kit developed by Hangzhou Zheda Dixun Biological Gene Engineering Co., Ltd. The new system was validated by comparing to single-component Der p 1, Der p 2, and Der p 23 tests by ImmunoCAP in 39 sera. The epidemiological study of these IgE profiles and the relation to age and clinical phenotypes were analyzed. Results: A greater proportion of male patients was in the younger age groups, while more female patients were in the adult groups. Both the sIgE levels and the positive rates (approximately 60%) against Der p 1/Der f 1 and Der p 2/Der f 2 were higher than for the Der p 7, Der p 10, and Der p 21 components (below 25%). The Der f 1 and Der p 2 positive rates were higher in 2-12-year-old children. The Der p 2 and Der f 2 IgE levels and positive rates were higher in the allergic rhinitis group. The positive rates of Der p 10 increased significantly with age. Der p 21 is relevant in allergic dermatitis symptom, while Der p 23 contributes to asthma development. Conclusion: HDM groups 1 and 2 were the major sensitizing allergens, with group 2 being the most important component relevant to respiratory symptoms in North China. The Der p 10 sensitization tends to increase with age. Der p 21 and Der p 23 might be associated with the development of allergic skin disease and asthma, respectively. Multiple allergen sensitizations increased the risk of allergic asthma.

Time-overlapping structured-light projection: high performance on 3D shape measurement for complex dynamic scenes.

High-speed three-dimensional (3D) shape measurement has been continuously researched due to the demand for analyzing dynamic behavior in transient scenes. In this work, a time-overlapping structured-light 3D shape measuring technique is proposed to realize high-speed and high-performance measurement on complex dynamic scenes. Time-overlapping structured-light projection is presented to maximumly reduce the information redundancy in temporal sequences and improve the measuring efficiency; generalized tripartite phase unwrapping (Tri-PU) is used to ensure the measuring robustness; fringe period extension is achieved by improving overlapping rate to further double the encoding fringe periods for higher measuring accuracy. Based on the proposed measuring technique, one new pixel-to-pixel and unambiguous 3D reconstruction result can be updated with three newly required patterns at a reconstruction rate of 3174 fps. Three transient scenes including collapsing wood blocks struck by a flying arrow, free-falling foam snowflakes and flying water balloon towards metal grids were measured to verify the high performance of the proposed method in various complex dynamic scenes.

Four clinical phenotypes of cow's milk protein allergy based on dairy product specific IgE antibody types in North China.

Background: Cow's milk protein allergy (CMPA) is a common allergy. Immunoglobulin E (IgE)-mediated cow's milk allergy is associated with a high mortality risk and poor prognosis. The study aims to investigate whether there are different clinically CMPA phenotypes in China and to explore the association between CMPA phenotypes and specific IgE (sIgE) antibodies against different dairy products. Methods: Serum sIgE against different animal milk and cow's milk products and different milk components was measured by an allergen array. Four CMPA classifications were identified by the presence of serum sIgE: boiled milk-positive, yogurt-positive, buttermilk-positive, and raw milk-positive. Results: Among the 234 participants included in the study, 9 were boiled milk sIgE-positive, 50 were yogurt sIgE-positive, 17 were buttermilk sIgE-positive, and 158 were only raw milk sIgE-positive. The boiled milk-positive group had the highest levels of raw milk sIgE and casein sIgE antibodies, followed sequentially by the yogurt-positive, buttermilk-positive, and raw milk-positive groups. The boiled milk group observed the highest levels of sIgE against raw milk, casein, α-lactalbumin, and ß-lactoglobulin. These levels differed significantly from those in the other three groups. Allergic symptoms were distributed differently among the four study groups. The percentages of allergic patients with gastrointestinal tract symptoms in the above mentioned four groups ranged from high to low, and the percentages of patients with skin symptoms in the four groups ranged from low to high, respectively. Conclusion: Based on dairy product sIgE antibody levels associated with different milk components and various clinical allergic symptom tendencies, we could distinguish four CMPA phenotypes.

Three-dimensional shape and deformation measurement on complex structure parts.

Stereo digital image correlation technique (stereo-DIC or 3D-DIC) has been widely used in three-dimensional (3D) shape and deformation measurement due to its high accuracy and flexibility. But it is a tough task for it to deal with complex structure components because of the severe perspective distortion in two views. This paper seeks to resolve this issue using a single-camera system based on DIC-assisted fringe projection profilometry (FPP). A pixel-wise and complete 3D geometry of complex structures can be reconstructed using the robust and efficient Gray-coded method based on a FPP system. And then, DIC is just used to perform the temporal matching and complete full-field pixel-to-pixel tracking. The in- and out-of-plane deformation are obtained at the same time by directly comparing the accurate and complete 3D data of each corresponding pixel. Speckle pattern design and fringe denoising methods are carefully compared and chosen to simultaneously guarantee the measuring accuracy of 3D shape and deformation. Experimental results demonstrate the proposed method is an effective means to achieve full-field 3D shape and deformation measurement on complex parts, such as honeycomb structure and braided composite tube, which are challenging and even impossible for the traditional stereo-DIC method.

The mechanism and origin of selectivities for NHC-catalyzed synthesis of axially chiral benzothiophene/benzofuran-fused biaryls.

By performing density functional theory (DFT) calculations, we investigated and identified the fundamental pathway for N-heterocyclic carbene (NHC)-catalyzed synthesis of axially chiral benzothiophene-fused biaryls using enal and 2-benzyl-benzothiophene-3-carbaldehyde, which includes (1) nucleophilic attack on enal by the organocatalyst NHC, (2) [1,2]-proton transfer, (3) oxidation, (4) stereoselective formation of the C-C σ bond, (5) intramolecular [2 + 2] cycloaddition, (6) dissociation of NHC, (7) release of CO2, and (8) transformation to axial chirality. Moreover, the calculated results can reasonably explain the observed chemo- and stereoselectivities for the formation of both benzothiophene/benzofuran-fused biaryls in these kinds of reactions. Further non-covalent interaction (NCI) and atoms-in-molecules (AIM) analyses demonstrate that the hydrogen bond interactions are responsible for the stability of key stereoselective transition states. This work would be useful for understanding the origin of stereoselectivity of NHC-catalyzed intermolecular cyclization reactions for the synthesis of axially benzothiophene/benzofuran-fused biaryl compounds.

Real-time motion-induced error compensation for 4-step phase-shifting profilometry.

Phase-shifting profilometry has been widely used in high-accuracy three-dimensional (3D) shape measurement. However, for dynamic scenarios, the object motion will lead to extra phase shift and then motion-induced error. Convenient and efficient motion-induced error compensation is still challenging. Therefore, we proposed a real-time motion-induced error compensation method for 4-step phase-shifting profilometry. The four phase-shifting images are divided into two groups to calculate two corresponding wrapped phases, one from the first three fringes and the other from the last three fringes. As the motion-induced error doubles the frequency of the projected fringes, the average phase can effectively compensate the motion-induced error because there is a π/2 phase shift between the adjacent frames. Furthermore, we designed a time sequence by recycling the projection fringes in a proper order, and the efficiency of 3D reconstruction could be effectively improved. This method performs pixel-wise error compensation, based on which we realized 50 fps real-time 3D measurement by GPU acceleration. Experimental results demonstrate that the proposed method can effectively reduce the motion-induced error.

Generalized phase unwrapping method that avoids jump errors for fringe projection profilometry.

Jump errors easily occur on the discontinuity of the wrapped phase because of the misalignment between wrapped phase and fringe order in fringe projection profilometry (FPP). In this paper, a phase unwrapping method that avoids jump errors is proposed for FPP. By building two other staggered wrapped phases from the original wrapped phase and dividing each period of fringe order into three parts, the proposed generalized tripartite phase unwrapping (Tri-PU) method can be used to avoid rather than compensatorily correct jump errors. It is suitable for the phase unwrapping method assisted by fringe order with a basic wrapped phase and fringe order, no matter which method is used to recover them. The experimental results demonstrate the effectiveness and generality of the proposed method, which is simple to implement and superior to measure complex objects with sharp edges.

Insights into Organoamine-Catalyzed Asymmetric Synthesis of Axially Chiral Allenoates Using Morita-Baylis-Hillman Carbonates and Trisubstituted Allenoates: Mechanism and Origin of Stereoselectivity.

A computational study was performed to explore the possible mechanisms of ß-isocinchonine-catalyzed asymmetric C(sp2)-H allylation of trisubstituted allenoates using Morita-Baylis-Hillman (MBH) carbonates for synthesis of axially chiral tetrasubstituted allenoates. The calculated results indicate that the most energetically favorable pathway includes (1) nucleophilic attack on MBH carbonate by ß-isocinchonine, (2) BocO- dissociation, (3) stereoselective formation of the C-C bond, and (4) regeneration of the catalyst. By tracking the orbital overlap/interaction changes, the half shoulder-to-head orbital overlap mode can be smoothly switched to a head-to-head orbital overlap mode for the key C-C σ bond formation, which is also identified as the stereoselectivity-determining process. Further distortion/interaction, noncovalent interaction (NCI), and atom-in-molecule (AIM) analyses demonstrate that C-H···O and C-H···π interactions should be key for controlling the axial and central chirality. This work would be useful for rational design of organocatalytic allylic alkylation reactions for synthesis of axially chiral compounds in the future.

Passive binary defocusing for large depth 3D measurement based on deep learning.

Phase-shifting profilometry (PSP) based on the binary defocusing technique has been widely used due to its high-speed capability. However, the required adjustment in projector defocus by traditional method is inaccurate, inflexible, and associated with fringe pitch. Instead of manual defocusing adjustment, a passive defocus of the binary patterns based on deep learning is proposed in this paper. Learning the corresponding binary patterns with a specifically designed convolutional neural network, high-quality three-step sinusoidal patterns can be generated. Experimental results demonstrate that the proposed method could reduce phase error by 80%-90% for different fringe pitches without projector defocus and outperform the traditional method by providing more accurate and robust results within a large measuring depth.

Identification of 6 gene markers for survival prediction in osteosarcoma cases based on multi-omics analysis.

Multiple-omics sequencing information with high-throughput has laid a solid foundation to identify genes associated with cancer prognostic process. Multiomics information study is capable of revealing the cancer occurring and developing system according to several aspects. Currently, the prognosis of osteosarcoma is still poor, so a genetic marker is needed for predicting the clinically related overall survival result. First, Office of Cancer Genomics (OCG Target) provided RNASeq, copy amount variations information, and clinically related follow-up data. Genes associated with prognostic process and genes exhibiting copy amount difference were screened in the training group, and the mentioned genes were integrated for feature selection with least absolute shrinkage and selection operator (Lasso). Eventually, effective biomarkers received the screening process. Lastly, this study built and demonstrated one gene-associated prognosis mode according to the set of the test and gene expression omnibus validation set; 512 prognosis-related genes (P < 0.01), 336 copies of amplified genes (P < 0.05), and 36 copies of deleted genes (P < 0.05) were obtained, and those genes of the mentioned genomic variants display close associations with tumor occurring and developing mechanisms. This study generated 10 genes for candidates through the integration of genomic variant genes as well as prognosis-related genes. Six typical genes (i.e. MYC, CHIC2, CCDC152, LYL1, GPR142, and MMP27) were obtained by Lasso feature selection and stepwise multivariate regression study, many of which are reported to show a relationship to tumor progressing process. The authors conducted Cox regression study for building 6-gene sign, i.e. one single prognosis-related element, in terms of cases carrying osteosarcoma. In addition, the samples were able to be risk stratified in the training group, test set, and externally validating set. The AUC of five-year survival according to the training group and validation set reached over 0.85, with superior predictive performance as opposed to the existing researches. Here, 6-gene sign was built to be new prognosis-related marking elements for assessing osteosarcoma cases' surviving state.

Real-time 3D shape measurement with dual-frequency composite grating and motion-induced error reduction.

Phase-shifting profilometry has been increasingly sought and applied in dynamic three-dimensional (3D) shape measurement. However, the object motion will lead to extra phase shift error and thus measurement error. In this paper, a real-time 3D shape measurement method based on dual-frequency composite phase-shifting grating and motion-induced error reduction is proposed for a complex scene containing dynamic and static objects. The proposed method detects the motion region of a complex scene through the phase relations of the dual-frequency composite grating and reduces the motion-induced error with the combination of the phase calculated by a phase-shifting algorithm and the phase extracted by Fourier fringe analysis. It can correctly reconstruct the 3D shape of a complex dynamic scene and ensure high measurement accuracy of its static object as well. With the aid of the phase-shifting image ordering approach, the dynamic 3D shape of complex scenes can be reconstructed and the motion-induced error can also be suppressed in real time. Experimental results well proved that the proposed method is effective and practical.

Improve Temporal Fourier Transform Profilometry for Complex Dynamic Three-Dimensional Shape Measurement.

The high-speed three-dimensional (3-D) shape measurement technique has become more and more popular recently, because of the strong demand for dynamic scene measurement. The single-shot nature of Fourier Transform Profilometry (FTP) makes it highly suitable for the 3-D shape measurement of dynamic scenes. However, due to the band-pass filter, FTP method has limitations for measuring objects with sharp edges, abrupt change or non-uniform reflectivity. In this paper, an improved Temporal Fourier Transform Profilometry (TFTP) algorithm combined with the 3-D phase unwrapping algorithm based on a reference plane is presented, and the measurement of one deformed fringe pattern producing a new 3-D shape of an isolated abrupt objects has been achieved. Improved TFTP method avoids band-pass filter in spatial domain and unwraps 3-D phase distribution along the temporal axis based on the reference plane. The high-frequency information of the measured object can be well preserved, and each pixel is processed separately. Experiments verify that our method can be well applied to a dynamic 3-D shape measurement with isolated, sharp edges or abrupt change. A high-speed and low-cost structured light pattern sequence projection has also been presented, it is capable of projection frequencies in the kHz level. Using the proposed 3-D shape measurement algorithm with the self-made mechanical projector, we demonstrated dynamic 3-D reconstruction with a rate of 297 Hz, which is mainly limited by the speed of the camera.

High-speed three-dimensional shape measurement based on shifting Gray-code light.

The measuring technique combining a phase-shifting algorithm and Gray-code light has been widely used in three-dimensional (3D) shape measurement for static scenes because of its high robustness and anti-noise ability. However, in the high-speed measurement, phase unwrapping errors occur easily on the boundaries of adjacent Gray-code words because of the defocus of the projector, the motion of the objects and the non-uniform reflectivity of the surface. To overcome this challenge, a high-speed 3D shape measurement method based on shifting Gray-code light has been proposed in this paper. Firstly, the average intensity of three captured phase-shifting fringe images are used as a pixel-wise threshold to binarize the Gray codes and to eliminate most phase unwrapping errors caused by the non-uniform reflectivity, ambient light variations, and the defocus of projector. Then, the shifting Gray-code (SGC) coding strategy is proposed to avoid the remaining errors of phase unwrapping on the edge of the code words. In this strategy, no additional patterns are projected, and two sets of decoding words with staggered boundaries are built in the temporal sequences for one wrapped phase. Finally, the simple, efficient, and robust phase unwrapping can be achieved in the high-speed dynamic measurement. This proposed method has been applied to reconstruct 3D shape of randomly collapsing objects in a large depth range, and the experimental results demonstrate that it can reliably obtain high-quality shape and texture information at 310 frames per second.

High-speed three-dimensional shape measurement based on cyclic complementary Gray-code light.

The binary defocusing technique has been widely used in high-speed three-dimensional (3D) shape measurement because it breaks the bottlenecks in high-speed fringe projection and the projector's nonlinear response. However, it is challenging for this method to realize a two- or multi-frequency phase-shifting algorithm because it is difficult to simultaneously generate high-quality sinusoidal fringe patterns with different periods under the same defocusing degree. To bypass this challenge, we proposed a high-speed 3D shape measurement technique for dynamic scenes based on cyclic complementary Gray-code (CCGC) patterns. In this proposed method, the projected phase-shifting sinusoidal fringes kept one same frequency, which is beneficial to ensure the optimum defocusing degree for binary dithering technique. The wrapped phase can be calculated by phase-shifting algorithm and unwrapped with the aid of complementary Gray-code (CGC) patterns in a simple and robust way. Then, the cyclic coding strategy further extends the unambiguous phase measurement range and improves the measurement accuracy compared with the traditional Gray-coding strategy under the condition of the same number of projected patterns. High-quality 3D results of three complex dynamic scenes-including a cooling fan and a standard ceramic ball with a free-falling table tennis, collapsing building blocks, and impact of the Newton's cradle-were demonstrated at a frame rate of 357 fps. This verified the proposed method's feasibility and validity.