A Robust Initialization of Residual Blocks for Effective ResNet Training Without Batch Normalization.

Batch normalization is an essential component of all state-of-the-art neural networks architectures. However, since it introduces many practical issues, much recent research has been devoted to designing normalization-free architectures. In this brief, we show that weights initialization is key to train ResNet-like normalization-free networks. In particular, we propose a slight modification to the summation operation of a block output to the skip-connection branch, so that the whole network is correctly initialized. We show that this modified architecture achieves competitive results on CIFAR-10, CIFAR-100 and ImageNet without further regularization nor algorithmic modifications.

Comprehensive disease control in systemic lupus erythematosus.

OBJECTIVES: We evaluated a monocentric SLE cohort in order to assess the frequency of Lupus comprehensive disease control (LupusCDC), a condition defined by the achievement of remission and the absence of damage progression. METHODS: Our longitudinal analysis included SLE patients with 5-years follow-up and at least one visit per year. Disease activity was assessed by SLE Disease Activity Index 2000 (SLEDAI-2K) and three different remission levels were evaluated (Complete Remission, CR; Clinical remission off-corticosteroids; clinical remission on-corticosteroids). Chronic damage was assessed according to SLICC Damage Index (SDI). LupusCDC was defined as remission achievement for at least one year plus absence of chronic damage progression in the previous one year. A machine learning based analysis was carried out, applying and comparing Nonlinear Support Vector Machines (SVM) models and Decision Trees (DT), whereas features ranking was performed with the ReliefF algorithm. RESULTS: We evaluated 172 patients [M/F 16/156, median age 49 years (IQR 16.7), median disease duration 180 months (IQR 156)]. SDI values (baseline mean±SD 0.7 ± 1.1) significantly increased during the follow-up period. In all time-points analyzed, LupusCDC including CR was the most frequently detected. The failure to reach this condition was significantly associated with renal involvement and with the intake of immunosuppressant drugs and glucocorticoid (GC). Ten patients (5.8%) have maintained LupusCDC during the whole 5-year follow-up: these patients had never presented renal involvement and showed lower prevalence of anti-phospholipid antibodies (p = 0.0001). Finally, the prevalence of GC intake was significantly lower (p = 0.0001). The application of machine learning models showed that the available features were able to provide significant information to build predictive models with an AUC score of 0.703 ± 0.02 for DT and 0.713 ± 0.02 for SVM. CONCLUSIONS: Our data on a monocentric cohort suggest that the LupusCDC can efficaciously merge into one outcome SLE-related disease activity and chronic damage in order to perform an all-around evaluation of SLE patients.

Injury risk assessment based on pre-crash variables: The role of closing velocity and impact eccentricity.

Thorough evaluations on injury risk (IR) are fundamental for guiding interventions toward the enhancement of both the road infrastructure and the active/passive safety of vehicles. Well-established estimates are currently based on IR functions modeled on post-crash variables, such as velocity change sustained by the vehicle (ΔV); thence, these analyses do not directly suggest how pre-crash conditions can be modified to allow for IR reduction. Nevertheless, ΔV can be disaggregated into two contributions which enable its apriori calculation, based only on the information available at the impact instant: the Crash Momentum Index (CMI), representing impact eccentricity at collision, and the closing velocity at collision (Vr). By extensively employing the CMI indicator, this work assesses the overall influence of impact eccentricity and closing velocity on the risk for occupants to sustain a serious injury. As CMI synthesizes indications regarding ΔV, its use can be disjointed from the ΔV itself for the derivation of high-quality IR models. This feature distinguishes CMI from the other eccentricity indicators available at the state-of-the-art, allowing for the contribution of eccentricity on IR to be completely isolated. Because of this element of originality, special attention is given to the CMI variable throughout the present work. Based on data extracted from the NASS/CDS database, the influence of the CMI and Vr variables on IR is specifically highlighted and analyzed from several perspectives. The feature ranking algorithm ReliefF, whose use is unprecedented in the accident analysis field, is first employed to assess importance of such impact-related variables in determining the injury outcome: if compared to vehicle-related and occupant-related variables (as category and age, respectively), the higher influence of CMI and Vr is initially highlighted. Secondly, the relevance of CMI and Vr is confirmed by fitting different predictive models: the fitted models which include the CMI predictor perform better than models which neglect the CMI, in terms of classical evaluation metrics. As a whole, considering the high predictive power of the proposed CMI-based models, this work provides valuable tools for the apriori assessment of IR.