Representation learning for continuous action spaces is beneficial for efficient policy learning.

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems. While model-free RL, as a class of efficient DRL methods, performs the learning of state representations simultaneously with policy learning in an end-to-end manner when facing large-scale continuous state and action spaces. However, training such a large policy model requires a large number of trajectory samples and training time. On the other hand, the learned policy often fails to generalize to large-scale action spaces, especially for the continuous action spaces. To address this issue, in this paper we propose an efficient policy learning method in latent state and action spaces. More specifically, we extend the idea of state representations to action representations for better policy generalization capability. Meanwhile, we divide the whole learning task into learning with the large-scale representation models in an unsupervised manner and learning with the small-scale policy model in the RL manner. The small policy model facilitates policy learning, while not sacrificing generalization and expressiveness via the large representation model. Finally, the effectiveness of the proposed method is demonstrated by MountainCar, CarRacing and Cheetah experiments.

Treatment of radiation-induced brain injury with bisdemethoxycurcumin.

Radiation therapy is considered the most effective non-surgical treatment for brain tumors. However, there are no available treatments for radiation-induced brain injury. Bisdemethoxycurcumin (BDMC) is a demethoxy derivative of curcumin that has anti-proliferative, anti-inflammatory, and anti-oxidant properties. To determine whether BDMC has the potential to treat radiation-induced brain injury, in this study, we established a rat model of radiation-induced brain injury by administering a single 30-Gy vertical dose of irradiation to the whole brain, followed by intraperitoneal injection of 500 µL of a 100 mg/kg BDMC solution every day for 5 successive weeks. Our results showed that BDMC increased the body weight of rats with radiation-induced brain injury, improved learning and memory, attenuated brain edema, inhibited astrocyte activation, and reduced oxidative stress. These findings suggest that BDMC protects against radiation-induced brain injury.

Effects of Plasma Exchange Combined with Immunoglobulin Therapy on Consciousness, Immune Function, and Prognosis in Patients with Myasthenia Gravis Crisis: A Prospective Randomized Test.

Background: Myasthenia gravis (MG) is an acquired autoimmune disease. The main clinical features of MG are skeletal muscle fatigue and pathological fatigue, which worsen at night or after fatigue, such as dyspnea, dysphagia, and systemic weakness. Plasma exchange (PE) is often used in patients with acute exacerbation of MG. Intravenous immunoglobulin (IVIG) is a collection of immunoglobulins from thousands of donors. IVIG can replace a variety of immunosuppressants or PE. However, the effect of PE or IVIG on patients' consciousness, immune function, and prognosis is not clear. Objective: A prospective randomized test of the effects of PE combined with immunoglobulin on consciousness, immune function, and prognosis in patients with myasthenia gravis crisis (MGC). Methods: Sixty patients with MGC treated from February 2019 to April 2021 were enrolled in our hospital. The cases who received PE were set as the PE group, and those who received PE combined with immunoglobulin were set as the PE+immunoglobulin group. The efficacy, clinical score, state of consciousness, immune function, acetylcholine receptor antibody (AChR-Ab), lymphocyte (LYM), albumin (ALB) levels, and the incidence of adverse reactions were compared. Results: The improvement rate was 100.005% in the treatment group and 83.33% in the PE group. After treatment, the clinical score of the PE+immunoglobulin group was lower than that of the PE group, and the clinical relative score of the PE+immunoglobulin group was higher than that of the PE group (P < 0.05). The number of conscious people in the PE+immunoglobulin group was more than that in the PE group (P < 0.05). Immunoglobulin A, immunoglobulin M, immunoglobulin G, and immunoglobulin G in the PE+immunoglobulin group were higher than those in the PE group (P < 0.05). The levels of AChR-Ab and ALB in the PE+immunoglobulin group were higher than those in the PE group, while the level of LYM in the PE+immunoglobulin group was lower than that in the PE group. The incidence of skin system, gastrointestinal system, nervous system, and systemic damage in the PE+immunoglobulin group was lower than that in the PE group (P < 0.05). Conclusion: The treatment of MGC with PE combined with immunoglobulin can not only effectively enhance the consciousness and immune function of patients but also effectively promote the prognosis, and the safety of treatment can be guaranteed.

Community-Based Rehabilitation Promotes the Functional Recovery of Patients After Intracerebral Hemorrhage.

BACKGROUND: Intracerebral hemorrhage (ICH), a severe disorder with the high death rate, high recurrence rate and high disability rate, affected the quality of human life. Community-based rehabilitation (CBR) helps disabled people at both community and family levels. However, the effect of CBR on the recovery of people after ICH remains unclear. METHODS: Patients were treated with the CBR training program, subsequently, medication compliance test, clinical neural impairment measurements, functional comprehensive assessments, improved Barthel index score, and life qualities assessments were to performed at 3-month or 6-month intervention of CBR to evaluate the influence of CBR on the medication compliance, physical function and life quality of patients after ICH. RESULTS: After the treatment of CBR, we observed that, the rate of medication compliance, motor function, functional comprehensive rating scale score, modified Barthel index score, and generic quality of life inventory-74 in the CBR-treated group were significantly higher than that in the control group; the neural impairment measure score in the CBR-treated group was significantly decreased in comparison to the control group. CONCLUSION: CBR increased the medication compliance, promoted the recovery of the neurological function and improved the life qualities of ICH patients.