Deep deterministic policy gradient algorithm: A systematic review.

Deep Reinforcement Learning (DRL) has gained significant adoption in diverse fields and applications, mainly due to its proficiency in resolving complicated decision-making problems in spaces with high-dimensional states and actions. Deep Deterministic Policy Gradient (DDPG) is a well-known DRL algorithm that adopts an actor-critic approach, synthesizing the advantages of value-based and policy-based reinforcement learning methods. The aim of this study is to provide a thorough examination of the latest developments, patterns, obstacles, and potential opportunities related to DDPG. A systematic search was conducted using relevant academic databases (Scopus, Web of Science, and ScienceDirect) to identify 85 relevant studies published in the last five years (2018-2023). We provide a comprehensive overview of the key concepts and components of DDPG, including its formulation, implementation, and training. Then, we highlight the various applications and domains of DDPG, including Autonomous Driving, Unmanned Aerial Vehicles, Resource Allocation, Communications and the Internet of Things, Robotics, and Finance. Additionally, we provide an in-depth comparison of DDPG with other DRL algorithms and traditional RL methods, highlighting its strengths and weaknesses. We believe that this review will be an essential resource for researchers, offering them valuable insights into the methods and techniques utilized in the field of DRL and DDPG.

Influence of Dietary Probiotic and Alpha-Monolaurin on Performance, Egg Quality, Blood Constituents, and Egg Fatty Acids' Profile in Laying Hens.

This work was designed to evaluate the advantages of using multi-strain probiotics feed (Bacillus subtilis, Bacillus licheniformis and Clostridium butyricum) (PRO) and alpha-monolaurin (AML) on laying performance, criteria of egg quality, blood parameters, and yolk fatty acids' profile in laying hens. One hundred forty of Bovans brown laying hens at 45 weeks old (25th week of egg production) were randomly allocated into four groups, with seven replicates of five birds each in a complete randomized design. The first group was fed a basal diet without feed additives (0 g/kg diet), and the second, third, and fourth groups received diets containing 1 g PRO, 1 g AML, and 1 g PRO + 1 g AML/kg diet, respectively. No significant impacts of PRO, AML, or their mixture on body weight (BW), body weight gain (BWG), feed intake (FI), or egg weight. Egg production, egg mass, and feed conversion ratio (FCR) were enhanced by 1 g PRO/kg and /or 1 g AML/kg supplementation in laying hen diets. Furthermore, egg shape index, eggshell thickness, and yolk color were statistically higher by PRO and AML supplementation at 55 weeks. However, oviduct, infundibulum, and uterus weights were significantly decreased by 1 g PRO or/and 1 g AML. Additionally, total cholesterol, triglycerides, low density lipoprotein (LDL), glucose, and glutamate pyruvate transaminase (GPT) levels were decreased by PRO and AML supplementation. In conclusion, it seems that dietary inclusion with 1 g PRO/kg, 1 g of AML/kg, and 1 g PRO + 1 g AML improved egg production, egg mass, FCR, and yolk fatty acids profile and lowered total cholesterol and malondialdehyde (MDA) contents in laying hens.

Red cell distribution width as a predictor of outcome in hospitalized cirrhotic patients.

BACKGROUND: A systemic inflammatory response syndrome (SIRS) is linked to red cell distribution width (RCDW), which produces pro-inflammatory signals that act directly on hematopoietic stem cells in the bone marrow. This stimulation may cause alterations in the membrane of red blood cells (RBCs), as assessed by RCDW, which have been linked to increased morbidity and death in a number of systemic disorders. AIM: This study aims to evaluate RCDW as a predictor of outcome in hospitalized cirrhotic patients. METHODS: This prospective cross-sectional study was conducted on 1000 patients. The outcome was assessed by days of hospitalization; mortality in hospitalized patients or during short-term follow-up (3 months) and rehospitalization during follow-up of 6 months. RESULTS: Male represented 69.6%. Mean age was 57.67 ± 13.07 years old. Baseline co-morbidities were recorded as the presence of diabetes mellitus (200 patients) and hypertension (400 patients). Hepatitis C virus was the commonest etiology of the diseased liver (90%). Child-Pugh classes A, B and C of studied patients represented (21.2%, 38.8% and 40%). The survived patients during follow-up represented 63.3%. Area under the curve for RCDW was 0.923 (95% CI, 0.904-0.943), 0.910 for C-reactive protein (95% CI, 0.890-0.930), 0.904 for Hb (95% CI, 0.883-0.925) and 0.903 for platelets (95% CI, 0.882-0.924). RCDW cutoff point at 21.35 for predicting survival had sensitivity 93%, specificity 91%, accuracy 92%, positive predictive value 85 and negative predictive value 96. Regression analysis revealed a significant positive association between both RCDW and white blood cells with mortality. CONCLUSION: RCDW could provide useful information for predicting the length of hospitalization and survival in hospitalized cirrhotic patients.

FCY-302, a Novel Small Molecule, Induces Apoptosis in Leukemia and Myeloma Cells by Attenuating Key Antioxidant and Mitochondrial Enzymes.

Arylidene analogs are well proven for biological activities. FCY-302, a novel small molecule belonging to this class, was screened for its biological efficacy in leukemia and myeloma cells. FCY-302 selectively inhibited proliferation of cancer cells with GI50 values of 395.2 nM, 514.6 Nm, and 642.4 nM in HL-60, Jurkat, and RPMI-8226 cells, respectively. The compound also increased sub-G0 peak in the cancer cell cycle and favored apoptosis determined by annexin V assay. The compound decreased the antiapoptotic Bcl-2 levels and increased proapoptotic Bax proteins in leukemia and myeloma cell lines. FCY-302 attenuated the mitochondrial membrane-bound Na+/K+ ATPase, Ca2+ ATPase, and Mg2+ ATPase enzyme activities and significantly decreased activities of antioxidant enzymes like SOD, CAT, GR, and GST in all the three cancer cells tested. Our findings suggest that FCY-302 inhibits the proliferation of leukemia and myeloma cancer cells by altering key mitochondrial and antioxidant enzymes, eventually driving them to apoptosis. These results drive focus on FCY-302 and its analogs to be developed as potential small molecules with bioactivities against cancer.

Early Repolarization Pattern Is Associated with Increased Risk of Early Ventricular Arrhythmias during Acute ST Segment Elevation Myocardial Infarction.

BACKGROUND: Early repolarization (ER) and acute ST segment elevation myocardial infarction (STEMI) are sharing the pathophysiology of J wave syndromes. It is speculated that early ventricular arrhythmias (VAs) during STEMI may be predisposed by ER. Our aim was to study the association between ER pattern and risk of VAs during acute STEMI. METHODS: The study included 102 male patients with acute STEMI who were divided into two groups: cases and controls. Cases included 52 patients with sustained VAs during the first 48 hours from the onset of STEMI, while controls included 50 patients with no VAs. On 12-lead surface electrocardiogram, ER was defined as ≥ 1 mm elevation of J point in at least two inferior or lateral leads with or without ST segment elevation. RESULTS: Mean age was 48.44 ± 10.08 years and mean left ventricular ejection fraction (LVEF) was 42.25 ± 11.1%. ER pattern was more frequent in cases than controls (29 vs 14 patients, P = 0.008). Notched J wave (P = 0.0007) and horizontal ST segment (P = 0.033) were more frequent in cases than controls. On adjusted regression model, LVEF (OR: 0.95, 95% CI: 0.91-0.99, P = 0.015) and ER (OR: 3.39, 95% CI: 1.41-8.12, P = 0.006) could predict VAs, while QTc interval (P = 0.24) and QTd (P = 0.86) did not have predictive effect. Inferior/inferolateral and global ER pattern (P = 0.044 and 0.031 respectively), notched J wave (P = 0.001), increasing J wave amplitude (P = 0.042), and ST segment elevation (P = 0.001) were associated with a higher risk of VAs. CONCLUSIONS: ER is associated with increased risk of VAs in the setting of acute STEMI.

Bacterial translocation in an experimental intestinal obstruction model. C-reactive protein reliability?

BACKGROUND: Bacterial translocation occurs in preseptic conditions such as intestinal obstruction through unclear mechanism. The C-reactive protein is an acute phase reactant and a marker of ischemia. METHODS: 45 albino male rats were divided into 3 groups each 15 rats. GI control, GII simple intestinal-obstruction and GIII strangulated obstruction. Outcome measures were: (1) Bacteriologic count and typing for intestinal contents, intestinal wall, liver, mesenteric lymph nodes and blood (cardiac and portal) (2) Histopathologic: mucosal injury score, inflammatory cell infiltrate in the wall, MLN, liver, (3) Biochemical: serum CRP, IL-10, mucosal stress pattern (glutathione peroxidase-malonyldialdhyde tissue levels). RESULTS: (1) Intestinal obstruction associates with BT precursors (Bact-overgrowth, mucosal-acidosis, immuno-incomptence), (2) Bacterial translocation (frequency and density) was found higher in strangulated I.O, that was mainly enteric (aerobic and anaerobic) and mostly E.coli, (3) The pathogen commonality supports the gut origin hypothesis but the systemic inflammatory response goes with the cytokine generating one. (4) The CRP median values for GI, II, III were 0.5, 6.9, 8.5 mg/L, for BT +ve 8 mg/L and 0.75 mg/L for BT -ve rats. CONCLUSION: Bacterial translocation occurs bi-directional (systemic-portal) in intestinal obstruction and the resultant inflammatory response pathogenesis is mostly 3 hit model. The CRP is a non selective marker of suspected I.O cases. However, it is a reliable marker of BT, BT density and vascular compromise during I.O.

Bacterial translocation in an experimental intestinal obstruction model: C-reactive protein reliability? / Translocação bacteriana no modelo experimental de obstrução intestinal: A proteína C-reativa é confiável?

BACKGROUND: Bacterial translocation occurs in preseptic conditions such as intestinal obstruction through unclear mechanism. The C-reactive protein is an acute phase reactant and a marker of ischemia. METHODS: 45 albino male rats were divided into 3 groups each 15 rats. GI control, GII simple intestinal-obstruction and GIII strangulated obstruction. Outcome measures were: (1) Bacteriologic count and typing for intestinal contents, intestinal wall, liver, mesenteric lymph nodes and blood (cardiac and portal) (2) Histopathologic: mucosal injury score, inflammatory cell infiltrate in the wall, MLN, liver, (3) Biochemical: serum CRP, IL-10, mucosal stress pattern (glutathione peroxidase-malonyldialdhyde tissue levels). RESULTS: (1) Intestinal obstruction associates with BT precursors (Bact-overgrowth, mucosal-acidosis, immuno-incomptence), (2) Bacterial translocation (frequency and density) was found higher in strangulated I.O, that was mainly enteric (aerobic and anaerobic) and mostly E.coli, (3) The pathogen commonality supports the gut origin hypothesis but the systemic inflammatory response goes with the cytokine generating one. (4) The CRP median values for GI, II, III were 0.5, 6.9, 8.5 mg/L, for BT +ve 8 mg/L and 0.75 mg/L for BT -ve rats. CONCLUSION: Bacterial translocation occurs bi-directional (systemic-portal) in intestinal obstruction and the resultant inflammatory response pathogenesis is mostly 3 hit model. The CRP is a non selective marker of suspected I.O cases. However, it is a reliable marker of BT, BT density and vascular compromise during I.O.

OBJETIVO: Translocação bacteriana ocorre em condições pré-sépticas como na obstrução intestinal por mecanismo não esclarecido. A proteína C-reativa é um marcador de ischemia em fase aguda. A proposição é investigar os possíveis efeitos da obstrução intestinal no equilíbrio ecológico microbiano. MÉTODOS: 45 ratos machos albinos foram distribuídos em três grupos de 15 ratos. GI controle, GII obstrução intestinal simples e GIII obstrução estrangulada. As medidas adotadas foram: (1) Contagem bacteriológica do conteúdo intestinal, parede intestinal, fígado, linfonodos mesentéricos e sangue (coração e portal) (2) Avaliação histopatológica da lesão da mucosa, infiltrado celular inflamatório da parede, linfonodos mesentéricos, fígado, (3) Avaliação bioquímica. RESULTADOS: (1) Obstrução intestinal está associada a precursora translocação bacteriana (crescimento bacteriano, acidose da mucosa, imuno-incompetência), (2) Translocação bacteriana (freqüência e densidade) foi maior na obstrução intestinal estrangulada, principalmente entérica (aeróbios e anaeróbios), sobretudo E.coli, (3) A ocorrência comum é de origem intestinal. CONCLUSÃO: A translocação bacteriana na obstrução intestinal é bi-direcional (sistêmica e portal) A proteina C-reativa não é um marcador seletivo na suspeita de obstrução intestinal. Contudo é marcador confiável da translocação bacteriana, na densidade e comprometimento durante a obstrução intestinal.