Search

Function approximation has gained significant attention in reinforcement learning research as it effectively addresses problems with large-scale, continuous state, and action space.Although the function approximation algorithm based on gradient descent method is one of the most widely used methods in reinforcement learning, it requires careful tuning of the step size parameter as an inappropriate value can lead to slow convergence, unstable convergence, or even divergence.To address these issues, an improvement was made around the temporal-difference (TD) algorithm based on function approximation.The weight update method was enhanced using both the least squares method and gradient descent, resulting in the proposed weights gradient descent (WGD) method.The least squares were used to calculate the weights, combining the ideas of TD and gradient descent to find the error between the weights.And this error was used to directly update the weights.By this method, the weights were updated in a new manner, effectively reducing the consumption of computing resources by the algorithm enhancing other gradient descent-based function approximation algorithms.The WGD method is widely applicable in various gradient descent-based reinforcement learning algorithms.The results show that WGD method can adjust parameters within a wider space, effectively reducing the possibility of algorithm divergence.Additionally, it achieves better performance while improving the convergence speed of the algorithm.

Cadmium (Cd) is a common environmental pollutant that accumulates mainly in the kidneys and thus endangers the physiological health of aquatic animals. Selenium (Se) is a natural antidote to heavy metals that antagonises heavy metal toxicity and enhances the antioxidant capacity of organisms. Lactobacillus plantarum (L. plantarum) can reduce the toxicity of heavy metals through adsorption, reduction and metabolism. Studies have confirmed that the biological synthesis of Se nanoparticles (Bio-SeNPs) using bacterial microorganisms is simple, safe and less toxic than the synthesis of inorganic and organic Se, but the effect on Cd-induced immunosuppression is un-known. One hundred and eighty Bulatmai barbel (Luciobarbus capito: L. capito) plants were randomly divided into control (C), Cd and Cd + Se-enriched L. plantarum groups (S1L1-Cd) and fed for 28 days. The analysis methods included histopathology, test kits, transcriptomics and real-time quantitative PCR. The addition of selenium-enriched L. plantarum significantly attenuated cadmium-induced pathological changes such as glomerular atrophy, detachment of renal tubular epithelial cells, mild swelling, and interstitial inflammatory cell infiltration. Cd stress can lead to significant decreases in RBC, HCT, WBC, LZM, C3, and IgM levels, and the addition of Se-enriched L. plantarum can significantly reverse the changes in these indicators. Transcriptomic analysis revealed 488 DEGs in the Cd groups, 301 of which were upregulated and 187 of which were downregulated. There were 1474 DEGs in the S1L1-Cd group, of which 720 were upregulated and 754 were downregulated. In addition, GO enrichment analysis revealed that the biological regulation of the most differentially expressed genes involved metal ion binding, ATP binding and nucleotide inclusion. KEGG enrichment analysis revealed six of the most enriched pathways: oxidative phosphorylation, Huntington disease, retrograde endocannabinoid signalling, natural killer cell-mediated cyto-toxicity, the IL-17 signalling pathway, and leukocyte transient migration. Moreover, we selected 12 DEGs for qRT-PCR, which showed that the qRT-PCR results were consistent with our RNA-Seq results. Our results suggest that Se-enriched L. plantarum can enhance immunity and alleviate Cd exposure-mediated immunosuppression in L. capito. [ABSTRACT FROM AUTHOR]

As an emerging technology to convert environmental high‐entropy energy into electrical energy, triboelectric nanogenerator (TENG) has great demands for further enhancing the service lifetime and output performance in practical applications. Here, an ultra‐robust and high‐performance rotational triboelectric nanogenerator (R‐TENG) by bearing charge pumping is proposed. The R‐TENG composes of a pumping TENG (P‐TENG), an output TENG (O‐TENG), a voltage‐multiplying circuit (VMC), and a buffer capacitor. The P‐TENG is designed with freestanding mode based on a rolling ball bearing, which can also act as the rotating mechanical energy harvester. The output low charge from the P‐TENG is accumulated and pumped to the non‐contact O‐TENG, which can simultaneously realize ultralow mechanical wear and high output performance. The matched instantaneous power of R‐TENG is increased by 32 times under 300 r/min. Furthermore, the transferring charge of R‐TENG can remain 95% during 15 days (6.4 × 106 cycles) continuous operation. This work presents a realizable method to further enhance the durability of TENG, which would facilitate the practical applications of high‐performance TENG in harvesting distributed ambient micro mechanical energy. [ABSTRACT FROM AUTHOR]

Background: Hypoxic pulmonary hypertension (HPH) is a devastating and incurable disease characterized by pulmonary vascular remodeling, resulting in right heart failure and even death. Accumulated evidence has confirmed long coding RNAs (lncRNAs) are involved in hypoxia-induced pulmonary vascular remodeling in HPH. The exact mechanism of lncRNA in hypoxic pulmonary hypertension remains unclear., Methods: Microarray analysis was applied to investigate the profiles of lncRNA expression in pulmonary artery smooth muscle cells (PASMCs) cultured under hypoxia and normoxia condition. qRT-PCR was performed for the expression of lncRNAs, miRNA, and mRNAs, western blot analysis was employed for the detection of the expression of proteins. CCK-8 and transwell chamber assay were applied for the assessment of PASMC proliferation and migration, respectively. Besides, flow cytometry was performed for assessments of cell cycle progression. The binding between AC068039.4 and miR-26a-5p, miR-26a-5p, and TRPC6 3'UTR was detected by dual luciferase reporter assay., Results: A total of 1,211 lncRNAs (698 up-regulated and 513 down-regulated) were differently expressed in hypoxia-induced PASMCs. Consistent with microarray analysis, quantitative PCR verified that AC068039.4 was obviously up-regulated in hypoxia-induced PASMCs. Knocking down AC068039.4 alleviated proliferation and migration of PASMCs and regulated cell cycle progression through inhibiting cells entering the G0/G1 cell cycle phase. Further experiment indicated AC068039.4 promoted hypoxic PASMCs proliferation via sponging miR-26-5p. In addition, transient receptor potential canonical 6 (TRPC6) was confirmed to be a target gene of miR-26a-5p., Conclusion: In conclusion, downregulation of lncRNA AC068039.4 inhibited pulmonary vascular remodeling through AC068039.4/miR-26a-5p/TRPC6 axis, providing new therapeutic insights for the treatment of HPH., Competing Interests: The authors report no conflicts of interest., (Copyright © 2020 by the Shock Society.)