Search

Deep reinforcement learning has enabled robots to learn motor skills from environmental interactions with minimal to no prior knowledge. However, existing reinforcement learning algorithms assume an episodic setting, in which the agent resets to a fixed initial state distribution at the end of each episode, to successfully train the agents from repeated trials. Such reset mechanism, while trivial for simulated tasks, can be challenging to provide for real-world robotics tasks. Resets in robotic systems often require extensive human supervision and task-specific workarounds, which contradicts the goal of autonomous robot learning. In this paper, we propose an extension to conventional reinforcement learning towards greater autonomy by introducing an additional agent that learns to reset in a self-supervised manner. The reset agent preemptively triggers a reset to prevent manual resets and implicitly imposes a curriculum for the forward agent. We apply our method to learn from scratch on a suite of simulated and real-world continuous control tasks and demonstrate that the reset agent successfully learns to reduce manual resets whilst also allowing the forward policy to improve gradually over time., Comment: 8 pages, 6 figures; accepted for publication in the IEEE Robotics and Automation Letters (RA-L); source code available at https://github.com/jigangkim/autoreset_rl ; supplementary video available at https://youtu.be/himd0Z5b64A

The European Society for Radiotherapy and Oncology (ESTRO) recently defined delineation guidelines for the clinical target volume for postmastectomy radiation therapy (PMRT) after immediate implant-based reconstruction for early-stage breast cancer. We analyzed the three-dimensional location and pattern of local recurrence in accordance with the reconstruction type and ESTRO-target volume.This retrospective study involved patients who had undergone mastectomy with implant reconstruction between 2010 and 2019 and who had local recurrence as the first event. For mapping analysis, one subpectoral and one prepectoral implant patient were selected. All recurrence lesions were contoured and mapped in a representative case.A total of 1327 patients with breast cancer who underwent mastectomy and implant-based breast reconstruction were identified; 51 were enrolled with a total of 65 lesions. In subpectoral implant patients, 93% of recurrences were located in the ESTRO-target volume. No recurrence occurred in the implant pocket, but 7% of the recurrent tumors developed in the pectoralis major and deep thoracic muscle. In prepectoral implant patients, all recurrent tumors occurred within the ESTRO-target volume.The ESTRO-target volume in PMRT after reconstruction encompassed most local recurrences in patients who underwent mastectomy with immediate implant reconstruction. Our results support the application of the ESTRO Advisory Committee for Radiation Oncology Practice consensus guideline for target volume of PMRT after immediate implant-based reconstruction for early-stage breast cancer.

Purpose This study aimed to investigate the impact of postoperative radiotherapy (PORT) in de novo metastatic breast cancer (dnMBC) patients undergoing planned primary tumor resection (PTR) and to identify the subgroup of patients who would most benefit from PORT.Materials and Methods This study enrolled 426 patients with dnMBC administered PTR alone or with PORT. The primary and secondary outcomes were overall and progression-free survival (OS and PFS), respectively.Results The median follow-up time was 53.7 months (range, 3.1 to 194.4). The 5-year OS and PFS rates were 73.2% and 32.0%, respectively. For OS, clinical T3/4 category, triple-negative breast cancer (TNBC), postoperative chemotherapy alone were significantly poor prognostic factors, and administration of PORT failed to show its significance. Regarding PFS, PORT was a favorable prognostic factor (hazard ratio, 0.64; 95% confidence interval, 0.50 to 0.82; p < 0.001), in addition to T1/2 category, ≤ 5 metastases, and non-TNBC. According to the multivariate analyses of OS in the PORT group, we divided the patients into three groups (group 1, T1/2 and non-TNBC [n=193]; group 2, T3/4 and non-TNBC [n=171]; and group 3, TNBC [n=49]), and evaluated the effect of PORT. Although PORT had no significance for OS in all subgroups, it was a significant factor for good prognosis regarding PFS in groups 1 and 2, not in group 3.Conclusion PORT was associated with a significantly better PFS in patients with dnMBC who underwent PTR. Patients with clinical T1/2 category and non-TNBC benefited most from PORT, while those with TNBC showed little benefit.

A moving bed biofilm reactor (MBBR) process in wastewater treatment plants (WWTPs) uses plastic carriers, called biofilm carrier, to increase their treatment efficiency. Biofilm carrier is made up of plastic, containing the OPEs as flame retardants or plasticizers, so OPEs in biofilm carrier are possible to release from WWTPs to the river. This study investigated the effect of the MBBR process in WWTP on aquatic environments, focusing on OPEs. OPE eluted from the biofilm carrier by leaching test was tris(2-chloroethyl) phosphate (TCEP), and the concentration of the effluent compared to the influent was increased in the WWTP of the MBBR process. 3609 mg/day of TCEP would be discharged into the water using the second-order model with rate constant [Formula: see text] = 0.000451 (ng L

A bibliometric approach using network analytical methods was applied to explore the research trends on acupuncture for neck pain treatment. Publications related to acupuncture for neck pain treatment from 2000 to 2020 were retrieved from the Web of Science database. The extracted records were analyzed in terms of publication year, research area, journal title, country, organization, authors, and keywords. The research trends on acupuncture for neck pain treatment were visualized using the VOSviewer program. Analyses of 325 articles revealed that the total number of publications has continually increased over the last 20 years. The most represented research area was integrative complementary medicine. The country producing the most articles was the US, followed by China, England, and the Republic of Korea. By assessing the total link strength of organizations and authors, we identified influential organizations and authors who have contributed to research on acupuncture for neck pain treatment. A network analysis based on the cooccurrence of keywords revealed the following two major study designs: clinical study and research methodology. This study examined the research trends on acupuncture for neck pain treatment using bibliometric methods. Our findings provide useful guidelines for researchers in searching for relevant topics.

This study aimed to propose a protocol to demonstrate the efficacy of Codonopsis lanceolata water extract for the improvement of skeletal muscle mass (SMM) and function (muscle strength or performance function) and its safety compared to a placebo in adults with reduced muscle strength.A randomized double-blind placebo-controlled clinical trial was conducted. Participants will be recruited from the Korean Medicine Hospital in South Korea. One hundred and four adults with reduced muscle strength will be randomly assigned a 1:1 ratio to either the experimental or placebo comparator groups. The participants will consume the product corresponding to their assigned group for the following 12 weeks, and efficacy and safety tests will be conducted. This is the first clinical trial of C lanceolata water extract in adults with reduced muscle strength. The results of this study would provide a clinical basis for the efficacy and safety of C lanceolata water extract in patients with sarcopenia.This trial was approved by the Institutional Review Board (IRB) of Kyung Hee University Korean Medicine Hospital at Gangdong on July 15, 2021 (amendment number: MLB_DDE_H01 [ver. 01]). When a change was made in the clinical trial plan, the IRB reviewed and approved the revised clinical trial plan. The study was registered on the Clinical Research Information Service website on December 3, 2021 (registration number: PRE20211203-003; https://cris.nih.go.kr/cris/search/detailSearch.do?seq=20841status=1seq_group=20841search_page=M). The results of this clinical trial will be reported in the future. Every document related to the clinical trial, such as the electronic case report form, will be recorded and classified by the subject identification code and not by the subject name.

External beam radiotherapy is effective for stage I orbital mucosa-associated lymphoid tissue lymphoma (MALToma). Hence, very-low-dose radiotherapy is increasingly being investigated. We conducted a single-center prospective phase II trial to evaluate the effectiveness of very-low-dose radiotherapy of 4 Gy (2 Gy × 2 fractions) in pathologically confirmed stage I orbital MALToma. In this first prospective trial, patients with complete response were observed after 3–6 months of follow-up. For patients without complete remission, a radiation dose of 24 Gy/12 fractions was additionally delivered. The primary endpoint was complete response rate; secondary endpoints were overall survival, local control, and progression-free survival. Seventeen patients were screened and three patients refused enrollment during October 2018–October 2021. Thus, 14 patients (17 eyes) were analyzed (median follow-up, 28.2 months). The overall response rate was 100% (complete remission: 11 lesions; partial remission: six lesions). In all lesions with residual disease, additional radiation therapy (dose: 24 Gy) was performed. One local failure was observed. Therefore, 4 Gy ultralow-dose radiation therapy for orbital MALToma was safely performed with a planned second-line treatment in patients without complete remission. This is the first prospective study to report the effectiveness of ultralow-dose radiotherapy of 4 Gy for stage I orbital MALToma treatment.

Introduction Indications for therapeutic plasma exchange (TPE) have expanded over the years, and the number of procedures is expected to have been increased. Apheresis registries can be difficult to sustain due to workload and privacy issues. This study aimed to analyze national claims data to characterize the use of TPE. Materials and methods Patients who underwent TPE were retrospectively identified between January 2008 and December 2017 from the Korean Health Insurance Review and Assessment Service database. Data of patients' characteristics, primary diagnosis, hospitalization, treatment, and procedures were analyzed. Results A total of 9944 patients underwent 62 606 TPE procedures. The median number of TPE procedures performed per patient was 5 (interquartile range, 3-7). Fresh frozen plasma (71.4%) was most commonly used as the replacement fluid. The most common indication was renal diseases (36.8%), followed by hepato-biliary (17.6%) and hematological (15.2%) diseases. Increased frequency of renal diseases was the most remarkable change, which increased from 529 (21.2%) procedures in 2008 to 4107 (44.5%) procedures in 2017, reflecting the widespread implementation of ABO-incompatible kidney transplantation. The top five hospitals conducted 59.6% of the procedures, which showed a centralized distribution. Conclusions The most common indication was renal diseases. The number of TPE procedures performed annually increased by approximately 3.7 times from 2008 to 2017. This study shows that other than a registry, claims data can be successfully used to analyze various aspects of TPE procedures on a nationwide scale. This approach could be used by other countries, especially those that have national health insurance.

We aimed to determine the optimal pressure of continuous positive airway pressure (CPAP) for radiotherapy (RT) through changes in the dosimetric parameters and lung volume according to pressure. Patients with locally advanced lung cancer, who underwent CPAP during computed tomography (CT) simulation, were included. The air pressure was raised in five steps of 4, 7, 10, 14, and 17 cmH2O and a CT scan was performed at the baseline and at each pressure step, accompanied by contouring and RT planning. Paired t- and Wilcoxon signed rank tests were used to compare the volumetric and dosimetric parameters according to pressure and interpressure. A total of 29 patients were selected, and 158 CT datasets were obtained. The lung volume increased significantly at all pressures (p < 0.01). The Dmean of the lung decreased significantly from 7 cmH2O (p < 0.01), the V5, V10, V15, and V20 of the lung decreased significantly from 7 cmH2O with increasing pressure, and the Dmean and V5 of the heart decreased significantly from 14 cmH2O with increasing pressure. The V50 showed no significant differences at any pressure. We recommend the use of at least 7 cmH2O with 14 cmH2O as the optimal pressure to achieve the effect of heart preservation.

Background Isolated musculocutaneous nerve injury is a rare condition. Herein, we report the first case of bilateral musculocutaneous neuropathy after vigorous stretching of both upper extremities with normal results of sensory nerve action potential. Clinicians should be aware of this rare condition that can appear bilaterally. In addition, the interpretation of the aberrant electrodiagnostic study results of this case was discussed. Case summary A 29-year-old male complaining of bilateral forearm tingling and upper extremity weakness visited the outpatient clinic. The symptoms began 6 mo prior, and he visited another hospital before visiting our department. The diagnosis was not made even after cervical spine magnetic resonance imaging, electrodiagnostic study, brain magnetic resonance imaging, and arteriography were conducted. The patient performed unique exercises that stretched the pectoralis minor and coracobrachialis muscles. On the follow-up electrodiagnostic study, abnormal spontaneous activities in the bilateral biceps and brachialis muscles were observed. The patient was diagnosed with bilateral musculocutaneous neuropathy. Steroid pulse therapy was administered for approximately 6 wk. After treatment, his muscle strength returned to the predisease condition. Conclusion Clinicians should be aware of this condition, have adequate understanding of anatomy, and advise to correct inappropriate exercises.

We report a unique dynamic morphology transformation of a Ag+-coordinated supramolecular nanostructure accompanying the conversion of complex structures in aqueous solution. In the presence of AgNO3 (1.0 equiv), the achiral bipyridine-based ligand 1G, possessing hydrazine and glycine moieties, preferentially generated a 1D needle-like structure (nanostructure I) based on the 1GAgNO3 complex (1G:Ag+ = 1:1) as a metastable product. Nanostructure I was then transformed into nanostructure II, which was composed of the 1G3Ag2(NO3)2 complex (1G:Ag+ = 3:2) as the thermodynamically stable product. This nanostructure exhibited a 1D helical tubular structure with a uniform diameter via a 2D ribbon as an intermediator, which led to the generation of a circular dichroism (CD) signal with right-handed (P-type) helicity. The observed dynamic transformation was attributed to formation of the thermodynamically favored helical 1G3Ag2(NO3)2 complex. In addition, the helical 1G3Ag2(NO3)2 complex acted as an initiator in the transformation from the 1D needle-like structure to the 1D helical tube via a 2D ribbon. The enhanced ΔG° value of nanostructure II compared to that of nanostructure I confirmed that nanostructure II is thermodynamically stable. More importantly, the transformation of supramolecular nanostructure I to nanostructure II occurred via an "on" pathway, even though the 1GAgNO3 complex was converted to the 1G3Ag2(NO3)2 complex, which did not involve dissociation from nanostructure I into the monomeric 1GAgNO3 complex species. In the kinetic study, the NO3- anion was found to act as an accelerator for the dynamic transformation from nanostructure I to nanostructure II. This result provides the first example of a dynamic transformation of a 1D needle-like structure into a 1D tubular structure via a 2D ribbon structure, accompanied by the conversion of a complex structure and the generation of a large CD signal for the metallo-supramolecular nanostructure. This study may open up new avenues to the understanding of a dynamic morphology transformation process in biological systems.

Purpose Concurrent chemoradiotherapy (CCRT) is recommended as the standard treatment for locally advanced cervical cancer (LACC). However, the synergistic effect of hyperthermia (HT) with CCRT remains unclear. Therefore, we performed a meta-analysis to evaluate the effect of HT with CCRT on LACC patients. Methods and materials A systematic literature search was conducted on the MEDLINE, PubMed, Embase, Cochrane library and SCOPUS databases for articles that compared CCRT with HT and CCRT alone as treatments for LACC. Hazard ratios (HRs) and risk ratios (RRs) were used to compare five-year overall survival (OS), local relapse-free survival (LRFS) and incidence of acute and chronic toxicity between the two treatments. Results Two articles out of 2860 were finally selected for analysis. A total of 536 patients were evaluated (CCRT with HT group: 268, CCRT group: 268). FIGO stages I–II and III–IV were found in 295 (55.0%) and 241 patients (45.0%), respectively. The CCRT with HT group had significantly better five-year OS than the CCRT group (HR 0.67, 95% confidence interval [CI] 0.47–0.96, p = 0.03). LRFS of patients was superior in the CCRT with HT group than in the CCRT group, but without significance (HR 0.74, 95% CI 0.49–1.12; p = 0.16). Moreover, there was no difference between the two groups regarding acute and chronic toxicity. Conclusion This systematic review and meta-analysis showed that CCRT with HT significantly improved OS in LACC patients without increasing acute and chronic toxicity. Therefore, tri-modality treatment could be a feasible approach for patients with LACC.

The lock-up clutch of a torque converter is used to enhance the efficiency of the automatic transmission. It is composed of a circumferential friction surface and a torsional damper spring. A damper spring is shocked by the dynamic load transmitted from the engine output shaft and transmission input shaft. The causes of this dynamic load are the engine torque, shifting shock, and impact torque of the driving wheel. Engine shock or shifting shock can be predicted through a performance test. However, the impact of the driving wheel is unpredictable due to the random road conditions. In this study, typical dynamic loading conditions are considered in order to calculate the impact of the damper spring. Quantitative analysis shows that the impact of the driving wheel is 5.8 times that of the engine’s exciting torque.

Jaehyeon Park,1,* Hyungsuk Kim,1,2,* Mi-Yeon Song1 1Department of Korean Rehabilitation Medicine, College of Korean Medicine, Kyung Hee University, Seoul, Republic of Korea; 2Department of Korean Rehabilitation Medicine, Kyung Hee University Medical Center, Seoul, Republic of Korea*These authors contributed equally to this workCorrespondence: Mi-Yeon SongDepartment of Korean Rehabilitation Medicine, College of Korean Medicine, Kyung Hee University, 23 Kyungheedaero, Dongdaemun-gu, Seoul, 02447, Republic of KoreaTel +82 2-440-7141Fax +82 2-958-9104Email mysong@khu.ac.kr View the original paper by Dr Park and colleagues This is in response to the Letter to the Editor

Background Neoadjuvant chemoradiotherapy (nCRT) followed by surgery is a standard treatment modality for locally-advanced esophageal cancer. However, patients who achieve clinical complete response (cCR) after nCRT have been reported to have better prognosis. Further, the role of surgery in these patients is controversial. Thus, this meta-analysis aimed to evaluate whether surgery is still useful in patients with cCR after nCRT. Methods We systematically reviewed the MEDLINE, PubMed, Embase, Cochrane library, and Scopus databases for studies on surgical efficacy in complete responders after concurrent chemoradiotherapy for esophageal cancer. The publication date was set to January 1, 2010–January 31, 2020. The hazard ratio (HR) and risk ratio were used to compare the 2-year overall survival (OS), disease-free survival (DFS), incidence of locoregional failure, distant metastasis, and treatment mortality between the nCRT and nCRT plus surgery groups. Results Six articles involving 609 patients were included. There was a significant benefit of nCRT for OS (HR = 0.80, 95% confidence interval [CI] 0.64–0.99, p = 0.04), but not for DFS (HR = 1.55, 95% CI 0.35–6.86, p = 0.56). The nCRT group tended to have lower mortality than the nCRT plus surgery group (risk ratio = 0.15, 95% CI 0.02–1.18, p = 0.07). Conclusion Omitting surgery provides better OS in complete responders after nCRT. Adding surgery could increase the morbidity and mortality and decrease the quality of life. Thus, nCRT alone could be a feasible approach for patients with cCR.

Plasma cell leukemia (PCL) is clinically and genetically distinct from multiple myeloma (MM), despite controversies regarding the disease definition. To determine the distinct features of PCL, the genetic property of primary PCL (pPCL) was compared with that of secondary PCL (sPCL) and MM. In patients with pPCL, Eighty-nine non-synonymous mutations were observed in 68 genes. The most frequently mutated genes were

Purpose The aim of this study is to evaluate the efficacy and feasibility of four-field box whole brain radiotherapy (FB-WBRT) with tilting baseplate by comparing bilateral WBRT (B-WBRT). Methods and Materials Between March 2016 and September 2018, 20 patients with brain metastases underwent WBRT using the four-field box technique. WBRT is performed with a dose of 30 Gy in 10 fractions daily. Two computed tomography simulations per person were performed. One was in the traditional supine position for B-WBRT and the other by applying the tilting acrylic supine baseplate to elevate the head by 40° for FB-WBRT. The B-WBRT used the field-in-field technique, which is the most commonly used method in our institution. The FB-WBRT comprised anterior, posterior, and bilateral beams. A wedge was applied in anterior and posterior fields to compensate for skull convexity. Results The average of Dmean of both parotid glands was 10.2 Gy (range, 3.8 to 17.8 Gy) in B-WBRT and 5.4 Gy (range, 2.0 to 11.7 Gy) in FB-WBRT (p < 0.05). Compared to B-WBRT, FB-WBRT reduced the mean dose of the right and left parotid glands from 10.1 Gy to 4.9 Gy and from 10.4 Gy to 5.8 Gy, respectively (p < 0.05). Further, V5, V10, V15, V20, and V25 for the parotid gland decreased significantly in FB-WBRT (p < 0.05). The Dmax and Dmean of lens decreased according to the dose-volume histogram. Conclusion Compared to B-WBRT, FB-WBRT with a tilting baseplate is a simple and effective method that takes feature of noncoplanar beam to protect the parotid gland.

The bladder is subject to filling variation, which poses a challenge to radiotherapy (RT) delivery. We aimed to assess feasibility and clinical outcomes in patients with bladder cancer treated with adaptive RT (ART) using individualized plan libraries. We retrospectively analyzed 19 patients who underwent RT for muscle-invasive bladder cancer (MIBC) in 2015–2021. Four planning computed tomography (CT) scans were acquired at 15-min intervals, and a library of three intensity-modulated RT plans were generated using internal target volumes (ITVs). A post-treatment cone-beam CT (CBCT) scan was acquired daily to assess intra-fraction filling and coverage. All patients completed the treatment, with 408 post-treatment CBCT scans. The bladder was out of the planning target volume (PTV) range in 12 scans. The volumes of the evaluated PTV plans were significantly smaller than those of conventional PTV. The 1-year and 2-year overall survival rates were 88.2% and 63.7%, respectively. Of eight cases that experienced recurrence, only two developed MIBC. There were no grade 3 or higher RT-related adverse events. ART using plan libraries and ITVs demonstrated good survival outcomes with a high local control rate. Irradiated normal tissue volume and treatment margins may be reduced through this approach, potentially resulting in lower toxicity rates.