Search

Nuclear fusion using magnetic confinement, in particular in the tokamak configuration, is a promising path towards sustainable energy. A core challenge is to shape and maintain a high-temperature plasma within the tokamak vessel. This requires high-dimensional, high-frequency, closed-loop control using magnetic actuator coils, further complicated by the diverse requirements across a wide range of plasma configurations. In this work, we introduce a previously undescribed architecture for tokamak magnetic controller design that autonomously learns to command the full set of control coils. This architecture meets control objectives specified at a high level, at the same time satisfying physical and operational constraints. This approach has unprecedented flexibility and generality in problem specification and yields a notable reduction in design effort to produce new plasma configurations. We successfully produce and control a diverse set of plasma configurations on the Tokamak à Configuration Variable1,2, including elongated, conventional shapes, as well as advanced configurations, such as negative triangularity and ‘snowflake’ configurations. Our approach achieves accurate tracking of the location, current and shape for these configurations. We also demonstrate sustained ‘droplets’ on TCV, in which two separate plasmas are maintained simultaneously within the vessel. This represents a notable advance for tokamak feedback control, showing the potential of reinforcement learning to accelerate research in the fusion domain, and is one of the most challenging real-world systems to which reinforcement learning has been applied.

Seit zehn Jahren gibt es jährlich die Weltmeisterschaft Robocup für autonome, fußballspielende Roboter. Inzwischen sind der mechanische Aufbau der Roboter, die Sensorauswertung und Verhaltenssteuerung per Bordrechner so weit entwickelt, dass ein echtes Fußballspiel entstehen kann. Allerdings erfordert die Übertragung der Techniken von radbasierten Robotern auf zweibeinige, humanoide Roboter noch intensive Forschung. Das gilt auch für eine technische Ausstattung, die die Entwicklung eines umfassenden taktischen Spiels ermöglicht. Trotz des ermutigenden Fortschritts ist der Weg noch weit, bis ein Fußballroboter mit menschlichen Spielern mithalten kann.

The significance of distinct classes of HIV-1 nucleic acids as correlates of recent HIV-1 replication was assessed in peripheral blood mononuclear cells (PBMC) obtained from 14 patients during 2 weeks of structured interruption of antiretroviral therapy (STI) and 2 weeks of resuming therapy. Levels of HIV RNA in plasma (HIV-RNAplasma) and of unspliced cell-associated HIV-1 RNA (HIV-UsRNAPBMC) were significantly increased as a result of STI, whereas no significant shifts in the levels of 2-LTR episomal HIV-1 DNA (2-LTR circles) and total late HIV-1 reverse transcripts (late-DNA) were observed. Thus, limited viral replication had occurred, which had no effect on the pool size of infected cells in the periphery. Levels of 2-LTR circles did not reflect rapid changes in HIV-1 replication. In contrast, expression of HIV-UsRNAPBMCincreased during STI and consequently provides a more sensitive, albeit not absolute cellular marker of ongoing HIV-1 replication.

ABSTRACTThere is a continuing search for better ways to use existing drugs against human immunodeficiency virus (HIV). One idea is to use short therapy interruptions to “autovaccinate” HIV-infected patients. A group of 13 chronically HIV-infected patients enrolled in a trial of such so-called structured treatment interruptions (STIs) were intensively studied with respect to their viral load (VL) and HIV-specific CD8+T-cell (cytotoxic T-lymphocyte [CTL]) responses. We found that 10 of the 13 patients had plateau VLs after STIs that were lower than their pretreatment VLs. While viral rebound rates became lower over STIs, there were no changes in clearance rates. Although numbers of CTLs did increase over the same time that viral rebounds decreased, there was no correlation between CTL count and either viral rebound rates or clearance rates. Finally, we asked whether absolute numbers of or changes in numbers of CTLs predict plateau VLs after STIs. No measure of CTLs was able to predict plateau VLs. Thus, there was no signature in these data of an important contribution to virological control from HIV-specific CD8+T lymphocytes.