Search

Multi-Agent Reinforcement Learning (MARL) is a promising candidate for realizing efficient control of microscopic particles, of which micro-robots are a subset. However, the microscopic particles' environment presents unique challenges, such as Brownian motion at sufficiently small length-scales. In this work, we explore the role of temperature in the emergence and efficacy of strategies in MARL systems using particle-based Langevin molecular dynamics simulations as a realistic representation of micro-scale environments. To this end, we perform experiments on two different multi-agent tasks in microscopic environments at different temperatures, detecting the source of a concentration gradient and rotation of a rod. We find that at higher temperatures, the RL agents identify new strategies for achieving these tasks, highlighting the importance of understanding this regime and providing insight into optimal training strategies for bridging the generalization gap between simulation and reality. We also introduce a novel Python package for studying microscopic agents using reinforcement learning (RL) to accompany our results., Comment: 12 pages, 5 figures

Abstract We experimentally demonstrate critical collective behavior in a system of active colloidal particles (APs), achieved through variations of their mutual interactions using feedback control. At the transition between a swarm and a swirl we observe an explicit bifurcation dynamics of the rotational order parameter and a critical slowing down, i.e., a growth of the relaxation time by almost one order of magnitude. Additional signatures of critical dynamics, including hysteresis in presence of symmetry-breaking particle interactions, and a maximum of the susceptibility, are measured and characterized in terms of a theoretical model which is based purely on the time-reversal symmetry of the order parameter.

This corrects the article DOI: 10.1103/PhysRevLett.125.258002.

Recent experiments show a strong rotational diffusion enhancement for self-propelled microrheological probes in colloidal glasses. Here, we provide microscopic understanding using simulations with a frictional probe-medium coupling that converts active translation into rotation. Diffusive enhancement emerges from the medium's disordered structure and peaks at a second-order transition in the number of contacts. Our results reproduce the salient features of the colloidal glass experiment and support an effective description that is applicable to a broader class of viscoelastic suspensions.

Activity and autonomous motion are fundamental in living and engineering systems. This has stimulated the new field of 'active matter' in recent years, which focuses on the physical aspects of propulsion mechanisms, and on motility-induced emergent collective behavior of a larger number of identical agents. The scale of agents ranges from nanomotors and microswimmers, to cells, fish, birds, and people. Inspired by biological microswimmers, various designs of autonomous synthetic nano- and micromachines have been proposed. Such machines provide the basis for multifunctional, highly responsive, intelligent (artificial) active materials, which exhibit emergent behavior and the ability to perform tasks in response to external stimuli. A major challenge for understanding and designing active matter is their inherent nonequilibrium nature due to persistent energy consumption, which invalidates equilibrium concepts such as free energy, detailed balance, and time-reversal symmetry. Unraveling, predicting, and controlling the behavior of active matter is a truly interdisciplinary endeavor at the interface of biology, chemistry, ecology, engineering, mathematics, and physics. The vast complexity of phenomena and mechanisms involved in the self-organization and dynamics of motile active matter comprises a major challenge. Hence, to advance, and eventually reach a comprehensive understanding, this important research area requires a concerted, synergetic approach of the various disciplines. The 2020 motile active matter roadmap of Journal of Physics: Condensed Matter addresses the current state of the art of the field and provides guidance for both students as well as established scientists in their efforts to advance this fascinating area.

Microorganisms are able to overcome the thermal randomness of their surroundings by harvesting energy to navigate in viscous fluid environments. In a similar manner, synthetic colloidal microswimmers are capable of mimicking complex biolocomotion by means of simple self-propulsion mechanisms. Although experimentally the speed of active particles can be controlled by e.g. self-generated chemical and thermal gradients, an in-situ change of swimming direction remains a challenge. In this work, we study self-propulsion of half-coated spherical colloids in critical binary mixtures and show that the coupling of local body forces, induced by laser illumination, and the wetting properties of the colloid, can be used to finely tune both the colloid’s swimming speed and its directionality. We experimentally and numerically demonstrate that the direction of motion can be reversibly switched by means of the size and shape of the droplet(s) nucleated around the colloid, depending on the particle radius and the fluid’s ambient temperature. Moreover, the aforementioned features enable the possibility to realize both negative and positive phototaxis in light intensity gradients. Our results can be extended to other types of half-coated microswimmers, provided that both of their hemispheres are selectively made active but with distinct physical properties.

The main subject of this thesis is to examine thermo-osmotic flows, which occur on interfaces of non-uniform temperature. Such thermo-osmotic flows are purely non-thermal equilibrium phenomena. Along the non-isothermal interface, specific interaction of a liquid and its solutes with a boundary vary in strength across the interface, according to the local temperature. This boundary can be a solid, a membrane or a phase boundary. The flow is thereby continuously pumping fluid across the interface in direction of the local temperature gradient, resulting in an extended flow pattern in the bulk due to mass conservation. In a system containing particles and heat sources in a liquid under spatial confinement, the thermo-osmotic flow may drive particles in a directed manner, or can lead to collective phenomena. To approach this broad topic of (self-)thermophoresis and collective motion of active particles and quantify the role of the thermo-osmotic flow upon the latter effects, different experiments have been performed: The first experiments aim to quantify the thermo-osmotic flow at a non-isothermal liquid/solid interface for two fundamentally different substrate properties. Further, the bulk flow was investigated for two different systems. The form and spatial extension of this bulk flow pattern depends sensitively on the form of the container and the interface, as well as on the thermo-osmotic flow. The first system is a liquid film confined between two planar glass cover slips. The second case is a Janus particle immobilized on one of the glass slips. In the first case, the non-uniform temperature profile is generated by optical heating of a nanometer sized gold colloid, and in the second case, the heat source is the Janus particle. The bulk flow pattern consists, for the second case, of the flow pattern created by the glass cover slips and the one created by the Janus particle. The following experiments are focusing on the dynamics of mobile self-thermophoretic Janus particles. In particu

The main subject of this thesis is to examine thermo-osmotic flows, which occur on interfaces of non-uniform temperature. Such thermo-osmotic flows are purely non-thermal equilibrium phenomena. Along the non-isothermal interface, specific interaction of a liquid and its solutes with a boundary vary in strength across the interface, according to the local temperature. This boundary can be a solid, a membrane or a phase boundary. The flow is thereby continuously pumping fluid across the interface in direction of the local temperature gradient, resulting in an extended flow pattern in the bulk due to mass conservation. In a system containing particles and heat sources in a liquid under spatial confinement, the thermo-osmotic flow may drive particles in a directed manner, or can lead to collective phenomena. To approach this broad topic of (self-)thermophoresis and collective motion of active particles and quantify the role of the thermo-osmotic flow upon the latter effects, different experiments have been performed: The first experiments aim to quantify the thermo-osmotic flow at a non-isothermal liquid/solid interface for two fundamentally different substrate properties. Further, the bulk flow was investigated for two different systems. The form and spatial extension of this bulk flow pattern depends sensitively on the form of the container and the interface, as well as on the thermo-osmotic flow. The first system is a liquid film confined between two planar glass cover slips. The second case is a Janus particle immobilized on one of the glass slips. In the first case, the non-uniform temperature profile is generated by optical heating of a nanometer sized gold colloid, and in the second case, the heat source is the Janus particle. The bulk flow pattern consists, for the second case, of the flow pattern created by the glass cover slips and the one created by the Janus particle. The following experiments are focusing on the dynamics of mobile self-thermophoretic Janus particles. In particu

The main subject of this thesis is to examine thermo-osmotic flows, which occur on interfaces of non-uniform temperature. Such thermo-osmotic flows are purely non-thermal equilibrium phenomena. Along the non-isothermal interface, specific interaction of a liquid and its solutes with a boundary vary in strength across the interface, according to the local temperature. This boundary can be a solid, a membrane or a phase boundary. The flow is thereby continuously pumping fluid across the interface in direction of the local temperature gradient, resulting in an extended flow pattern in the bulk due to mass conservation. In a system containing particles and heat sources in a liquid under spatial confinement, the thermo-osmotic flow may drive particles in a directed manner, or can lead to collective phenomena. To approach this broad topic of (self-)thermophoresis and collective motion of active particles and quantify the role of the thermo-osmotic flow upon the latter effects, different experiments have been performed: The first experiments aim to quantify the thermo-osmotic flow at a non-isothermal liquid/solid interface for two fundamentally different substrate properties. Further, the bulk flow was investigated for two different systems. The form and spatial extension of this bulk flow pattern depends sensitively on the form of the container and the interface, as well as on the thermo-osmotic flow. The first system is a liquid film confined between two planar glass cover slips. The second case is a Janus particle immobilized on one of the glass slips. In the first case, the non-uniform temperature profile is generated by optical heating of a nanometer sized gold colloid, and in the second case, the heat source is the Janus particle. The bulk flow pattern consists, for the second case, of the flow pattern created by the glass cover slips and the one created by the Janus particle. The following experiments are focusing on the dynamics of mobile self-thermophoretic Janus particles. In particu

The main subject of this thesis is to examine thermo-osmotic flows, which occur on interfaces of non-uniform temperature. Such thermo-osmotic flows are purely non-thermal equilibrium phenomena. Along the non-isothermal interface, specific interaction of a liquid and its solutes with a boundary vary in strength across the interface, according to the local temperature. This boundary can be a solid, a membrane or a phase boundary. The flow is thereby continuously pumping fluid across the interface in direction of the local temperature gradient, resulting in an extended flow pattern in the bulk due to mass conservation. In a system containing particles and heat sources in a liquid under spatial confinement, the thermo-osmotic flow may drive particles in a directed manner, or can lead to collective phenomena. To approach this broad topic of (self-)thermophoresis and collective motion of active particles and quantify the role of the thermo-osmotic flow upon the latter effects, different experiments have been performed: The first experiments aim to quantify the thermo-osmotic flow at a non-isothermal liquid/solid interface for two fundamentally different substrate properties. Further, the bulk flow was investigated for two different systems. The form and spatial extension of this bulk flow pattern depends sensitively on the form of the container and the interface, as well as on the thermo-osmotic flow. The first system is a liquid film confined between two planar glass cover slips. The second case is a Janus particle immobilized on one of the glass slips. In the first case, the non-uniform temperature profile is generated by optical heating of a nanometer sized gold colloid, and in the second case, the heat source is the Janus particle. The bulk flow pattern consists, for the second case, of the flow pattern created by the glass cover slips and the one created by the Janus particle. The following experiments are focusing on the dynamics of mobile self-thermophoretic Janus particles. In particu

We study the thermophoretic motion of a micron sized single colloidal particle in front of a flat wall by evanescent light scattering. To quantify thermophoretic effects we analyse the nonequilibrium steady state (NESS) of the particle in a constant temperature gradient perpendicular to the confining walls. We propose to determine thermophoretic forces from a "generalized potential" associated with the probability distribution of the particle position in the NESS. Experimentally we demonstrate, how this spatial probability distribution is measured and how thermophoretic forces can be extracted with 10 fN resolution. By varying temperature gradient and ambient temperature, the temperature dependence of Soret coefficient ST(T) is determined for r = 2.5 mm polystyrene and r = 1.35 mm melamine particles. The functional form of ST(T) is in good agreement with findings for smaller colloids. In addition, we measure and discuss hydrodynamic effects in the confined geometry. The theoretical and experimental technique proposed here extends thermophoresis measurements to so far inaccessible particle sizes and particle solvent combinations., QC 20150420

We study the thermophoretic motion of a micron sized single colloidal particle in front of a flat wall by evanescent light scattering. To quantify thermophoretic effects we analyse the nonequilibrium steady state (NESS) of the particle in a constant temperature gradient perpendicular to the confining walls. We propose to determine thermophoretic forces from a generalized potential associated with the probability distribution of the particle position in the NESS. Experimentally we demonstrate, how this spatial probability distribution is measured and how thermophoretic forces can be extracted with 10 fN resolution. By varying temperature gradient and ambient temperature, the temperature dependence of Soret coefficient ST(T) is determined for r = 2.5 mm polystyrene and r = 1.35 mm melamine particles. The functional form of ST(T) is in good agreement with findings for smaller colloids. In addition, we measure and discuss hydrodynamic effects in the confined geometry. The theoretical and experimental technique proposed here extends thermophoresis measurements to so far inaccessible particle sizes and particle solvent combinations., AuthorCount:3

Micron-sized self-propelled (active) particles can be considered as model systems for characterizing more complex biological organisms like swimming bacteria or motile cells. We produce asymmetric microswimmers by soft lithography and study their circular motion on a substrate and near channel boundaries. Our experimental observations are in full agreement with a theory of Brownian dynamics for asymmetric self-propelled particles, which couples their translational and orientational motion., QC 20130613

Stereoisomeric molecules with opposite chirality, so-called enantiomers, often vary regarding their sensory, pharmacological and toxicological properties. Such enantiomer specific effects play a central role in the development, testing and evaluation of drugs, pesticides and food related products. Accordingly, efficient techniques for separation of chiral mixtures into enantiopure compounds are of enormous practical relevance. Most current enantiomer separation methods are based on enantioselective interactions with an auxiliary substance which has to be developed and optimized for different chiral molecules in an elaborate and costly process. Here, we experimentally demonstrate the separation of micron-sized chiral particles in a helical fluid flow which is created inside a microfluidic device patterned with slanted grooves. We observe that the retention time of particles in a helical flow field strongly depends on their chirality which leads to an effective chiral separation within the channel. Our experimental results are confirmed by numerical calculations which demonstrate how the coupling of rotational and translational degrees of freedom leads to differences in the trajectories of particles with opposite chirality. Since our separation mechanism does not rely on material specific interactions, this offers considerable advantages over existing methods. We expect that our approach can be also applied at nanometre length scales by using channels with smaller diameters and with an optimized geometry., QC 20130305

Micron-sized self-propelled (active) particles can be considered as model systems for characterizing more complex biological organisms like swimming bacteria or motile cells. We produce asymmetric microswimmers by soft lithography and study their circular motion on a substrate and near channel boundaries. Our experimental observations are in full agreement with a theory of Brownian dynamics for asymmetric self-propelled particles, which couples their translational and orientational motion., AuthorCount:8

Stereoisomeric molecules with opposite chirality, so-called enantiomers, often vary regarding their sensory, pharmacological and toxicological properties. Such enantiomer specific effects play a central role in the development, testing and evaluation of drugs, pesticides and food related products. Accordingly, efficient techniques for separation of chiral mixtures into enantiopure compounds are of enormous practical relevance. Most current enantiomer separation methods are based on enantioselective interactions with an auxiliary substance which has to be developed and optimized for different chiral molecules in an elaborate and costly process. Here, we experimentally demonstrate the separation of micron-sized chiral particles in a helical fluid flow which is created inside a microfluidic device patterned with slanted grooves. We observe that the retention time of particles in a helical flow field strongly depends on their chirality which leads to an effective chiral separation within the channel. Our experimental results are confirmed by numerical calculations which demonstrate how the coupling of rotational and translational degrees of freedom leads to differences in the trajectories of particles with opposite chirality. Since our separation mechanism does not rely on material specific interactions, this offers considerable advantages over existing methods. We expect that our approach can be also applied at nanometre length scales by using channels with smaller diameters and with an optimized geometry., AuthorCount:3