Search

We develop Polaris, the first safety-focused LLM constellation for real-time patient-AI healthcare conversations. Unlike prior LLM works in healthcare focusing on tasks like question answering, our work specifically focuses on long multi-turn voice conversations. Our one-trillion parameter constellation system is composed of several multibillion parameter LLMs as co-operative agents: a stateful primary agent that focuses on driving an engaging conversation and several specialist support agents focused on healthcare tasks performed by nurses to increase safety and reduce hallucinations. We develop a sophisticated training protocol for iterative co-training of the agents that optimize for diverse objectives. We train our models on proprietary data, clinical care plans, healthcare regulatory documents, medical manuals, and other medical reasoning documents. We align our models to speak like medical professionals, using organic healthcare conversations and simulated ones between patient actors and experienced nurses. This allows our system to express unique capabilities such as rapport building, trust building, empathy and bedside manner. Finally, we present the first comprehensive clinician evaluation of an LLM system for healthcare. We recruited over 1100 U.S. licensed nurses and over 130 U.S. licensed physicians to perform end-to-end conversational evaluations of our system by posing as patients and rating the system on several measures. We demonstrate Polaris performs on par with human nurses on aggregate across dimensions such as medical safety, clinical readiness, conversational quality, and bedside manner. Additionally, we conduct a challenging task-based evaluation of the individual specialist support agents, where we demonstrate our LLM agents significantly outperform a much larger general-purpose LLM (GPT-4) as well as from its own medium-size class (LLaMA-2 70B).

The second generation of the Extreme Universe Space Observatory on a Super Pressure Balloon (EUSO-SPB2) is a balloon instrument that searched for ultra high energy cosmic rays (UHECRs) with energies above 1 EeV and very high energy neutrinos with energies above 1 PeV. EUSO-SPB2 consists of two telescopes: a fluorescence telescope pointed downward for the detection of UHECRs and a Cherenkov telescope toward the limb for the detection of PeV-scale showers produced by neutrino-sourced tau decay (just below the limb) and by cosmic rays (just above the limb). Clouds inside the fields of view of these telescopes--particularly that of the fluorescence telescope--reduce EUSO-SPB2's geometric aperture. As such, cloud coverage and cloud-top altitude within the field of view of the fluorescence telescope must be monitored throughout data-taking. The University of Chicago Infrared Camera (UCIRC2) monitored these clouds using two infrared cameras centered at 10 and 12 $\mu$m. By capturing images at wavelengths spanning the cloud thermal emission peak, UCIRC2 measured cloud color-temperatures and thus cloud-top altitudes. In this contribution, we provide an overview of UCIRC2, including an update on its construction and performance. We also show first results from the flight., Comment: 10 pages, 7 figures, proceedings of the 38th International Cosmic Ray Conference (ICRC 2023). arXiv admin note: substantial text overlap with arXiv:2112.09618, arXiv:1909.02663

The second generation of the Extreme Universe Space Observatory on a Super Pressure Balloon (EUSO-SPB2) is a balloon instrument for the detection of ultra high energy cosmic rays (UHECRs) with energies above 1 EeV and very high energy neutrinos with energies above 10 PeV. EUSO-SPB2 consists of two telescopes: a fluorescence telescope pointed downward for the detection of UHECRs and a Cherenkov telescope pointed towards the limb for the detection of tau lepton-induced showers produced by up-going tau neutrinos and background signals below the limb. Clouds inside the field of view of these telescopes reduce EUSO-SPB2's geometric aperture, in particular that of the fluorescence telescope. For this reason, cloud coverage and cloud-top altitude within the field of view of the fluorescence telescope must be monitored throughout data-taking. The University of Chicago Infrared Camera (UCIRC2) will monitor these clouds using two infrared cameras with response centered at wavelengths 10 and 12 microns. By capturing images at wavelengths spanning the cloud thermal emission peak, UCIRC2 will measure cloud color-temperatures and thus cloud-top altitudes. In this contribution, we provide an overview of UCIRC2, including an update on its construction and a discussion of the techniques used to calibrate the instrument., Comment: 12 pages, 5 figures, proceedings of the 37th International Cosmic Ray Conference (ICRC 2021). arXiv admin note: substantial text overlap with arXiv:1909.02663