Search

This paper introduces LLM-jp, a cross-organizational project for the research and development of Japanese large language models (LLMs). LLM-jp aims to develop open-source and strong Japanese LLMs, and as of this writing, more than 1,500 participants from academia and industry are working together for this purpose. This paper presents the background of the establishment of LLM-jp, summaries of its activities, and technical reports on the LLMs developed by LLM-jp. For the latest activities, visit https://llm-jp.nii.ac.jp/en/.

Humans pay careful attention to the interlocutor's internal state in dialogues. For example, in recommendation dialogues, we make recommendations while estimating the seeker's internal state, such as his/her level of knowledge and interest. Since there are no existing annotated resources for the analysis, we constructed RecMind, a Japanese movie recommendation dialogue dataset with annotations of the seeker's internal state at the entity level. Each entity has a subjective label annotated by the seeker and an objective label annotated by the recommender. RecMind also features engaging dialogues with long seeker's utterances, enabling a detailed analysis of the seeker's internal state. Our analysis based on RecMind reveals that entities that the seeker has no knowledge about but has an interest in contribute to recommendation success. We also propose a response generation framework that explicitly considers the seeker's internal state, utilizing the chain-of-thought prompting. The human evaluation results show that our proposed method outperforms the baseline method in both consistency and the success of recommendations.

Organic thin film materials with molecular ordering are gaining attention as they exhibit semiconductor characteristics. When using them for electronics, the thermal management becomes important, where heat dissipation is directional owning to the anisotropic thermal conductivity arising from the molecular ordering. However, it is difficult to evaluate the anisotropy by simultaneously measuring in-plane and cross-plane thermal conductivities of the film on a substrate, because the film is typically as thin as tens to hundreds of nanometers and its in-plane thermal conductivity is low. Here, we develop a novel bidirectional 3{\omega} system that measures the anisotropic thermal conductivity of thin films by patterning two metal wires with different widths and preparing the films on top, and extracting the in-plane and cross-plane thermal conductivities using the difference in their sensitivities to the metal-wire width. Using the developed system, the thermal conductivity of spin-coated poly(3,4-ethylenedioxythiophene) olystyrene sulfonate (PEDOT:PSS) with thickness of 70 nm was successfully measured. The measured in-plane thermal conductivity of PEDOT:PSS film was as high as 2.9 W m-1 K-1 presumably due to the high structural ordering, giving anisotropy of 10. The calculations of measurement sensitivity to the film thickness and thermal conductivities suggest that the device can be applied to much thinner films by utilizing metal wires with smaller width., Comment: 35 pages, 12 figures

Aiming at developing high thermal conductivity copper/diamond composite, an unconventional approach applying self-assembled monolayer (SAM) prior to the high-temperature sintering of copper/diamond composite was utilized to enhance the thermal boundary conductance (TBC) between copper and diamond. The enhancement was first systematically confirmed on a model interface system by detailed SAM morphology characterization and TBC measurements. TBC significantly depends on the SAM coverage and ordering, and the formation of high-quality SAM promoted the TBC to 73 MW/m^2-K from 27 MW/m^2-K, the value without SAM. With the help of molecular dynamics simulations, the TBC enhancement was identified to be determined by the number of SAM bridges and the overlap of vibrational density of states. The diamond particles of 210 {\micro\metre} in size were simultaneously functionalized by SAM with the condition giving the highest TBC in the model system and sintered together with the copper to fabricate isotropic copper/diamond composite of 50% volume fraction. The measured thermal conductivity marked 711 W/m-K at room temperature, the highest value among the ones with similar diamond-particles volume fraction and size. This work demonstrates a novel strategy to enhance the thermal conductivity of composite materials by SAM functionalization.

Intelligent dialogue systems are expected as a new interface between humans and machines. Such an intelligent dialogue system should estimate the user's internal state (UIS) in dialogues and change its response appropriately according to the estimation result. In this paper, we model the UIS in dialogues, taking movie recommendation dialogues as examples, and construct a dialogue system that changes its response based on the UIS. Based on the dialogue data analysis, we model the UIS as three elements: knowledge, interest, and engagement. We train the UIS estimators on a dialogue corpus with the modeled UIS's annotations. The estimators achieved high estimation accuracy. We also design response change rules that change the system's responses according to each UIS. We confirmed that response changes using the result of the UIS estimators improved the system utterances' naturalness in both dialogue-wise evaluation and utterance-wise evaluation.

The global pandemic of COVID-19 has made the public pay close attention to related news, covering various domains, such as sanitation, treatment, and effects on education. Meanwhile, the COVID-19 condition is very different among the countries (e.g., policies and development of the epidemic), and thus citizens would be interested in news in foreign countries. We build a system for worldwide COVID-19 information aggregation containing reliable articles from 10 regions in 7 languages sorted by topics. Our reliable COVID-19 related website dataset collected through crowdsourcing ensures the quality of the articles. A neural machine translation module translates articles in other languages into Japanese and English. A BERT-based topic-classifier trained on our article-topic pair dataset helps users find their interested information efficiently by putting articles into different categories., Comment: Accepted to EMNLP 2020 Workshop NLP-COVID

Since solid-state heat transport in a highly porous nanocomposite strongly depends on the thermal boundary conductance (TBC) between constituent nanomaterials, further suppression of the TBC is important for improving performance of thermal insulators. Here, targeting a nanocomposite fabricated by stamping fumed silica nanoparticles, we perform a wide variety of surface functionalization on fumed silica nanoparticles by silane coupling method and investigate the impact on the thermal conductivity (Km). The Km of the silica nanocomposite is approximately 20 and 9 mW/m/K under atmospheric and vacuum condition at the material density of 0.2 g/cm3 without surface functionalization, respectively, and the experimental results indicate that the Km can be modulated depending on the chemical structure of molecules. The surface modification with a linear alkyl chain of optimal length significantly suppresses Km by approximately 30%, and the suppression can be further enhanced to approximately 50% with the infrared opacifier. The magnitude of suppression was found to sensitively depend on the length of terminal chain. The magnitude is also related to the number of reactive silanol groups in the chemical structure, where the surface modification with fluorocarbon gives the largest suppression. The surface hydrophobization merits thermal insulation through significant suppression of the TBC, presumably by reducing the water molecules that otherwise would serve as heat conduction channels at the interface. On the other hand, when the chain length is long, the suppression is counteracted by the enhanced phonon transmission through the silane coupling molecules that grows with the chain length. This is supported by the analytical model and present simulation results, leading to predict the optimal chemical structure for better thermal insulation.

Individual carbon nanotubes (CNTs) possess extremely high thermal conductivities. However, the thermal conductivities and their anisotropy of macroscopic assemblies of CNTs have so far remained small. Here, we report results of directional thermal transport measurements on a nearly-perfectly aligned CNT film fabricated via controlled vacuum filtration. We found the thermal conductivity to be 43 +- 2.2 W m^-1 K^-1 with a record-high thermal anisotropy of 500. From the temperature dependence of the thermal conductivity and its agreement with the atomistic phonon transport calculation, we conclude that the effect of intertube thermal resistance on heat conduction in the alignment direction is negligible because of the large contact area between CNTs. These observations thus represent ideal unidirectional thermal transport, i.e., the thermal conductivity of the film is determined solely by that of individual CNTs., Comment: 29 pages, 11 figures, to be published in Applied Physics Letters