Search

Large language models (LLMs), such as GPT3.5, GPT4 and LLAMA2 perform surprisingly well and outperform human experts on many tasks. However, in many domain-specific evaluations, these LLMs often suffer from hallucination problems due to insufficient training of relevant corpus. Furthermore, fine-tuning large models may face problems such as the LLMs are not open source or the construction of high-quality domain instruction is difficult. Therefore, structured knowledge databases such as knowledge graph can better provide domain background knowledge for LLMs and make full use of the reasoning and analysis capabilities of LLMs. In some previous works, LLM was called multiple times to determine whether the current triplet was suitable for inclusion in the subgraph when retrieving subgraphs through a question. Especially for the question that require a multi-hop reasoning path, frequent calls to LLM will consume a lot of computing power. Moreover, when choosing the reasoning path, LLM will be called once for each step, and if one of the steps is selected incorrectly, it will lead to the accumulation of errors in the following steps. In this paper, we integrated and optimized a pipeline for selecting reasoning paths from KG based on LLM, which can reduce the dependency on LLM. In addition, we propose a simple and effective subgraph retrieval method based on chain of thought (CoT) and page rank which can returns the paths most likely to contain the answer. We conduct experiments on three datasets: GenMedGPT-5k [14], WebQuestions [2], and CMCQA [21]. Finally, RoK can demonstrate that using fewer LLM calls can achieve the same results as previous SOTAs models.

Large language models (LLMs) have emerged as pivotal contributors in contemporary natural language processing and are increasingly being applied across a diverse range of industries. However, these large-scale probabilistic statistical models cannot currently ensure the requisite quality in professional content generation. These models often produce hallucinated text, compromising their practical utility in professional contexts. To assess the authentic reliability of LLMs in text generation, numerous initiatives have developed benchmark evaluations for hallucination phenomena. Nevertheless, these benchmarks frequently utilize constrained generation techniques due to cost and temporal constraints. These techniques encompass the use of directed hallucination induction and strategies that deliberately alter authentic text to produce hallucinations. These approaches are not congruent with the unrestricted text generation demanded by real-world applications. Furthermore, a well-established Chinese-language dataset dedicated to the evaluation of hallucinations in text generation is presently lacking. Consequently, we have developed an Unconstrained Hallucination Generation Evaluation (UHGEval) benchmark, designed to compile outputs produced with minimal restrictions by LLMs. Concurrently, we have established a comprehensive benchmark evaluation framework to aid subsequent researchers in undertaking scalable and reproducible experiments. We have also executed extensive experiments, evaluating prominent Chinese language models and the GPT series models to derive professional performance insights regarding hallucination challenges., Comment: Accepted by ACL 2024

The coherent many-body interaction at the organic-inorganic interface can give rise to intriguing hybrid excitons that combine the advantages of the Wannier-Mott and Frenkel excitons simultaneously. Unlike the 2D inorganic heterostructures that suffer from moment mismatch, the hybrid excitons formed at the organic-inorganic interface have a momentum-direct nature, which have yet to be explored. Here, we report hybrid excitons at the copper phthalocyanine/molybdenum diselenide (CuPc/MoSe2) interface with strong molecular orientation dependence using low-temperature photoluminescence spectroscopy. The new emission peaks observed in the CuPc/MoSe2 heterostructure indicate the formation of interfacial hybrid excitons. The density functional theory (DFT) calculation confirms the strong hybridization between the lowest unoccupied molecular orbital (LUMO) of CuPc and the conduction band minimum (CBM) of MoSe2, suggesting that the hybrid excitons consist of electrons extended in both layers and holes confined in individual layers. The temperature-dependent measurements show that the hybrid excitons can gain the signatures of the Frenkel excitons of CuPc and the Wannier-Mott excitons of MoSe2 simultaneously. The out-of-plane molecular orientation is used to tailor the interfacial hybrid exciton states. Our results reveal the hybrid excitons at the CuPc/MoSe2 interface with tunability by molecular orientation, which suggests that the emerging organic-inorganic heterostructure can be a promising platform for many-body exciton physics.

Magnetic circular dichroism (MCD) is a widely used spectroscopic technique which reveals valuable information about molecular geometry and electronic structure. However, the weak signal and the necessary strong magnets impose major limitations on its application. We propose a novel protocol to overcome these limitations by using pulsed vector beams (VBs), which consist of nanosecond gigahertz pump and femtosecond UV-Vis probe pulses. By virtue of the strong longitudinal electromagnetic fields, the MCD signal detected by using the pulsed VBs is greatly enhanced compared to conventional MCD performed with plane waves. Furthermore, varying the pump-probe time delay allows to monitor the ultrafast variation of molecular properties., Comment: 20 pages, 4 figures

The atomic-level vdW heterostructures have been one of the most interesting quantum material systems, due to their exotic physical properties. The interlayer coupling in these systems plays a critical role to realize novel physical observation and enrich interface functionality. However, there is still lack of investigation on the tuning of interlayer coupling in a quantitative way. A prospective strategy to tune the interlayer coupling is to change the electronic structure and interlayer distance by high pressure, which is a well-established method to tune the physical properties. Here, we construct a high-quality WS2/MoSe2 heterostructure in a DAC and successfully tuned the interlayer coupling through hydrostatic pressure. Typical photoluminescence spectra of the monolayer MoSe2 (ML-MoSe2), monolayer WS2 (ML-WS2) and WS2/MoSe2 heterostructure have been observed and it's intriguing that their photoluminescence peaks shift with respect to applied pressure in a quite different way. The intralayer exciton of ML-MoSe2 and ML-WS2 show blue shift under high pressure with a coefficient of 19.8 meV/GPa and 9.3 meV/GPa, respectively, while their interlayer exciton shows relative weak pressure dependence with a coefficient of 3.4 meV/GPa. Meanwhile, external pressure helps to drive stronger interlayer interaction and results in a higher ratio of interlayer/intralayer exciton intensity, indicating the enhanced interlayer exciton behavior. The first-principles calculation reveals the stronger interlayer interaction which leads to enhanced interlayer exciton behavior in WS2/MoSe2 heterostructure under external pressure and reveals the robust peak of interlayer exciton. This work provides an effective strategy to study the interlayer interaction in vdW heterostructures, which could be of great importance for the material and device design in various similar quantum systems., Comment: 11 pages, 4 figures