Search

Your search keyword '"Liang, Xun"' showing total 407 results
Start Over Author "Liang, Xun" Publication Year Range This year

Refine your results

more »

more »

more »
407 results on '"Liang, Xun"'

1. Controllable Text Generation for Large Language Models: A Survey

Author

Liang, Xun, Wang, Hanyu, Wang, Yezhaohui, Song, Shichao, Yang, Jiawei, Niu, Simin, Hu, Jie, Liu, Dan, Yao, Shunyu, Xiong, Feiyu, and Li, Zhiyu

Subjects
Computer Science - Computation and Language, A.2, I.2.7
Abstract

In Natural Language Processing (NLP), Large Language Models (LLMs) have demonstrated high text generation quality. However, in real-world applications, LLMs must meet increasingly complex requirements. Beyond avoiding misleading or inappropriate content, LLMs are also expected to cater to specific user needs, such as imitating particular writing styles or generating text with poetic richness. These varied demands have driven the development of Controllable Text Generation (CTG) techniques, which ensure that outputs adhere to predefined control conditions--such as safety, sentiment, thematic consistency, and linguistic style--while maintaining high standards of helpfulness, fluency, and diversity. This paper systematically reviews the latest advancements in CTG for LLMs, offering a comprehensive definition of its core concepts and clarifying the requirements for control conditions and text quality. We categorize CTG tasks into two primary types: content control and attribute control. The key methods are discussed, including model retraining, fine-tuning, reinforcement learning, prompt engineering, latent space manipulation, and decoding-time intervention. We analyze each method's characteristics, advantages, and limitations, providing nuanced insights for achieving generation control. Additionally, we review CTG evaluation methods, summarize its applications across domains, and address key challenges in current research, including reduced fluency and practicality. We also propose several appeals, such as placing greater emphasis on real-world applications in future research. This paper aims to offer valuable guidance to researchers and developers in the field. Our reference list and Chinese version are open-sourced at https://github.com/IAAR-Shanghai/CTGSurvey., Comment: 52 pages, 11 figures, 7 tables, 11 equations

Published
2024

2. Internal Consistency and Self-Feedback in Large Language Models: A Survey

Author

Liang, Xun, Song, Shichao, Zheng, Zifan, Wang, Hanyu, Yu, Qingchen, Li, Xunkai, Li, Rong-Hua, Cheng, Peng, Wang, Zhonghao, Xiong, Feiyu, and Li, Zhiyu

Subjects
Computer Science - Computation and Language
Abstract

Large language models (LLMs) often exhibit deficient reasoning or generate hallucinations. To address these, studies prefixed with "Self-" such as Self-Consistency, Self-Improve, and Self-Refine have been initiated. They share a commonality: involving LLMs evaluating and updating themselves. Nonetheless, these efforts lack a unified perspective on summarization, as existing surveys predominantly focus on categorization. In this paper, we summarize a theoretical framework, Internal Consistency, offering explanations for reasoning deficiencies and hallucinations. Internal Consistency refers to the consistency in expressions among LLMs' latent, decoding, or response layers based on sampling methodologies. Then, we introduce another effective theoretical framework capable of mining Internal Consistency, named Self-Feedback. This framework consists of two modules: Self-Evaluation and Self-Update. The former captures Internal Consistency Signals, while the latter leverages the signals to enhance either the model's response or the model itself. This framework has been employed in numerous studies. We systematically classify these studies by tasks and lines of work; summarize relevant evaluation methods and benchmarks; and delve into the concern, "Does Self-Feedback Really Work?" We also propose several critical viewpoints, including the "Hourglass Evolution of Internal Consistency", "Consistency Is (Almost) Correctness" hypothesis, and "The Paradox of Latent and Explicit Reasoning". The relevant resources are open-sourced at https://github.com/IAAR-Shanghai/ICSFSurvey., Comment: 24 pages, 9 figures, 7 tables, 14 equations

Published
2024

3. Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learning

Author

Liang, Xun, Niu, Simin, li, Zhiyu, Zhang, Sensen, Song, Shichao, Wang, Hanyu, Yang, Jiawei, Xiong, Feiyu, Tang, Bo, and Xi, Chenyang

Subjects
Computer Science - Computation and Language, Computer Science - Information Retrieval
Abstract

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable effort. We propose a pre-retrieval framework named Pseudo-Graph Retrieval-Augmented Generation (PG-RAG), which conceptualizes LLMs as students by providing them with abundant raw reading materials and encouraging them to engage in autonomous reading to record factual information in their own words. The resulting concise, well-organized mental indices are interconnected through common topics or complementary facts to form a pseudo-graph database. During the retrieval phase, PG-RAG mimics the human behavior in flipping through notes, identifying fact paths and subsequently exploring the related contexts. Adhering to the principle of the path taken by many is the best, it integrates highly corroborated fact paths to provide a structured and refined sub-graph assisting LLMs. We validated PG-RAG on three specialized question-answering datasets. In single-document tasks, PG-RAG significantly outperformed the current best baseline, KGP-LLaMA, across all key evaluation metrics, with an average overall performance improvement of 11.6%. Specifically, its BLEU score increased by approximately 14.3%, and the QE-F1 metric improved by 23.7%. In multi-document scenarios, the average metrics of PG-RAG were at least 2.35% higher than the best baseline. Notably, the BLEU score and QE-F1 metric showed stable improvements of around 7.55% and 12.75%, respectively. Our code: https://github.com/IAAR-Shanghai/PGRAG.

Published
2024

4. Controlled Text Generation for Large Language Model with Dynamic Attribute Graphs

Author

Liang, Xun, Wang, Hanyu, Song, Shichao, Hu, Mengting, Wang, Xunzhi, Li, Zhiyu, Xiong, Feiyu, and Tang, Bo

Subjects
Computer Science - Computation and Language
Abstract

Controlled Text Generation (CTG) aims to produce texts that exhibit specific desired attributes. In this study, we introduce a pluggable CTG framework for Large Language Models (LLMs) named Dynamic Attribute Graphs-based controlled text generation (DATG). This framework utilizes an attribute scorer to evaluate the attributes of sentences generated by LLMs and constructs dynamic attribute graphs. DATG modulates the occurrence of key attribute words and key anti-attribute words, achieving effective attribute control without compromising the original capabilities of the model. We conduct experiments across four datasets in two tasks: toxicity mitigation and sentiment transformation, employing five LLMs as foundational models. Our findings highlight a remarkable enhancement in control accuracy, achieving a peak improvement of 19.29% over baseline methods in the most favorable task across four datasets. Additionally, we observe a significant decrease in perplexity, markedly improving text fluency., Comment: 18 Pages, Accepted by ACL 2024 Findings

Published
2024

6. Research on Hidden Parenthood Relationship of Figures in Long-text Kung Fu Novels

Author

Qi, Jinshan, Gui, Bin, Liang, Xun, Gao, Junheng, Striełkowski, Wadim, Editor-in-Chief, Black, Jessica M., Series Editor, Butterfield, Stephen A., Series Editor, Chang, Chi-Cheng, Series Editor, Cheng, Jiuqing, Series Editor, Dumanig, Francisco Perlas, Series Editor, Al-Mabuk, Radhi, Series Editor, Scheper-Hughes, Nancy, Series Editor, Urban, Mathias, Series Editor, Webb, Stephen, Series Editor, Chitrakar, Roshan, editor, Liliana, Mata, editor, Dobrota, Dan, editor, Peng, Chew Fong, editor, and Tessema, Ameha Tefera, editor

Published
2024
Full Text
View/download PDF

15. A parallel framework on hybrid architectures for raster-based geospatial cellular automata models.

Author

Gao, Huan, Liang, Zhewei, Guan, Qingfeng, Liang, Xun, and Zeng, Wen

Subjects
CELLULAR automata, PARALLEL processing, PARALLEL programming, LAND use, PARALLEL algorithms, TRAFFIC flow, LAND mines
Abstract

Geospatial cellular automata (Geo-CA) models have encountered challenges in computing efficiency and scalability when conducting large-scale land use change simulation applications. Parallel computing has proven to be effective to address these challenges. However, parallelization strategies for existing parallel Geo-CA models are always optimized for specific models and lack applicability to others. Besides, most parallel Geo-CA models focus on parallelizing land use change simulations, ignoring land use transition rule mining. Moreover, there is a lack of effective parallel strategies for demand-constrained land use change simulation on distributed heterogeneous architectures. This study proposes a parallel framework on hybrid parallel computing architectures applicable for raster-based Geo-CA models to enhance their computing efficiency and scalability while maintaining simulation accuracy. The framework provides parallelization strategies for both the land use transition rule mining for multiple land use types and the demand-constrained land use change simulation on distributed heterogeneous architectures. The framework was employed to parallelize two contemporary Geo-CA models, i.e., PLUS and MCCA. Experiments showed that the parallelized models achieved significant improvements in computing efficiency and scalability, confirming the effectiveness of the proposed framework for large-scale land use change simulation studies. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

17. Analysis of Factors Influencing Legal Consciousness Among College Students

Author

Zeng, Fanyi, Cheng, Xiao, Pan, Xiaoyi, Chen, Yang, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

18. Digital Education and Dissemination of Cantonese Opera Culture in Guangfu under the Framework of Information Space Theory

Author

Zeng, Yuxiao, Huang, Yixuan, Xie, Xin, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

19. Construction and Optimization of an Artificial Intelligence-Assisted Kansei Engineering Product Design Mapping Model

Author

Li, Tianxin, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

20. Multi-dimensional Evaluation Methods for Enhancing the Teaching Effectiveness of Mechanical Courses

Author

Chang, Lin, Zhuang, Fangxiang, Gao, Jiehua, Wei, Jiamiao, Xie, Chenxin, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

21. Research on the Application of Artificial Intelligence Technology in Improving Teacher Quality and Teaching Efficiency

Author

Mo, Zuqin, Shen, Ling, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

22. Research on the Application of Blended Learning Mode Based on the OBE Philosophy --Taking 'Artificial Intelligence-Graph Search Strategy' as an Example

Author

Zhang, Bingge, Shao, Xiuting, Song, Ziwen, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

23. Visual Analysis of Competency of Psychological Committeeman in Chinese Universities Based on Database Retrieval

Author

Liang, Guanlan, Pan, Jiashan, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

24. Optimizing E-Learning Environments: Leveraging Large Language Models for Personalized Education Pathways

Author

Liu, Fangfang, Wang, Yiyun, Feng, Qiuling, Zhu, Linkai, Li, Guang, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

26. Design and Implementation of Online Teaching System for Ideological and Political Courses in University Environment Under Web Environment

Author

Ji, Ying, Li, Na, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

27. Research on the Lifelong Learning Mode of College Students Based on Technical Support: Motivation, Demand and Transmutation

Author

Wang, Chu, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

28. Research HotSpots and Topic Evolution of Long Tail Theory in China: a CiteSpace Knowledge Graph Analysis

Author

Li, Chunlan, Ma, Qiuying, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

31. The Process and Measures of Reliability Data Management for Civil Products

Author

Zhou, Wenzao, Zhang, Dong, Wu, Zhonghao, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

32. Research on the Regional Industrial Adaptability of Vocational Education in Zhuzhou City Based on Big Data Analysis

Author

Zou, Ruirui, Liu, Qian, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

33. The Way to Enhance the Sense of Gain of Ideological and Political Education in Private Colleges in Guangdong Province: Based on Mediating and Moderating Effects

Author

He, Siyuan, Lu, Min, Dai, Huichuan, Sun, Wen, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

35. Research on the Influence of Knowledge Hiding on the Subsequent Altruistic Behavior of the Hider -- A Dual Mediation Model Based on Compensatory Ethics

Author

Liu, Jingwen, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

37. Research on the Construction of Technical Ethics Boundary and Responsibility Model in the Construction of Smart Campus

Author

Hu, Changlong, Zhou, Rong, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

39. A Survey of Current Status of Digital Reading Proficiency among Master's Students: A Case Study of a Normal University in Southwest China

Author

Jin, Xinru, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

40. Research on the Monitoring Status and Promotion Path of Physical Health Status of Higher Vocational Students-Taking Heyuan Polytechnic as an Example

Author

Yang, Liuqing, Zhang, Yuanping, Yin, Hua, Huang, Zhiyu, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

41. An Evaluation and Analysis of University Curriculum Support Effectiveness in Public Security Colleges for Public Security Joint Examination

Author

Shen, Jun, Li, Fan, Zhong, Xia, Kong, Fan, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

43. Analysis of the Domestic Cultural and Creative Product Field from the Perspective of Knowledge Graph

Author

Jian, Rao, Guo, Dingyan, Tan, Yuyan, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

45. Research on Policy Evaluation of College Ideological and Political Education based on PMC Index Model : —— Take the 100 Policies Published Since the New Era

Author

Zhu, Sijie, Wang, Jia, Li, Kan, Editor-in-Chief, Li, Qingyong, Associate Editor, Fournier-Viger, Philippe, Series Editor, Hong, Wei-Chiang, Series Editor, Liang, Xun, Series Editor, Wang, Long, Series Editor, Xu, Xuesong, Series Editor, Kuang, Yunshan, editor, Zhu, Lixin, editor, Zhang, Xiangyang, editor, and Khan, Intakhab Alam, editor

Published
2024
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results