10 results on '"TEXT summarization"'
Search Results
2. Chatgpt in and for second language acquisition: A call for systematic research.
- Author
-
Han, ZhaoHong
- Subjects
CHATGPT ,GENERATIVE pre-trained transformers ,LANGUAGE models ,SECOND language acquisition ,COMPUTER assisted language instruction ,TEXT summarization - Abstract
The article discusses the use of Artificial Intelligence (A.I.) tools, specifically chatbots, in second language acquisition. It highlights the potential benefits and concerns associated with the use of A.I. in language learning. The article calls for systematic research to explore the capabilities of A.I. language models, such as ChatGPT, and their impact on language learning. It suggests three strands of research: examining the language model itself, investigating learner interactions with the model, and exploring the effects of the model on learners. The article emphasizes the need to connect this research with existing studies in Instructed Second Language Acquisition (ISLA) to enhance our understanding of language learning conditions. [Extracted from the article]
- Published
- 2024
- Full Text
- View/download PDF
3. QUICK REVIEW OF PEDAGOGICAL EXPERIENCES USING GPT-3 IN EDUCATION.
- Author
-
Manuel Prieto-Andreu, Joel and Labisa-Palmeira, Antonio
- Subjects
GENERATIVE pre-trained transformers ,LANGUAGE models ,TEXT summarization ,CHATBOTS ,COMPUTER science ,ARTIFICIAL intelligence - Abstract
GPT-3 is a neuronal language model that performs tasks such as classification, question-answering and text summarization. Although chatbots like BlenderBot-3 work well in a conversational sense, and GPT-3 can assist experts in evaluating questions, they are quantifiably worse than real teachers in several pedagogical dimensions. We present the first systematic literature review that analyzes the main contributions and uses of GPT-3 in the field of education. The protocols suggested in the PRISMA 2020 statement were followed for the drafting of the review. According to the results, 34 significant productions were identified through a systematic search in ISI Web of Science, SCOPUS and Google Scholar. GPT-3 has been considered in the academic, ethical and medical fields, in humanities and in computer science, in the formulation of questions and answers, and through cooperative educational dialogs. GPT-3 has been proven to have valuable applications in education, such as the automation of routine tasks, in making quick diagnoses of the students' weaknesses and in the automatic generation of questions, but it still faces challenges and limitations that require additional investigation. We discuss the educational possibilities and the limitations to the use of GPT-3. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
4. Opportunities and challenges for ChatGPT and large language models in biomedicine and health.
- Author
-
Tian, Shubo, Jin, Qiao, Yeganova, Lana, Lai, Po-Ting, Zhu, Qingqing, Chen, Xiuying, Yang, Yifan, Chen, Qingyu, Kim, Won, Comeau, Donald C, Islamaj, Rezarta, Kapoor, Aadit, Gao, Xin, and Lu, Zhiyong
- Subjects
- *
LANGUAGE models , *CHATGPT , *TEXT summarization , *GENERATIVE artificial intelligence , *DATA privacy , *DATA mining - Abstract
ChatGPT has drawn considerable attention from both the general public and domain experts with its remarkable text generation capabilities. This has subsequently led to the emergence of diverse applications in the field of biomedicine and health. In this work, we examine the diverse applications of large language models (LLMs), such as ChatGPT, in biomedicine and health. Specifically, we explore the areas of biomedical information retrieval, question answering, medical text summarization, information extraction and medical education and investigate whether LLMs possess the transformative power to revolutionize these tasks or whether the distinct complexities of biomedical domain presents unique challenges. Following an extensive literature survey, we find that significant advances have been made in the field of text generation tasks, surpassing the previous state-of-the-art methods. For other applications, the advances have been modest. Overall, LLMs have not yet revolutionized biomedicine, but recent rapid progress indicates that such methods hold great potential to provide valuable means for accelerating discovery and improving health. We also find that the use of LLMs, like ChatGPT, in the fields of biomedicine and health entails various risks and challenges, including fabricated information in its generated responses, as well as legal and privacy concerns associated with sensitive patient data. We believe this survey can provide a comprehensive and timely overview to biomedical researchers and healthcare practitioners on the opportunities and challenges associated with using ChatGPT and other LLMs for transforming biomedicine and health. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
5. A Comprehensive Study of ChatGPT: Advancements, Limitations, and Ethical Considerations in Natural Language Processing and Cybersecurity.
- Author
-
Alawida, Moatsum, Mejri, Sami, Mehmood, Abid, Chikhaoui, Belkacem, and Isaac Abiodun, Oludare
- Subjects
- *
CHATGPT , *NATURAL language processing , *LANGUAGE models , *TEXT summarization , *INTERNET security , *HAZARD mitigation - Abstract
This paper presents an in-depth study of ChatGPT, a state-of-the-art language model that is revolutionizing generative text. We provide a comprehensive analysis of its architecture, training data, and evaluation metrics and explore its advancements and enhancements over time. Additionally, we examine the capabilities and limitations of ChatGPT in natural language processing (NLP) tasks, including language translation, text summarization, and dialogue generation. Furthermore, we compare ChatGPT to other language generation models and discuss its applicability in various tasks. Our study also addresses the ethical and privacy considerations associated with ChatGPT and provides insights into mitigation strategies. Moreover, we investigate the role of ChatGPT in cyberattacks, highlighting potential security risks. Lastly, we showcase the diverse applications of ChatGPT in different industries and evaluate its performance across languages and domains. This paper offers a comprehensive exploration of ChatGPT's impact on the NLP field. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
6. Enhancing Abstractive Summarization with Extracted Knowledge Graphs and Multi-Source Transformers.
- Author
-
Chen, Tong, Wang, Xuewei, Yue, Tianwei, Bai, Xiaoyu, Le, Cindy X., and Wang, Wenping
- Subjects
TEXT summarization ,KNOWLEDGE graphs ,LANGUAGE models ,CHATGPT - Abstract
As the popularity of large language models (LLMs) has risen over the course of the last year, led by GPT-3/4 and especially its productization as ChatGPT, we have witnessed the extensive application of LLMs to text summarization. However, LLMs do not intrinsically have the power to verify the correctness of the information they supply and generate. This research introduces a novel approach to abstractive summarization, aiming to address the limitations of LLMs in that they struggle to understand the truth. The proposed method leverages extracted knowledge graph information and structured semantics as a guide for summarization. Building upon BART, one of the state-of-the-art sequence-to-sequence pre-trained LLMs, multi-source transformer modules are developed as an encoder, which are capable of processing textual and graphical inputs. Decoding is performed based on this enriched encoding to enhance the summary quality. The Wiki-Sum dataset, derived from Wikipedia text dumps, is introduced for evaluation purposes. Comparative experiments with baseline models demonstrate the strengths of the proposed approach in generating informative and relevant summaries. We conclude by presenting our insights into utilizing LLMs with graph external information, which will become a powerful aid towards the goal of factually correct and verified LLMs. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
7. What is ChatGPT and how will it impact project management?
- Author
-
Reid, Lawrence
- Subjects
PROJECT managers ,CHATGPT ,PROJECT management ,LANGUAGE models ,TEXT summarization - Published
- 2023
8. A Mathematical Interpretation of Autoregressive Generative Pre-Trained Transformer and Self-Supervised Learning.
- Author
-
Lee, Minhyeok
- Subjects
- *
LANGUAGE models , *TEXT summarization , *QUESTION answering systems , *NATURAL language processing , *INVERSE functions , *AUTOREGRESSIVE models , *NATURAL languages - Abstract
In this paper, we present a rigorous mathematical examination of generative pre-trained transformer (GPT) models and their autoregressive self-supervised learning mechanisms. We begin by defining natural language space and knowledge space, which are two key concepts for understanding the dimensionality reduction process in GPT-based large language models (LLMs). By exploring projection functions and their inverses, we establish a framework for analyzing the language generation capabilities of these models. We then investigate the GPT representation space, examining its implications for the models' approximation properties. Finally, we discuss the limitations and challenges of GPT models and their learning mechanisms, considering trade-offs between complexity and generalization, as well as the implications of incomplete inverse projection functions. Our findings demonstrate that GPT models possess the capability to encode knowledge into low-dimensional vectors through their autoregressive self-supervised learning mechanism. This comprehensive analysis provides a solid mathematical foundation for future advancements in GPT-based LLMs, promising advancements in natural language processing tasks such as language translation, text summarization, and question answering due to improved understanding and optimization of model training and performance. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF
9. Text summarization with ChatGPT for drug labeling documents.
- Author
-
Ying, Lan, Liu, Zhichao, Fang, Hong, Kusko, Rebecca, Wu, Leihong, Harris, Stephen, and Tong, Weida
- Subjects
- *
TEXT summarization , *CHATGPT , *LANGUAGE models , *DRUG labeling , *DRUG discovery , *NATURAL language processing - Abstract
• Text summarization in scientific research is crucial but time consuming and labor intensive, and it requires specific expertise; here, NLP is playing a role. • ChatGPT's drug information summarization was evaluated against human experts using >14 000 records from the FDA Labeling document for the first time. • ChatGPT reliably generates summaries closely resembling those of human experts, particularly in the context of summarizing drug safety information from labeling documents. • ChatGPT and its derivatives are valuable in drug discovery, improving drug labeling access and supporting FDA review processes. Text summarization is crucial in scientific research, drug discovery and development, regulatory review, and more. This task demands domain expertise, language proficiency, semantic prowess, and conceptual skill. The recent advent of large language models (LLMs), such as ChatGPT, offers unprecedented opportunities to automate this process. We compared ChatGPT-generated summaries with those produced by human experts using FDA drug labeling documents. The labeling contains summaries of key labeling sections, making them an ideal human benchmark to evaluate ChatGPT's summarization capabilities. Analyzing >14 000 summaries, we observed that ChatGPT-generated summaries closely resembled those generated by human experts. Importantly, ChatGPT exhibited even greater similarity when summarizing drug safety information. These findings highlight ChatGPT's potential to accelerate work in critical areas, including drug safety. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
10. Topic model for long document extractive summarization with sentence-level features and dynamic memory unit.
- Author
-
Han, Chunlong, Feng, Jianzhou, and Qi, Haotian
- Subjects
- *
TEXT summarization , *LANGUAGE models , *CHATGPT , *MEMORY - Abstract
The Transformer-based summarization models rely solely on the attention mechanism for document encoding, making it difficult to accurately capture long-range dependencies in long documents due to the presence of attention redundancy. To address this issue, we propose an extractive summarization framework guided by a topic model (TopicSum) that utilizes a heterogeneous graph neural network to leverage the topic information as document-level features during the sentence selection process, thereby capturing the long-range dependencies among sentences. The sentence-level features in this topic model align with the basic unit of the extractive summarization task. Additionally, a memory mechanism is employed to dynamically store and update the memory module, reducing the potential of repetitive information guiding sentence selection. We evaluated the model on three large document datasets, namely Pubmed, arXiv, and GovReport, and achieved significantly higher Rouge scores than previous works, including extractive and abstractive models. Furthermore, our experiments demonstrate that recent highly regarded large language models such as ChatGPT are insufficient to handle the long document summarization task directly. The proposed approach in this paper exhibits sufficient competitiveness in terms of both generation quality and deployment conditions. [ABSTRACT FROM AUTHOR]
- Published
- 2024
- Full Text
- View/download PDF
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.