Search

Your search keyword '"Hu, Menglan"' showing total 18 results
Start Over Author "Hu, Menglan" Publication Year Range Last 3 years
18 results on '"Hu, Menglan"'

3. Targeted Training Data Extraction—Neighborhood Comparison-Based Membership Inference Attacks in Large Language Models.

Author

Xu, Huan, Zhang, Zhanhao, Yu, Xiaodong, Wu, Yingbo, Zha, Zhiyong, Xu, Bo, Xu, Wenfeng, Hu, Menglan, and Peng, Kai

Subjects
LANGUAGE models, ARTIFICIAL intelligence, DEEP learning, SUFFIXES & prefixes (Grammar), LANGUAGE research, DATA extraction
Abstract

A large language model refers to a deep learning model characterized by extensive parameters and pretraining on a large-scale corpus, utilized for processing natural language text and generating high-quality text output. The increasing deployment of large language models has brought significant attention to their associated privacy and security issues. Recent experiments have demonstrated that training data can be extracted from these models due to their memory effect. Initially, research on large language model training data extraction focused primarily on non-targeted methods. However, following the introduction of targeted training data extraction by Carlini et al., prefix-based extraction methods to generate suffixes have garnered considerable interest, although current extraction precision remains low. This paper focuses on the targeted extraction of training data, employing various methods to enhance the precision and speed of the extraction process. Building on the work of Yu et al., we conduct a comprehensive analysis of the impact of different suffix generation methods on the precision of suffix generation. Additionally, we examine the quality and diversity of text generated by various suffix generation strategies. The study also applies membership inference attacks based on neighborhood comparison to the extraction of training data in large language models, conducting thorough evaluations and comparisons. The effectiveness of membership inference attacks in extracting training data from large language models is assessed, and the performance of different membership inference attacks is compared. Hyperparameter tuning is performed on multiple parameters to enhance the extraction of training data. Experimental results indicate that the proposed method significantly improves extraction precision compared to previous approaches. [ABSTRACT FROM AUTHOR]

Published
2024
Full Text
View/download PDF

15. Positive effects of running exercise on astrocytes in the medial prefrontal cortex in an animal model of depression

Author

Huang, Dujuan, primary, Xiao, Qian, additional, Tang, Jing, additional, Liang, Xin, additional, Wang, Jin, additional, Hu, Menglan, additional, Jiang, Yanhong, additional, Liu, Li, additional, Qin, Lu, additional, Zhou, Mei, additional, Li, Yue, additional, Zhu, Peilin, additional, Deng, Yuhui, additional, Li, Jing, additional, Zhou, Chunni, additional, Luo, Yanmin, additional, and Tang, Yong, additional

Published
2022
Full Text
View/download PDF

Catalog

Books, media, physical & digital resources
See catalog results