Search

Your search keyword '"Yang, Lijuan"' showing total 2,251 results
Start Over Author "Yang, Lijuan"
2,251 results on '"Yang, Lijuan"'

6. Advancing Transformer Architecture in Long-Context Large Language Models: A Comprehensive Survey

Author

Huang, Yunpeng, Xu, Jingwei, Lai, Junyu, Jiang, Zixu, Chen, Taolue, Li, Zenan, Yao, Yuan, Ma, Xiaoxing, Yang, Lijuan, Chen, Hao, Li, Shupeng, and Zhao, Penghao

Subjects
Computer Science - Computation and Language, Computer Science - Machine Learning, I.2.7, I.2.6, I.2.11
Abstract

Transformer-based Large Language Models (LLMs) have been applied in diverse areas such as knowledge bases, human interfaces, and dynamic agents, and marking a stride towards achieving Artificial General Intelligence (AGI). However, current LLMs are predominantly pretrained on short text snippets, which compromises their effectiveness in processing the long-context prompts that are frequently encountered in practical scenarios. This article offers a comprehensive survey of the recent advancement in Transformer-based LLM architectures aimed at enhancing the long-context capabilities of LLMs throughout the entire model lifecycle, from pre-training through to inference. We first delineate and analyze the problems of handling long-context input and output with the current Transformer-based models. We then provide a taxonomy and the landscape of upgrades on Transformer architecture to solve these problems. Afterwards, we provide an investigation on wildly used evaluation necessities tailored for long-context LLMs, including datasets, metrics, and baseline models, as well as optimization toolkits such as libraries, frameworks, and compilers to boost the efficacy of LLMs across different stages in runtime. Finally, we discuss the challenges and potential avenues for future research. A curated repository of relevant literature, continuously updated, is available at https://github.com/Strivin0311/long-llms-learning., Comment: 40 pages, 3 figures, 4 tables

Published
2023

7. Weighted structure tensor total variation for image denoising

Author

Sheng, Xiuhan, Yang, Lijuan, and Chang, Jingya

Subjects
Mathematics - Optimization and Control, Computer Science - Computer Vision and Pattern Recognition, Electrical Engineering and Systems Science - Image and Video Processing
Abstract

For image denoising problems, the structure tensor total variation (STV)-based models show good performances when compared with other competing regularization approaches. However, the STV regularizer does not couple the local information of the image and may not maintain the image details. Therefore, we employ the anisotropic weighted matrix introduced in the anisotropic total variation (ATV) model to improve the STV model. By applying the weighted matrix to the discrete gradient of the patch-based Jacobian operator in STV, our proposed weighted STV (WSTV) model can effectively capture local information from images and maintain their details during the denoising process. The optimization problem in the model is solved by a fast first-order gradient projection algorithm with a complexity result of $O(1 / i^2)$. For images with different Gaussian noise levels, the experimental results demonstrate that the WSTV model can effectively improve the quality of restored images compared to other TV and STV-based models.

Published
2023

18. Mucosal prime-boost immunization with live murine pneumonia virus-vectored SARS-CoV-2 vaccine is protective in macaques

Author

Kaiser, Jaclyn A., Nelson, Christine E., Liu, Xueqiao, Park, Hong-Su, Matsuoka, Yumiko, Luongo, Cindy, Santos, Celia, Ahlers, Laura R. H., Herbert, Richard, Moore, Ian N., Wilder-Kofie, Temeri, Moore, Rashida, Walker, April, Yang, Lijuan, Munir, Shirin, Teng, I-Ting, Kwong, Peter D., Dowdell, Kennichi, Nguyen, Hanh, Kim, JungHyun, Cohen, Jeffrey I., Johnson, Reed F., Garza, Nicole L., Via, Laura E., Barber, Daniel L., Buchholz, Ursula J., and Le Nouën, Cyril

Published
2024
Full Text
View/download PDF

23. Premature death of female breast cancer patients and its trend in Putuo District of Shanghai from 2004 to 2019

Author

SHI Feiya, CHEN Jun, YANG Lijuan, WANG Wan, and SHEN Yuan

Subjects
breast cancer, female, incidence rate, mortality rate, probability of premature death, tendency, Medicine
Abstract

ObjectiveTo understand the incidence and death of female breast cancer patients and the premature death caused by breast cancer in Putuo District of Shanghai, and to reduce the incidence of breast cancer, mortality and the probability of early death, and to provide reference for realizing the control target of the probability of early death of major chronic diseases.MethodsThe incidence and death data of the registered female residents with breast cancer in Putuo District of Shanghai from 2004 to 2019 were collected using Shanghai Population-based tumor registration management system. The crude incidence rate, standardized incidence rate, crude mortality rate, standardized mortality rate, age-specific incidence rate, age-specific mortality rate and other indicators were calculated. The Joinpoint regression model was used to calculate the annual percentage change (APC) and average annual percentage change (AAPC) of breast cancer incidence, mortality and premature death probability, and to analyze the changing trend.ResultsFrom 2004 to 2019, the crude incidence of breast cancer in Putuo District of Shanghai increased from 75.76/105 to 95.77/105 (APC=2.26%, t=6.05, P

Published
2024
Full Text
View/download PDF

24. Research on Closing Resistance of 750 kV Circuit Breaker Based on ATP-EMTP

Author

Yang, Lijuan, Tao, Xing, Jiang, Longyun, Angrisani, Leopoldo, Series Editor, Arteaga, Marco, Series Editor, Chakraborty, Samarjit, Series Editor, Chen, Jiming, Series Editor, Chen, Shanben, Series Editor, Chen, Tan Kay, Series Editor, Dillmann, Rüdiger, Series Editor, Duan, Haibin, Series Editor, Ferrari, Gianluigi, Series Editor, Ferre, Manuel, Series Editor, Jabbari, Faryar, Series Editor, Jia, Limin, Series Editor, Kacprzyk, Janusz, Series Editor, Khamis, Alaa, Series Editor, Kroeger, Torsten, Series Editor, Li, Yong, Series Editor, Liang, Qilian, Series Editor, Martín, Ferran, Series Editor, Ming, Tan Cher, Series Editor, Minker, Wolfgang, Series Editor, Misra, Pradeep, Series Editor, Mukhopadhyay, Subhas, Series Editor, Ning, Cun-Zheng, Series Editor, Nishida, Toyoaki, Series Editor, Oneto, Luca, Series Editor, Panigrahi, Bijaya Ketan, Series Editor, Pascucci, Federica, Series Editor, Qin, Yong, Series Editor, Seng, Gan Woon, Series Editor, Speidel, Joachim, Series Editor, Veiga, Germano, Series Editor, Wu, Haitao, Series Editor, Zamboni, Walter, Series Editor, Tan, Kay Chen, Series Editor, Yang, Qingxin, editor, Li, Zewen, editor, and Luo, An, editor

Published
2024
Full Text
View/download PDF

28. Evaluation of Recombinant Live-Attenuated Respiratory Syncytial Virus (RSV) Vaccines RSV/ΔNS2/Δ1313/I1314L and RSV/276 in RSV-Seronegative Children

Author

Cunningham, Coleen K, Karron, Ruth A, Muresan, Petronella, Kelly, Matthew S, McFarland, Elizabeth J, Perlowski, Charlotte, Libous, Jennifer, Oliva, Jennifer, Jean-Philippe, Patrick, Moye, Jack, Schappell, Elizabeth, Barr, Emily, Rexroad, Vivian, Johnston, Benjamin, Chadwick, Ellen G, Cielo, Mikhaela, Paul, Mary, Deville, Jaime G, Aziz, Mariam, Yang, Lijuan, Luongo, Cindy, Collins, Peter L, Buchholz, Ursula J, and Team, the International Maternal Pediatric Adolescent AIDS Clinical Trials 2018 Study

Subjects
Medical Microbiology, Biomedical and Clinical Sciences, Clinical Sciences, Pneumonia, Immunization, Clinical Trials and Supportive Activities, Lung, Infectious Diseases, Biotechnology, Vaccine Related, Pneumonia & Influenza, Clinical Research, Pediatric, Prevention, Evaluation of treatments and therapeutic interventions, Prevention of disease and conditions, and promotion of well-being, 3.4 Vaccines, 6.1 Pharmaceuticals, Infection, Good Health and Well Being, Child, Humans, Antibodies, Neutralizing, Antibodies, Viral, Cough, Respiratory Syncytial Virus Infections, Respiratory Syncytial Virus Vaccines, Respiratory Syncytial Virus, Human, Respiratory Syncytial Viruses, Vaccines, Attenuated, respiratory syncytial virus, RSV, live-attenuated viral vaccine, neutralizing antibodies, immunogenicity, RNA regulatory protein M2-2, International Maternal Pediatric Adolescent AIDS Clinical Trials (IMPAACT) 2018 Study Team, Biological Sciences, Medical and Health Sciences, Microbiology, Biological sciences, Biomedical and clinical sciences, Health sciences
Abstract

BackgroundThis United States-based study compared 2 candidate vaccines: RSV/ΔNS2/Δ1313/I1314L, attenuated by NS2 gene-deletion and temperature-sensitivity mutation in the polymerase gene; and RSV/276, attenuated by M2-2 deletion.MethodsRSV-seronegative children aged 6-24 months received RSV/ΔNS2/Δ1313/I1314L (106 plaque-forming units [PFU]), RSV/276 (105 PFU), or placebo intranasally. Participants were monitored for vaccine shedding, reactogenicity, and RSV serum antibodies, and followed over the subsequent RSV season.ResultsEnrollment occurred September 2017 to October 2019. During 28 days postinoculation, upper respiratory illness and/or fever occurred in 64% of RSV/ΔNS2/Δ1313/I1314L, 84% of RSV/276, and 58% of placebo recipients. Symptoms were generally mild. Cough was more common in RSV/276 recipients than RSV/ΔNS2/Δ1313/I1314L (48% vs 12%; P = .012) or placebo recipients (17%; P = .084). There were no lower respiratory illness or serious adverse events. Eighty-eight and 96% of RSV/ΔNS2/Δ1313/I1314L and RSV/276 recipients were infected with vaccine (shed vaccine and/or had ≥4-fold rises in RSV antibodies). Serum RSV-neutralizing titers and anti-RSV F IgG titers increased ≥4-fold in 60% and 92% of RSV/ΔNS2/Δ1313/I1314L and RSV/276 vaccinees, respectively. Exposure to community RSV during the subsequent winter was associated with strong anamnestic RSV-antibody responses.ConclusionsBoth vaccines had excellent infectivity and were well tolerated. RSV/276 induced an excess of mild cough. Both vaccines were immunogenic and primed for strong anamnestic responses.Clinical trials registrationNCT03227029 and NCT03422237.

Published
2022

44. An Engineering-Problem-Based Short Experiment Project on Finite Element Method for Undergraduate Students

Author

Guo, Yanjie, Yang, Lijuan, Chen, Xuefeng, and Yang, Lei

Abstract

How to cultivate students' engineering practice ability in the digital manufacturing period is a difficult problem. This paper presents a finite element analysis experiment project for undergraduate students. The goals of implementing finite element modeling in this project are to enhance students' understanding of theoretical mechanics and to introduce computational methods to undergraduate students at an early stage during their undergraduate education. The students are required to use different methods to analyze the stress state of a typical engineering structure and seek the optimal design. Then, the experiment score is divided into two parts according to the course objectives. We analyzed the score distribution to find the limitations of teaching. The feedback from the students demonstrate that the experiment case from the engineering project can increase their interest in learning and applying the acquired knowledge. After comparisons, our conclusion is that outcome-based education (OBE) can effectively improve the quality of classroom teaching, and this experimental project can improve students' engineering practice ability and obtain satisfactory teaching results.

Published
2020

Catalog

Books, media, physical & digital resources
See catalog results