Search

[Purpose/Significance] Deep learning for language modeling is one of the major methods and advanced technologies to enhance language intelligence of machines at present, which has become an indispensable important technical means for automatic processing and analysis of data resources, and intelligent mining of information and knowledge. However, there are still some difficulties in using deep learning for language modeling for technology development and application service in the library and information science (LIS) field. Therefore, this study systematically reviews and reveals the research progress, technical principles, and development methods of deep learning for language modeling, with the aim at providing reliable theoretical basis and feasible methodological paths for the deep understanding and application of deep learning for language modeling for librarians and fellow practitioners. [Method/Process] The data used in this study were collected from the WOS core database, CNKI literature database, arXiv preprint repository, GitHub open-source software hosting platform and the open resources on the Internet. Based on these data, this paper first systematically investigates the background, basic feature representation algorithms, and representative application development tools of deep learning for language modeling, reveals their dynamic evolution and technical principles, and analyzes the advantages and disadvantages and applicability of each algorithm model and development tool. Second, an in-depth analysis of the possible challenging problems faced by the development and application of deep learning for language modeling was performed, and two strategic approaches to expand their application capabilities were put forward. [Results/Conclusions] The important challenges faced by the application and development of deep learning for language modeling include numerous parameters and difficulties to adjust accuracy, relying on a large amount of accurate training data, difficulties in making changes, and the intellectual property and information security issues. In the future, we will start from two aspects of specific domains and feature engineering to expand and improve the application capabilities of deep learning for language modeling. Specifically, we focus on consideration of the collection and preparation of domain data, selection of model architecture, participation of domain experts, and optimization for specific tasks, in order to ensure that the data source of the model is more reliable and secure, and the application effect is more accurate and practical. Moreover, the strategic methods for feature engineering to expand the application capabilities of deep learning for language modeling include selecting appropriate features, feature pre-processing, feature selection, and feature dimensionality reduction. These strategies can help improve the performance and efficiency of deep learning for language models, making them more suitable for specific tasks or domains. To sum up, LIS institutions should leverage the deep learning for language modeling related technologies, guided by the needs of scientific research and social development, and based on advantages of existing literature data resources and knowledge services; they should carry out innovative professional or vertical domain intelligent knowledge management and application service, and develop technology and systems with independent intellectual property rights, which is their long-term sustainable development path.

Abstract Background Non‐alcoholic fatty liver disease (NAFLD) is a metabolic syndrome of the liver, and its incidence is increasing worldwide. Accumulating evidence suggests that bile acids are associated with NAFLD. Although many studies on bile acids and NAFLD have been published over the past 20 years, the authors of this study have not found a relevant bibliometric analysis in this field. Therefore, this study aimed to evaluate the trend of publications, summarize current research hotspots and predict future research directions through bibliometric analysis in this field. Method Articles related to bile acids and NAFLD published between 2002 and 2022 were obtained from the Science Citation Index‐Expanded of Web of Science Core Collection. Microsoft Excel, CiteSpace, VOSviewer and Bibliometric Online Analysis Platform were used to analyse the publication trends and research hotspots in this field. Results Among the articles published between 2002 and 2022, we retrieved 1284 articles related to bile acids and NAFLD, and finally included 568 articles. The USA was dominant until 2020, after which China surpassed the USA to become the dominant force. These two countries cooperate the most closely, and are also the most active in international cooperation. The University of California (UCL) was the most published institution, with a total of 31 publications. There were six authors who have published nine articles and ranked first. The keywords cluster labels show the 10 main clusters: #0fatty liver, #1obeticholic acid, #2oxidative stress, #37 alpha hydroxy 4 cholesten 3 one, #4deoxycholic acid, #5nonalcoholic fatty liver disease, #6mouse model, #7fibroblast growth factor 21, #8animal models, #9high‐fat diet. Keywords burst analysis revealed a higher intensity of study for the nuclear receptor, FXR, and metabolic syndrome. Conclusion Bile acids have become an important research direction in the field of NAFLD, and the intervention of gut microbiota in NAFLD by acting on bile acids may become a potential hotspot for future research. This study provides reference and guidance for future research, and will help scholars better explore the field and innovatively discover the mechanisms and treatments of NAFLD.

The X-ray spectral state transitions of Galactic black hole transients (GBHTs) are often linked to the changes in the mass accretion rate. A narrow distribution of transition luminosity in terms of the Eddington ratio has been found in previous studies of GBHTs based on RXTE data (Maccarone, 2003, A&A, 409, 697; Vahdat Motlagh et al. 2019, MNRAS, 485, 2744) and this Eddington ratio at the transition is often used in recent studies with instruments such as Swift/XRT and NICER/XTI, covering soft energies below 1 to 10 keV. However, the X-ray states characterized by spectral parameters may have different definitions depending on the energy ranges adopted in the spectral analysis, leaving the question of whether the distribution of transition luminosity obtained with RXTE remains the same when we use the instruments covering softer energy bands. In this work, we investigated the X-ray state evolutions and the variations of luminosities of eight outbursts of seven GBHTs. We found that the bolometric luminosity of the power-law component was tightly constrained to |$\sim\! 1.3\%$| Eddington luminosity at index transition when the photon index starts to decrease towards the hard state, which is consistent with the previous RXTE results (Vahdat Motlagh et al. 2019, MNRAS, 485, 2744; Kalemci et al. 2013, ApJ, 779, 95). Moreover, the tightest clustering was found to be the power-law luminosity right after the start of disk recession, with a mean logarithmic Eddington ratio of −1.84 ± 0.28. In addition, our results suggest that the disk recession starts after the bolometric disk luminosity drops below 1% Eddington luminosity. [ABSTRACT FROM AUTHOR]

It is important to classify academic papers in a fine-grained manner to uncover deeper implicit themes and semantics in papers for better semantic retrieval, paper recommendation, research trend prediction, topic analysis, and a series of other functions. Based on the ontology of the climate change domain, this study used an unsupervised approach to combine two methods, syntactic structure and semantic modeling, to build a framework of subject-indexing techniques for academic papers in the climate change domain. The framework automatically indexes a set of conceptual terms as research topics from the domain ontology by inputting the titles, abstracts and keywords of the papers using natural language processing techniques such as syntactic dependencies, text similarity calculation, pre-trained language models, semantic similarity calculation, and weighting factors such as word frequency statistics and graph path calculation. Finally, we evaluated the proposed method using the gold standard of manually annotated articles and demonstrated significant improvements over the other five alternative methods in terms of precision, recall and F1-score. Overall, the method proposed in this study is able to identify the research topics of academic papers more accurately, and also provides useful references for the application of domain ontologies and unsupervised data annotation. [ABSTRACT FROM AUTHOR]

Several studies have demonstrated the expression status of CD56 was associated with prognosis in multiple myeloma (MM) patients, the prognostic significance remains controversial. Here, the prognostic value of CD56 is further investigated in MM patients. We systematically searched the databases including PubMed, EMBASE, Web of Science and the Cochrane Library. The hazard ratios (HRs) with their 95% confidence intervals (CIs) were pooled to evaluate the relationship between CD56 and overall survival (OS) and progress-free survival (PFS). A total of 14 studies covering 1365 patients were included in this meta-analysis. The results revealed that CD56 negativity in MM was associated with poorer OS (HR = 1.83, 95% CI = 1.29–2.60, P = 0.001) and PFS (HR = 1.57, 95% CI = 1.27–1.95, P = 0.000). Subgroup analysis further demonstrated that there was an effect of treatment regimen, detection method, survival analysis, study region and the cut-off value of CD56 on CD56 expression. The meta-analysis suggested that CD56 negative patients had a poor prognosis for OS in Asian patients and for PFS in non-Asian patients. Novel drugs didn't show a significant improvement or overcome on the adverse prognosis brought by CD56 negativity. For patients undergone autologous stem-cell transplantation (ASCT), the poor prognosis was overcome by the treatment, which shed a light on the prognostic judgment and individualized treatment. [ABSTRACT FROM AUTHOR]

We report on the evolution of X-ray spectral and timing properties of the X-ray binary MAXI J1727 − 203 based on NICER/XTI and MAXI/GSC observations. Over the course of the outburst, a transition from the intermediate state to the high/soft state, and then back to the low/hard state was observed. During the high/soft state, the innermost radius estimated from the multi-colour disc model remained constant at |$\sim 145.0\ (\frac{D}{10\ \mathrm{kpc}}) \ {(\frac{\cos i}{\cos 0^{\circ }})}^{-1/2}$| km, where D is the source distance and i is the inclination. Assuming that the binary system contain a Schwarzschild black hole and has an inclination angle of 0°–84°, and considering the typical Eddington ratio at the transition back to the low/hard state, the black hole mass was estimated to be M ≥ 11.5 M⊙ for a distance of D ≥ 5.9 kpc. We also attempted to constrain the black hole mass and distance with a different method by combining the results from optical and near-infrared photometric observations. We modelled the near-infrared to X-ray spectral energy distributions obtained in the outburst period with an irradiated disk model, and estimated the lower limit of the black hole mass for a given distance, assuming both accretion disk and companion star fill their Roche lobe. The lower limit was, however, found to be much higher than the constraint obtained from the X-ray data. We discuss several possible causes of this inconsistency. It is difficult to fully resolve the conflict by a single cause and hence a combination of causes is required. [ABSTRACT FROM AUTHOR]

A good understanding of the chemical disorder in silicon carbide (SiC) after ion irradiation is crucial for evaluating structural stability in both semiconductor and nuclear power systems. In this study, 6H-SiC single-crystal was irradiated with 500 keV He and 2.5 MeV Fe ions at room temperature, followed by annealing at 1500 °C for 2 h. The chemical disorders were investigated by electron energy-loss spectroscopy with the transmission electron microscopy at 200 kV. Facetted voids were found in the end region of the damaged layer. Compared with the substrate region, the Si at.% was lower, while the values of C and O at.% were higher, in particular in inner voids. SiCOx (x < 1) bonds at the inner surface of the voids were detected. The energy losses of Si, C edges shifted to be lower in the damaged layer. The possible reason is discussed, and the research results will be used for understanding the ion irradiation-induced damage in SiC. [ABSTRACT FROM AUTHOR]

Apatite fission track (AFT) sampled from Helan Mountain, of the western Ordos Basin, North China shows that the study area located in the western part of the North China Craton (NCC) has undergone four‐stage exhumation since Mesozoic time, that is, Late Jurassic to Early Cretaceous, Late Cretaceous, Early Cenozoic, and post‐late Miocene. Helan Mountain had slowly uplifted and eroded from the Late Jurassic to the beginning of the Cenozoic. The intensive deformation within NCC is attributable dynamically to the gently angular subduction of the Pacific Plate under the Eurasian Plate (EP). Helan Mountain has undergone sinistral strike‐slipping with a 60‐km maximum displacement caused by the collision of the southeast margin of EP during the Late Cretaceous. The Early Cenozoic tectonic event in the study area is respondent to collision between the Indian Plate and Eurasian Plate, whereas, the post‐late Miocene event is likely related to the eastward extension of Tibet Plateau. Based on the available AFT ages, the partial annealing zone for the palaeo‐Helan Mountain is ascertained to elevation ~1,200 m to ~2,100 m. The tectonic events occurring from Mesozoic to Cenozoic in Helan Mountain is directly related to the plate margin tectonism and representative for the intracontinental deformation of Eurasian Plate convergence. The sandstone‐type uranium deposits in the western margin thrust belt of Ordos Basin are related to the Late Jurassic to Early Cretaceous and Late Cretaceous exhumation events. Immediately after the host rock, the Zhiluo Formation sedimentation during the Middle Jurassic, the Late Jurassic ~ Late Cretaceous exhumations resulted in north–south‐trending anticlines, synclines, and thrust faults; meanwhile, the Zhiluo Formation was uplifted to the surface and infiltrated by uranium‐bearing oxidized fluids originated from the Helan Mountain. Uranium deposits were formed in both east and west limbs of folds. Finally, uranium mineralization ceased since the Cenozoic because the Yinchuan and Hetao faulted grabens have separated the Helan Mountain provenance from the western margin thrust belt. [ABSTRACT FROM AUTHOR]

We developed a high-speed image reduction pipeline using Graphics Processing Units (GPUs) as hardware accelerators. Astronomers desire to detect the emission measure counterpart of gravitational-wave sources as soon as possible and to share in the systematic follow-up observation. Therefore, high-speed image processing is important. We developed a new image-reduction pipeline for our robotic telescope system, which uses a GPU via the Python package CuPy for high-speed image processing. As a result, the new pipeline has increased in processing speed by more than 40 times compared with the current one, while maintaining the same functions. [ABSTRACT FROM AUTHOR]

Seismic signal is always contaminated by coherent and incoherent noise. Conventional incoherent noise suppression methods use the statistical difference between the signal and incoherent noise to distinguish between them. These methods are effective for random noise but are limited or even invalid for erratic noise because the latter far from satisfies the statistical assumption behind the conventional techniques. The presented study proposes a novel mathematical morphology based technique for attenuating both erratic and random noise. In this technique, 2-D mathematical morphological filtering (MMF) is implemented in each frequency slice of the 3-D seismic data cube (f – xy domain) to detect the morphological scale difference between the signal and noise. The proposed technique is compared with state-of-the-art low-rank/sparse representation based techniques by using both synthetic and real data sets. The various examples demonstrate that the proposed f – xy domain 2-D MMF method can preserve more useful signal and suppress more incoherent noise (erratic and random noise) than the low-rank and sparse representations based methods. [ABSTRACT FROM AUTHOR]

Crude glycerol is a primary by-product in the biodiesel industry. Microbial fermentation on crude glycerol for producing value-added products provides opportunities to utilize a large quantity of this by-product. This study investigates the potential of using the crude glycerol to produce vancomycin (glycopeptide antibiotics) through fermentation of Amycolatopsis orientalis XMU-VS01. The results show that crude glycerol was the most effective carbon source for mycelium growth and vancomycin production, with 40-60 g/L glycerol concentration as optimal range. Among other culture medium components, potato protein (nitrogen source) and the phosphate concentration had significant effects ( p<0.05) for vancomycin production. A Box-Behnken design and response surface methodology were employed to formulate the optimal medium. Their optimal values were determined as 52.73 g/L of glycerol, 17.36 g/L of potato protein, and 0.1 g/L of dipotassium phosphate. A highest vancomycin yield of 7.61 g/L with biomass concentration of 15.8 g/L was obtained after 120 h flask fermentation. The yield of vancomycin was 3.5 times higher than with basic medium. The results suggest that biodiesel-derived crude glycerol is a promising feedstock for production of vancomycin from A. orientalis culture. [ABSTRACT FROM AUTHOR]

Locating underground microseismic events is important for monitoring subsurface activity and understanding the planetary subsurface evolution. Due to bandwidth limitations, especially in applications involving planetarily-distributed sensor networks, networks should be designed to perform the localization algorithm in-situ, so that only the source location information needs to be sent out, not the raw data. In this paper, we propose a decentralized Gaussian beam time-reverse imaging (GB-TRI) algorithm that can be incorporated to the distributed sensors to detect and locate underground microseismic events with reduced usage of computational resources and communication bandwidth of the network. After the in-situ distributed computation, the final real-time location result is generated and delivered. We used a real-time simulation platform to test the performance of the system. We also evaluated the stability and accuracy of our proposed GB-TRI localization algorithm using extensive experiments and tests. [ABSTRACT FROM AUTHOR]

We report on the X-ray spectral analysis and time evolution of GRS 1739−278 during its 2014 outburst, based on MAXI/GSC and Swift/XRT observations. Over the course of the outburst, a transition from the low/hard state to the high/soft state and then back to the low/hard state was seen. During the high/soft state, the innermost disk temperature mildly decreased, while the innermost radius estimated with the multi-color disk model remained constant at ∼18 (D /8.5 kpc)(cos  i /cos 30°)−1/2 km, where D is the source distance and i is the inclination of observation. This small innermost radius of the accretion disk suggests that the central object is more likely to be a Kerr black hole rather than a Schwardzschild black hole. Applying a relativistic disk emission model to the high/soft state spectra, a mass upper limit of 18.3  M ⊙ was obtained based on the inclination limit i  < 60° for an assumed distance of 8.5 kpc. Using the empirical relation of the transition luminosity to the Eddington limit, the mass is constrained to 4.0–18.3  M ⊙ for the same distance. The mass can be further constrained to be no larger than 9.5  M ⊙ by adopting the constraints based on the fits to the NuSTAR spectra with relativistically blurred disk reflection models (Miller et al. 2015, ApJ, 799, L6). [ABSTRACT FROM AUTHOR]