Search

BackgroundPatients find technology tools to be more approachable for seeking sensitive health-related information, such as reproductive health information. The inventive conversational ability of artificial intelligence (AI) chatbots, such as ChatGPT (OpenAI Inc), offers a potential means for patients to effectively locate answers to their health-related questions digitally.ObjectiveA pilot study was conducted to compare the novel ChatGPT with the existing Google Search technology for their ability to offer accurate, effective, and current information regarding proceeding action after missing a dose of oral contraceptive pill.MethodsA sequence of 11 questions, mimicking a patient inquiring about the action to take after missing a dose of an oral contraceptive pill, were input into ChatGPT as a cascade, given the conversational ability of ChatGPT. The questions were input into 4 different ChatGPT accounts, with the account holders being of various demographics, to evaluate potential differences and biases in the responses given to different account holders. The leading question, "what should I do if I missed a day of my oral contraception birth control?" alone was then input into Google Search, given its nonconversational nature. The results from the ChatGPT questions and the Google Search results for the leading question were evaluated on their readability, accuracy, and effective delivery of information.ResultsThe ChatGPT results were determined to be at an overall higher-grade reading level, with a longer reading duration, less accurate, less current, and with a less effective delivery of information. In contrast, the Google Search resulting answer box and snippets were at a lower-grade reading level, shorter reading duration, more current, able to reference the origin of the information (transparent), and provided the information in various formats in addition to text.ConclusionsChatGPT has room for improvement in accuracy, transparency, recency, and reliability before it can equitably be implemented into health care information delivery and provide the potential benefits it poses. However, AI may be used as a tool for providers to educate their patients in preferred, creative, and efficient ways, such as using AI to generate accessible short educational videos from health care provider-vetted information. Larger studies representing a diverse group of users are needed.

This article provides three major contributions to the literature: we provide granular information on the development of student argumentative writing across secondary school; we replicate the MacArthur et al. model of Natural Language Processing (NLP) writing features that predict quality with a younger group of students; and we are able to examine the differences for students across language status. In our study, we sought to find the average levels of text length, cohesion, connectives, syntactic complexity, and word-level complexity in this sample across Grades 7-12 by sex, by English learner status, and for essays scoring above and below the median holistic score. Mean levels of variables by grade suggest a developmental progression with respect to text length, with the text length increasing with grade level, but the other variables in the model were fairly stable. Sex did not seem to affect the model in meaningful ways beyond the increased fluency of women writers. We saw text length and word level differences between initially designated and redesignated bilingual students compared to their English-only peers. Finally, we see that the model works better with our higher scoring essays and is less effective explaining the lower scoring essays.

The price of oil is highly complex to predict as it is impacted by global demand and supply, geopolitical events, and market sentiment. The accuracy of such predictions, however, has far-reaching implications for supply chain performance, portfolio management, and expected stock market returns. This paper contributes to the oil price prediction literature by evaluating the predictive impact of the US President's communication on Twitter, while benchmarking various Natural Language Processing (NLP) techniques, including Term Frequency-Inverse Document Frequency (TF-IDF), Word2Vec, Doc2Vec, Global Vectors for Word Representation (GloVe), and Bidirectional Encoder Representations from Transformers (BERT). These techniques are combined with a deep neural network Long Short-Term Memory (LSTM) architecture using a five-day lag for both the oil price and the textual Twitter data. The data was collected during the term of US President Donald Trump, resulting in 1449 days of crude oil price prediction and a total of 16,457 tweets. The study is validated for Brent and West Texas Intermediate blends, using the daily price of a barrel of crude oil as the target variable. The results confirm that including the US President's tweets significantly increases the predictive power of oil price prediction models, and that an LSTM architecture with BERT as NLP technique has the best performance. [ABSTRACT FROM AUTHOR]

Our research strives to examine how simulation models of logistics systems can be produced automatically from verbal descriptions in natural language and how human experts and artificial intelligence (AI)-based systems can collaborate in the domain of simulation modelling. We demonstrate that a framework constructed upon the refined GPT-3 Codex is capable of generating functionally valid simulations for queuing and inventory management systems when provided with a verbal explanation. As a result, the language model could produce simulation models for inventory and process control. These results, along with the rapid improvement of language models, enable a significant simplification of simulation model development. Our study offers guidelines and a design of a natural language processing-based framework on how to build simulation models of logistics systems automatically, given the verbal description. In generalised terms, our work offers a technological underpinning of human-AI collaboration for the development of simulation models. [ABSTRACT FROM AUTHOR]

Large-scale text data from public sources, including social media or online platforms, can expand urban planners’ ability to monitor and analyze urban conditions in near real-time. To overcome scalability challenges of manual techniques for qualitative data analysis, researchers and practitioners have turned to computer-automated methods, such as natural language processing (NLP) and deep learning. However, the benefits, challenges, and trade-offs of these methods remain poorly understood. How much meaning can different NLP techniques capture and how do their results compare to traditional manual techniques? Drawing on 90,000 online rental listings in Los Angeles County, this study proposes and compares manual, semi-automated, and fully automated methods for identifying context-informed topics in unstructured, user-generated text data. We find that fully automated methods perform best with more-structured text, but struggle to separate topics in free-flow text and when handling nuanced language. Introducing a manual technique first on a small data set to train a semi-automated method, however, improves accuracy even as the structure of the text degrades. We argue that while fully automated NLP methods are attractive replacements for scaling manual techniques, leveraging the contextual understanding of human expertise alongside efficient computer-based methods like BERT models generates better accuracy without sacrificing scalability.

BACKGROUND: Pathology reports contain key information about the patients diagnosis as well as important gross and microscopic findings. These information-rich clinical reports offer an invaluable resource for clinical studies, but data extraction and analysis from such unstructured texts is often manual and tedious. While neural information retrieval systems (typically implemented as deep learning methods for natural language processing) are automatic and flexible, they typically require a large domain-specific text corpus for training, making them infeasible for many medical subdomains. Thus, an automated data extraction method for pathology reports that does not require a large training corpus would be of significant value and utility. OBJECTIVE: To develop a language model-based neural information retrieval system that can be trained on small datasets and validate it by training it on renal transplant-pathology reports to extract relevant information for two predefined questions: (1) What kind of rejection does the patient show?; (2) What is the grade of interstitial fibrosis and tubular atrophy (IFTA)? METHODS: Kidney BERT was developed by pre-training Clinical BERT on 3.4K renal transplant pathology reports and 1.5M words. Then, exKidneyBERT was developed by extending Clinical BERTs tokenizer with six technical keywords and repeating the pre-training procedure. This extended the models vocabulary. All three models were fine-tuned with information retrieval heads. RESULTS: The model with extended vocabulary, exKidneyBERT, outperformed Clinical BERT and Kidney BERT in both questions. For rejection, exKidneyBERT achieved an 83.3% overlap ratio for antibody-mediated rejection (ABMR) and 79.2% for T-cell mediated rejection (TCMR). For IFTA, exKidneyBERT had a 95.8% exact match rate. CONCLUSION: ExKidneyBERT is a high-performing model for extracting information from renal pathology reports. Additional pre-training of BERT language models on specialized small domains does not necessarily improve performance. Extending the BERT tokenizers vocabulary library is essential for specialized domains to improve performance, especially when pre-training on small corpora.

There is an ever-increasing number of public users of the internet just to remain learned and updated as well as distribute millions of posts, articles, and videos across platforms such as Twitter, Facebook and YouTube etc. The speedy acceptance of social media has forced to an explosive growth in information-distribution among users, with fake news becoming a fundamental intrusion of our digital day-to-day life. The spread of disinformation is in part associated to social media failing to verify the correctness of a news item. Although it is technically possible, it is challenging for a deep neural network to "attend to" the false alone portions of each news piece because the linguistics of fake news will approximate that of true news. In this paper, a Simple Shallow Perceptron Network (SSPN) has been proposed and will reduce the complications such as the curse of high dimensionality, high training time of Deep Neural Networks, over-fitting and over-thinking problem during network training. The effectiveness of the proposed SSPN model for false news identification using the benchmark LIAR dataset and the more recent FakeNewsNet dataset have also been examined. The proposed model outperformed all other existing models, with an F1-score of 0.73 for the LIAR dataset and 0.90 for the FakeNewsNet dataset. [ABSTRACT FROM AUTHOR]

Misidentification and misreporting of hate crimes by victims and law enforcement are significant barriers to accurate data collection of hate crimes, and their consequent study and prevention. The use of machine learning in crime detection can improve the accuracy and speed at which reported incidents with bias elements are identified. This study develops a machine learning classifier that categorizes police reports as either events with bias elements or events with no bias elements. We use incident/offense reports from the Seattle Police Department to train a Natural Language Processing classification algorithm. We collect narratives, location data, and victim and suspect demographics to use as features. We evaluate the performance of logistic regression, random forest, and XGBoost algorithms, as well as several text embedding techniques. Despite substantial class imbalance, our model achieves a macro F1-score of 0.79, demonstrating the benefits of applied machine learning in accurately detecting and reporting hate crimes. [ABSTRACT FROM AUTHOR]

Microbiota analysis can provide valuable insights in various fields, including diet and nutrition, understanding health and disease, and in environmental contexts, such as understanding the role of microorganisms in different ecosystems. Based on the results, we can provide targeted therapies, personalized medicine, or detect environmental contaminants. In our research, we examined the gut microbiota of 16 animal taxa, including humans, as well as the microbiota of cattle and pig manure, where we focused on 16S rRNA V3-V4 hypervariable regions. Analyzing these regions is common in microbiome studies but can be challenging since the results are high-dimensional. Thus, we utilized machine learning techniques and demonstrated their applicability in processing microbial sequence data. Moreover, we showed that techniques commonly employed in natural language processing can be adapted for analyzing microbial text vectors. We obtained the latter through frequency analyses and utilized the proposed hierarchical clustering method over them. All steps in this study were gathered in a proposed microbial sequence data processing pipeline. The results demonstrate that we not only found similarities between samples but also sorted groups' samples into semantically related clusters. We also tested our method against other known algorithms like the Kmeans and Spectral Clustering algorithms using clustering evaluation metrics. The results demonstrate the superiority of the proposed method over them. Moreover, the proposed microbial sequence data pipeline can be utilized for different types of microbiota, such as oral, gut, and skin, demonstrating its reusability and robustness. [ABSTRACT FROM AUTHOR]

In this modern digital era, the increasing volume of textual data and the widespread adoption of natural language processing (NLP) techniques have presented a critical challenge in safeguarding sensitive privacy information. As a result, there is a pressing demand to design robust and accurate NLP-based techniques to perform efficient sensitive information detection in textual data. This research paper focuses on the detection and classification of sensitive privacy information in textual documents using NLP by proposing a novel algorithm named Privacy BERT-LSTM. The proposed Privacy BERT-LSTM algorithm employs BERT for obtaining contextual embeddings and LSTM for sequential information processing, facilitating efficient sensitive information detection in textual documents. The BERT with its bidirectional characteristics captures the nuances and meaning of the textual documents, while the LSTM derives the long-range dependencies in the textual data. Moreover, the proposed Privacy BERT-LSTM algorithm with its attention mechanism highlights the important regions of the textual documents, contributing to efficient sensitive information detection. The comprehensive performance evaluation is conducted by employing the SMS Spam Collection dataset in terms of standard performance metrics and comparing it with different state-of-the-art techniques, namely, CASSED, PRIVAFRAME, CNN-LSTM, Conv-FFD, GCSA, TSIIP, and, C-PIIM. The experimental outcomes clearly illustrate that the Privacy BERT-LSTM algorithm demonstrates superior performance in identifying various types of sensitive information by achieving an accuracy of 92.50%, F1-score of 85.02%, and Precision of 89.36%. The proposed algorithm outperforms existing baseline models, providing valuable advancements in sensitive information detection using NLP. Therefore, this research contributes to the advancement of privacy protection in NLP applications and opens avenues for future investigations in the domain of sensitive information detection. Additionally, the proposed algorithm provides valuable insights for researchers and practitioners working on privacy-sensitive NLP tasks. [ABSTRACT FROM AUTHOR]

This paper presents the topic review (TR), a novel semi-automatic framework designed to enhance the efficiency and accuracy of literature reviews. By leveraging the capabilities of large language models (LLMs), TR addresses the inefficiencies and error-proneness of traditional review methods, especially in rapidly evolving fields. The framework significantly improves literature review processes by integrating advanced text mining and machine learning techniques. Through a case study approach, TR offers a step-by-step methodology that begins with query generation and refinement, followed by semi-automated text mining to identify relevant articles. LLMs are then employed to extract and categorize key themes and concepts, facilitating an in-depth literature analysis. This approach demonstrates the transformative potential of natural language processing in literature reviews. With an average similarity of 69.56% between generated and indexed keywords, TR effectively manages the growing volume of scientific publications, providing researchers with robust strategies for complex text synthesis and advancing knowledge in various domains. An expert analysis highlights a positive Fleiss' Kappa score, underscoring the significance and interpretability of the results. [ABSTRACT FROM AUTHOR]

The pace of technological advancement over the last three decades has led to a slew of new companies adopting the latest technologies and marrying them to innovative new business models to threaten more traditional businesses. Start-ups such as Google, Meta and Amazon, to name a few, have revolutionised the way consumers engage with service providers, consume information and purchase goods. Fintech start-ups have also threatened to change the way financial services are provided, albeit with varying degrees of success due to barriers such as consumer trust in new brands, regulatory compliance and the financial strength of banks to build those same services internally. There is no denying, however, that custodian banks today face many challenges that are slowly eroding margins. Regulators are demanding shorter settlement times, clients are demanding greater control over their accounts, staff costs are rising and cyber security threats are increasing. This paper seeks to highlight some of the threats the industry is facing while exploring the role that artificial intelligence (AI) may be able to play in addressing some of these challenges. It offers a broad overview of not just areas of application but also weaknesses of the technology that the bank needs to be aware of and also possible issues with implementation. It also seeks to highlight the fact that AI is not a single technology, unlike distributed ledger systems. There are many nuances to AI, such as convolution neural networks, natural language processing and generative AI, and the judicious application of the right nuance of AI to the problem will be key to a successful implementation. [ABSTRACT FROM AUTHOR]

Large language models (LLMs) have transformed the interpretation and creation of human language in the rapidly developing field of computerized language processing. These models, which are based on deep learning techniques like transformer architectures, have been painstakingly trained on massive text datasets. This study paper takes an in-depth look into LLMs, including their architecture, historical evolution, and applications in education, healthcare, and finance sector. LLMs provide logical replies by interpreting complicated verbal patterns, making them beneficial in a variety of real-world scenarios. Their development and implementation, however, raise ethical concerns and have societal ramifications. Understanding the importance and limitations of LLMs is critical for guiding future research and ensuring the ethical use of their enormous potential. This survey exposes the influence of these models as they change, providing a roadmap for researchers, developers, and policymakers navigating the world of artificial intelligence and language processing. [ABSTRACT FROM AUTHOR]

The spread of misinformation has reached a level at which neither research nor fact-checkers can monitor it only manually anymore. Accordingly, there has been much research on models and datasets for detecting checkworthy claims. However, the research in NLP is mostly detached from findings in communication science on misinformation and fact-checking. Checkworthiness is a notoriously vague concept whose meaning is contested among different stakeholders. Against the background of news value theory, i.e., the study of factors that make an event relevant for journalistic reporting, this is not surprising. It is argued that this vagueness leads to inconsistencies and poor generalization across different datasets and domains. For the experiments, models are trained on one dataset, tested on the remaining, and evaluated against the results on the original performance, against a random baseline, and against the scores when the models are not trained at all. The study finds that there is a drastic reduction in comparison with the performance on the original dataset. Moreover, often the models are outperformed by the random baseline and training on one dataset has no or even a negative impact on the performance on the other datasets. This paper proposes that future research should abandon this task design and instead take inspiration from research in communication science. In the style of news values, Claim Detection should focus on factors that are relevant for fact-checkers and misinformation. [ABSTRACT FROM AUTHOR]

Entity recognition and extraction from contracts play a crucial role in automating contract analysis and extracting valuable information. Named Entity Recognition (NER) techniques are used for identifying and classifying specific entities such as parties, dates, amounts, and clauses within contracts. In this study, we create a high-quality NER dataset from various types of English language contracts by considering their structure, and the legal terminology used within these documents. We present a systematic approach to manually annotate contracts with appropriate entity labels, ensuring accuracy and consistency. The resulting NER dataset serves as a valuable resource for training and evaluating NER models for contract analysis tasks. We evaluate the performance of NER on this dataset using a range of methods. These methods include Conditional Random Fields, various Bidirectional LSTM configurations, and BERT models. Each of these models brings different strengths and capabilities to the task of entity recognition, allowing for a comprehensive evaluation and the selection of the best models over the dataset. Among these, the NER model based on Contracts–BERT–base from the Legal–BERT family, which is pre-trained specifically on English contracts, outperformed all others, achieving an impressive overall F1 score of 0.94. [ABSTRACT FROM AUTHOR]

With the advancement of source-load interaction in the new power systems, data-driven approaches have provided a foundational support for aggregating and interacting between sources and loads. However, with the widespread integration of distributed energy resources, fine-grained perception of intelligent sensing devices, and the inherent stochasticity of source-load dynamics, a massive amount of raw data is being recorded and accumulated in the data center. Valuable information is often dispersed across different paragraphs of the raw data, making it challenging to extract effectively. Distribution substation inspection plays a crucial role in ensuring the safe operation of the power system. Traditional methods for inspection report text classification typically rely on manual judgment and accumulated experience, resulting in low efficiency and a significant misjudgment rate. Therefore, this paper proposes a text classification method for inspection reports based on the pre-trained BERT-TextRCNN model. By utilizing the dense connection between the BERT embedding layer and the neural network, the proposed method improves the accuracy of matching long texts. This article collected 2,831 maintenance data for the first quarter of 2023 from the distribution room, including approximately 58 environmental testing data, 738 environmental box testing data, approximately 672 distribution room testing data, and approximately 1,363 box type substation testing data. A text corpus was constructed for experiments. Experimental results demonstrate that the proposed model automatically classifies a large volume of manually recorded inspection report data based on time, location, and faults, achieving a classification accuracy of 94.7%, precision of 92%, recall of 92%, and F1 score of 90.3%. [ABSTRACT FROM AUTHOR]

Project-based Learning (PBL) provides an effective environment for collaborative engineering design education. However, it is difficult to assess students' engagement and provide process-oriented feedback on their collaboration due to limited resources and scalability challenges. This paper presents an empirical study examining the application of Machine Learning (ML) to evaluate student engagement in PBL. A supervised ML model (SML) was developed using Natural Language Processing (NLP) to predict engagement levels using conversation data in online chat groups and comparing them to the ground truth metrics. Eleven teams of engineering students participated in the PBL courses on systems engineering while employing text-based discussions. Communication messages were manually labelled for active engagement metrics collected in our prior research. The SML was constructed with Gradient Boosting to classify engagement levels. The model was trained using more than 5,000 manually classified text messages, and it demonstrated an accuracy range of 0.75 to 0.81 on held-out test data. The model's predictions for complete team communication showed a meaningful association with the actual levels of engagement as determined by log data and surveys. Moreover, the model reproduces general patterns of team engagement and collaboration. According to the findings, conversational data can be a scalable source for ML-driven engagement assessment. This shows how AI has the potential to scale up process-oriented assessment in PBL. Future research should look towards instructor-AI dashboards and individualized feedback systems. The work adds an empirical evaluation of AI for automated engagement analysis, extending earlier research on feedback systems to tackle PBL issues. [ABSTRACT FROM AUTHOR]

Utilizing deep learning for data mining in biomedicine often falls short in leveraging prior knowledge and adapting to the complexities of biomedical literature mining. Entity recognition, a fundamental task in information extraction, also provides data support for Natural Language Processing (NLP) downstream tasks. Bovine Viral Diarrhea Virus (BVDV) results in considerable economic losses in the cattle industry due to calf diarrhea, bovine respiratory syndrome, and cow abortion. This study aims to extract information on BVDV from relevant literature and build a knowledge base. It enhances feature extraction in the BioBERT pre-trained model using the Machine Reading Comprehension (MRC) framework for information fusion and bi-directionally extracts corpus information through the Bi-LSTM network, followed by a CRF layer for decoding and prediction. The results show the construction of a BVDV Corpus with 22 biomedical entities and introduce the BioBERT-Bi-LSTM-CRF Integrated with MRC (BBCM) model for Named Entity Recognition (NER), combining prior knowledge and the reading comprehension framework (MRC). The BBCM model achieves F 1 -scores of 78.79% and 76.3% on the public datasets JNLPBA and GENIA, respectively, and 67.52% on the BVDV Corpus, outperforming other models. This research presents a targeted NER method for BVDV, effectively identifying related entities and exploring their relationships, thus providing valuable data support for NLP's downstream tasks. [ABSTRACT FROM AUTHOR]

Deep learning models have overcome traditional machine learning techniques for text classification domains in the field of natural language processing (NLP). Since, NLP is a branch of machine learning, used for interpreting language, classifying text of interest, and the same can be applied to analyse the medical clinical electronic health records. Medical text consists of lot of rich data which can altogether provide a good insight, by determining patterns from the clinical text data. In this paper, bidirectional‐long short‐term memory (Bi‐LSTM), bi‐LSTM attention and bidirectional encoder representations from transformers (BERT) base models are used to classify the text which are of privacy concern to a person and which should be extracted and can be tagged as sensitive. This text data which we might think not of privacy concern would majorly reveal a lot about the patient's integrity and personal life. Clinical data not only have patient demographic data but lot of hidden data which might go unseen and thus could arise privacy issues. Bi‐LSTM with attention layer is also added on top to realize the importance of critical words which will be of great importance in terms of classification, we are able to achieve accuracy of about 92%. About 206,926 sentences are used out of which 80% are used for training and rest for testing we get accuracy of 90% approx. with Bi‐LSTM alone. The same set of datasets is used for BERT model with accuracy of 93% approx. [ABSTRACT FROM AUTHOR]

With the widespread adoption of next-generation sequencing technologies, the speed and convenience of genome sequencing have significantly improved, and many biological genomes have been sequenced. However, during the assembly of small genomes, we still face a series of challenges, including repetitive fragments, inverted repeats, low sequencing coverage, and the limitations of sequencing technologies. These challenges lead to unknown gaps in small genomes, hindering complete genome assembly. Although there are many existing assembly software options, they do not fully utilize the potential of artificial intelligence technologies, resulting in limited improvement in gap filling. Here, we propose a novel method, DLGapCloser, based on deep learning, aimed at assisting traditional tools in further filling gaps in small genomes. Firstly, we created four datasets based on the original genomes of Saccharomyces cerevisiae, Schizosaccharomyces pombe, Neurospora crassa, and Micromonas pusilla. To further extract effective information from the gene sequences, we also added homologous genomes to enrich the datasets. Secondly, we proposed the DGCNet model, which effectively extracts features and learns context from sequences flanking gaps. Addressing issues with early pruning and high memory usage in the Beam Search algorithm, we developed a new prediction algorithm, Wave-Beam Search. This algorithm alternates between expansion and contraction phases, enhancing efficiency and accuracy. Experimental results showed that the Wave-Beam Search algorithm improved the gap-filling performance of assembly tools by 7.35%, 28.57%, 42.85%, and 8.33% on the original results. Finally, we established new gap-filling standards and created and implemented a novel evaluation method. Validation on the genomes of Saccharomyces cerevisiae, Schizosaccharomyces pombe, Neurospora crassa, and Micromonas pusilla showed that DLGapCloser increased the number of filled gaps by 8.05%, 15.3%, 1.4%, and 7% compared to traditional assembly tools. [ABSTRACT FROM AUTHOR]

Aim: This study examines the intricate language and communication patterns of nurse‐to‐nurse handoffs across three units with varying patient acuity levels and nurse–patient ratios, seeking to identify linguistic factors that may affect the quality of information transfer and patient outcomes. Design: A mixed‐methods cross‐sectional design. Methods: This study used the Nurse‐to‐Nurse Transition of Care Communication Model to explore the content and meaning of language in nursing handoffs within a large academic medical centre. Data were collected on three units through digital audio recordings of 20 handoffs between June and September 2022, which were transcribed and analysed using the Linguistic Inquiry Word Count programme. Trustworthiness was established by adhering to COREQ and STROBE guidelines for qualitative and quantitative research, respectively. Results: Analysis revealed a preference for casual, narrative language across all units, with ICU nurses demonstrating a higher confidence and leadership in communication. Cognitive processes such as insight and causation were found to be underrepresented, indicating a potential area for miscommunication. Communication motives driven by affiliation were more pronounced in ICU settings, suggesting a strong collaborative nature. No significant differences were observed among the units post multiple testing adjustments. Speech dysfluencies were most pronounced in ICU handoffs, reflecting possible stress and cognitive overload. Conclusion: The study highlights the need for improved communication strategies such as interventions to enhance language clarity and incorporating technological tools into handoff processes to mitigate potential miscommunications and errors. The findings advance nursing science by highlighting the critical role of nuanced language in varied‐acuity hospital settings and the necessity for structured nurse education in handoff communication and standardized handoff procedures. Implications for the profession and patient care: This study underscores the critical role of language in nurse‐to‐nurse handoffs. It calls for enhanced communication strategies, technology integration and training to reduce medical errors, improving patient outcomes in high‐acuity hospital settings. Patient or Public Contribution: Nurses only. [ABSTRACT FROM AUTHOR]

In the continuously changing labor market, understanding the dynamics of online job postings is crucial for economic and workforce development. With the increasing reliance on Online Job Portals, analyzing online job postings has become an essential tool for capturing real-time labor-market trends. This paper presents a comprehensive methodology for processing online job postings to generate labor-market intelligence. The proposed methodology encompasses data source selection, data extraction, cleansing, normalization, and deduplication procedures. The final step involves information extraction based on employer industry, occupation, workplace, skills, and required experience. We address the key challenges that emerge at each step and discuss how they can be resolved. Our methodology is applied to two use cases: the first focuses on the analysis of the Greek labor market in the tourism industry during the COVID-19 pandemic, revealing shifts in job demands, skill requirements, and employment types. In the second use case, a data-driven ontology is employed to extract skills from job postings using machine learning. The findings highlight that the proposed methodology, utilizing NLP and machine-learning techniques instead of LLMs, can be applied to different labor market-analysis use cases and offer valuable insights for businesses, job seekers, and policymakers. [ABSTRACT FROM AUTHOR]

Part-of-Speech (POS) tagging is one of the popular Natural Language Processing (NLP) tasks. It is also considered to be a preliminary task for other NLP applications such as speech recognition, machine translation, and sentiment analysis. A few works have been published on POS tagging for the Tamil language. However, the performance of the POS tagger with unknown words is not explored in the literature. The appearance of unknown words is a frequently occurring problem in POS tagging and makes it a challenging task. In this paper, we propose a deep learning-based POS tagger for Tamil using Bi-directional Long Short Term Memory (BLSTM). The performance of the POS tagger was evaluated using known and unknown words. The POS tagger with regular word-level embeddings produces 99.83 and 92.46% accuracies for all known and 63.21% unknown words. It clearly shows that the accuracy decreases when the number of unknown words increases. To improve the performance of the POS tagger with unknown words, the proposed BLSTM model that uses word-level, character-level and pre-trained word embeddings. Test results of this model show a 2.57% improvement for 63.21% of unknown words, with an accuracy of 95.03%. [ABSTRACT FROM AUTHOR]

This paper demonstrates an automated workflow for extracting network data from policy documents. We use natural language processing tools, part‐of‐speech tagging, and syntactic dependency parsing, to represent relationships between real‐world entities based on how they are described in text. Using a corpus of regional groundwater management plans, we demonstrate unique graph motifs created through parsing syntactic relationships and how document‐level syntax can be aggregated to develop large‐scale graphs. This approach complements and extends existing methods in public management and governance research by (1) expanding the feasible geographic and temporal scope of data collection and (2) allowing for customized representations of governance systems to fit different research applications, particularly by creating graphs with many different node and edge types. We conclude by reflecting on the challenges, limitations, and future directions of automated, text‐based methods for governance research. [ABSTRACT FROM AUTHOR]

Financial news is one of the most influential sources for making long-term investment decisions. The goal of this paper is to learn whether it is possible, based on texts from news headlines, to select stocks with low forecasted volatility which outrun the market represented by the Standard and Poor's 500 Index. We solve several binary classification problems using a range of machine learning and deep learning principles. The best classifiers are interpreted with a model-agnostic technique, LIME, to extract key words having the greatest impact on the probabilities of market outrun and low volatility. [ABSTRACT FROM AUTHOR]

Over the past decade, there has been a renewed interest in Artificial Intelligence and its diverse frameworks. This research proposed a big data recommendation system that leverages two prominent deep learning frameworks which are PyTorch and TensorFlow to enhance collaborative filtering (CF) outcomes. The goal is to recommend more relevant products to users by incorporating textual review comments and combining various attributes. The study explores two recommendation system approaches within each framework. In the PyTorch framework, two collaborative filtering models were developed: one without incorporating user review text and the other with the inclusion of text from user reviews. Similarly, for the TensorFlow framework, two recommendation models were created: one without utilizing user review text, and the other with the integration of text reviews. The dataset, sourced from the Amazon website, comprised over 600,000 ratings and reviews. The outcomes showed significant enhancements by employing the proposed text-based method in both PyTorch and TensorFlow frameworks and addressed challenges such as dynamic preferences and data sparsity. Finally, the study provides a comparative analysis of the advantages and drawbacks of each utilized framework. [ABSTRACT FROM AUTHOR]

Nowadays, most health professionals use electronic health records to keep track of patients. To properly use and share these data, the community has relied on medical classification standards to represent patient information. However, the coding process is tedious and time-consuming, often limiting its application. This paper proposes a novel feature representation method that considers the distinction between diagnoses and procedure codes, and applies this to the task of medical procedure code prediction. Diagnosis codes are combined with text annotations, and the result is then used as input to a downstream procedure code prediction task. Various diagnosis code representations are considered by exploiting a code hierarchy. Furthermore, different text representation strategies are also used, including embeddings from language models. Finally, the method was evaluated using the MIMIC-III database. Our experiments showed improved performance in procedure code prediction when exploiting the diagnosis codes, outperforming state-of-the-art models. [ABSTRACT FROM AUTHOR]

The global significance of SMEs has traditionally been recognized as a key driver of economic growth and sustainability. The emergence of digital technologies and Information and Communication Technology for Development (ICT4D) holds significant potential to further enhance this impact. However, SMEs in developing countries have faced challenges in adopting sustainable, resource-intensive digital systems. Factors such as limited skills, financial constraints, and the alignment of suitable solutions hinder this adoption. To address these challenges and promote sustainable digital transformation, this study proposes a two-tier approach. The first prong employs Natural Language Processing (NLP) techniques, including Word2Vec, for global analysis and digital systems identification. The second prong involves a country-specific analysis of SMEs' digital requirements. This two-tier analysis aims to uncover the actual digital needs of SMEs while shedding light on high-intensity global SME activities that, if integrated through ICT4D, could effectively address the risks and challenges SMEs face in adopting, implementing, and maintaining digital systems. In addition, the study develops systems required by SMEs to optimize their business processes and production, thereby promoting their growth and sustainability in the digital era. The results of this study demonstrate the effectiveness of these proposed methods in addressing digital challenges for SMEs and fostering sustainable development. [ABSTRACT FROM AUTHOR]

Predicting hotel ratings from reviews involves natural language processing techniques to extract sentiment and features from text data, then applying machine learning (ML) models like regression or classification to estimate the corresponding rating based on these features. This study proposes an ensemble learning approach for predicting hotel ratings from user reviews. By integrating multiple ML algorithms trained on various textual features, including linguistic, semantic, and sentiment-based attributes, our model achieves superior predictive accuracy. The primary aim of this study is to predict user experience ratings with high accuracy. To achieve this, this research utilizes an Ensemble learning approach known as majority voting to make these predictions effectively. In this investigation, initially, the dataset undergoes cleaning and is subsequently subjected to a series of pre-processing steps using Natural Language Processing (NLP) techniques. The research includes a comparative analysis of various classifiers along with different embedding methods. Seven different types of classifiers are used alongside three embedding techniques i.e., Term Frequency-Inverse Document Frequency (TF-IDF), Bag of Words (BoW), and Word2Vec. The classifiers include, Logistic Regression without Cross Validation (LR), LR with Cross Validation (LRCV), Decision Tree Classifier (DTC), Stochastic Gradient Descent Classifier (SGDC), Random Forest Classifier (RFC), Support Vector Classifier (SVC) and K-Nearest Neighbour (KNN). Our proposed methodology demonstrates higher accuracy and robust performance. Accuracy and frequency are utilized as performance metrics for assessing and validating both classifiers and embedding techniques. As per the simulation results, TF-IDF in combination with LRCV achieves an accuracy rate of 61%. [ABSTRACT FROM AUTHOR]

The internet use among children and adolescents has increased massively recently. This situation has promoted harmful situations such as cyberbullying, which is becoming a worldwide problem that entails serious consequences for well-being. The detection of these attitudes is essential to prevent and act accordingly. Groundbreaking techniques based on deep learning, like pre-trained language models, have achieved state-of-the-art results in many downstream Natural Language Processing tasks. This paper presents a simple but effective approach to improve the detection of cyberbullying situations by fine-tuning a pre-trained sentence transformer language model. We experimented on three datasets, and the results surpassed the state-of-the-art results. The approach could help prevent cyberbullying, filter those messages, and detect those children involved in the situation, providing opportunities to develop intervention programs to address this problem. [ABSTRACT FROM AUTHOR]

Natural Language Processing has been extensively researched for languages with abundant resources like English and Spanish, but low-resource languages present unique challenges and opportunities. Consequently, the performance of learning algorithms for downstream tasks in low resource languages, such as the Indic languages Bhojpuri and Maithili, is unsatisfactory. To address these challenges, we collect a corpus of 20,000 sentences in both Bhojpuri and Maithili each and use them to develop word representations using popular the approaches such as Word2Vec, FastText, and GloVe. The evaluation of the word representation is accomplished through machine translation and text classification tasks. Among the various models used in the experiments, word2Vec with Bidirectional Encoder Representations from Transformers (BERT) outperforms GloVe and FastText in machine translation task, achieving a BiLingual Evaluation Understudy score of 32.95 for Bhojpuri to English and 28.95 for Maithili to English. Additionally, the BERT model provides a good text classification accuracy of 71.23% for Bhojpuri and 66.91% for Maithili. This work may serve as a reasonable beginning point for further research in low-resource Indic languages. [ABSTRACT FROM AUTHOR]

Large Language Models (LLM) continue to demonstrate their utility in a variety of emergent capabilities in different fields. An area that could benefit from effective language understanding in cybersecurity is the analysis of log files. This work explores LLMs with different architectures (BERT, RoBERTa, DistilRoBERTa, GPT-2, and GPT-Neo) that are benchmarked for their capacity to better analyze application and system log files for security. Specifically, 60 fine-tuned language models for log analysis are deployed and benchmarked. The resulting models demonstrate that they can be used to perform log analysis effectively with fine-tuning being particularly important for appropriate domain adaptation to specific log types. The best-performing fine-tuned sequence classification model (DistilRoBERTa) outperforms the current state-of-the-art; with an average F1-Score of 0.998 across six datasets from both web application and system log sources. To achieve this, we propose and implement a new experimentation pipeline (LLM4Sec) which leverages LLMs for log analysis experimentation, evaluation, and analysis. [ABSTRACT FROM AUTHOR]

Social networks have modernized the way people communicate, share information, and consume content. The widespread use of social media platforms has resulted in the creation of vast amounts of user-generated content, which can be analyzed to gain valuable insights into customer behaviour, emotions, preferences, and trends. Previous studies on online customer engagement have mainly focused on brand perspective and its socially significant elements, such as brand personality, image, reputation, and loyalty. These studies have explored how these elements influence the behavioural engagement of customers, such as their purchase intentions, word-of-mouth recommendations, and repeat purchases. However, more recent research has started to shift towards a more customer-centric perspective, which acknowledges that customer engagement is a two-way process, involving both the brand and the customer. This approach considers the role of customer experiences, emotions, topics of interest, and motivations in shaping their social engagement with the brand. This paper contributes to these endeavours by developing a consolidated framework that incorporates various facets of the customer's emotional and behavioural social content. In particular, features of online customers have been extracted using various sophisticated modules that incorporate natural language inference, topic modelling, sentiment analysis, emotion detection, and the Big-Five Personality Traits. Further, a heuristic-based feature selection (FS) strategy, Dual Annealing Optimisation (DAO), is integrated with Light Gradient Boosting Machine (LGBM) to furnish a consolidated machine learning module (DAO-LGBM) that is implemented and examined to detect advocates in online customer engagement. A thorough examination of a proposed model and its utility for detecting advocates using rigorous evaluation metrics is undertaken, reported, and discussed. These findings have substantial implications for both academic research and practical applications in social media analytics. [ABSTRACT FROM AUTHOR]

Current AI detection systems often struggle to distinguish between Arabic human-written text (HWT) and AI-generated text (AIGT) due to the small marks present above and below the Arabic text called diacritics. This study introduces robust Arabic text detection models using Transformer-based pre-trained models, specifically AraELECTRA, AraBERT, XLM-R, and mBERT. Our primary goal is to detect AIGTs in essays and overcome the challenges posed by the diacritics that usually appear in Arabic religious texts. We created several novel datasets with diacritized and non-diacritized texts comprising up to 9666 HWT and AIGT training examples. We aimed to assess the robustness and effectiveness of the detection models on out-of-domain (OOD) datasets to assess their generalizability. Our detection models trained on diacritized examples achieved up to 98.4% accuracy compared to GPTZero's 62.7% on the AIRABIC benchmark dataset. Our experiments reveal that, while including diacritics in training enhances the recognition of the diacritized HWTs, duplicating examples with and without diacritics is inefficient despite the high accuracy achieved. Applying a dediacritization filter during evaluation significantly improved model performance, achieving optimal performance compared to both GPTZero and the detection models trained on diacritized examples but evaluated without dediacritization. Although our focus was on Arabic due to its writing challenges, our detector architecture is adaptable to any language. [ABSTRACT FROM AUTHOR]

Named Entity Recognition (NER) is a fundamental task that aids in the completion of other tasks such as text understanding, information retrieval and question answering in Natural Language Processing (NLP). In recent years, the use of a mix of character-word structure and dictionary information for Chinese NER has been demonstrated to be effective. As a representative of hybrid models, Lattice-LSTM has obtained better benchmarking results in several publicly available Chinese NER datasets. However, Lattice-LSTM does not address the issue of long-distance entities or the detection of several entities with the same character. At the same time, the ambiguity of entity boundary information also leads to a decrease in the accuracy of embedding NER. This paper proposes ELCA: Enhanced Boundary Location for Chinese Named Entity Recognition Via Contextual Association, a method that solves the problem of long-distance dependent entities by using sentence-level position information. At the same time, it uses adaptive word convolution to overcome the problem of several entities sharing the same character. ELCA achieves the state-of-the-art outcomes in Chinese Word Segmentation and Chinese NER. [ABSTRACT FROM AUTHOR]

This research develops a classification model for Arabic news tweets using Bidirectional Long Short-Term Memory networks (BiLSTM). Tweets about Arabic news were gathered between August 2016 and August 2020 and divided into five categories. Custom Python scripts, Twitter API and the GetOldTweets3 Python library were used to collect the data. BiLSTM was used to train and test the model. The results indicated an average accuracy, precision, recall, and f1-score of 0.88, 0.92, 0.88, and 0.89, respectively. The results could have practical implications for Arabic machine learning and NLP tasks in research and practice. [ABSTRACT FROM AUTHOR]

This research paper deals with self-confidence and how the application of Neuro-Linguistic Programming (NLP) technique, six-step reframing, plays a crucial role in students' self-confidence in the English as a foreign language (EFL) classroom. It analyses the effectiveness of incorporating NLP six-step reframing on students' self-confidence levels across different age groups, cultural backgrounds, and academic settings. This provides an opportunity for learners to gain self-confidence, helping them to truly believe in themselves, and allowing them to feel 'seen, heard, and understood'. Reframing, drawing from Neuro-Linguistic Programming (NLP), enables learners to see mistakes as an integral parts of learning process and also helps to refine their skills which are crucial for language acquisition. The research includes sixty-six students who differ based on criteria such as age, cultural backgrounds, and learning experience. Quantitative methods through questionnaires and qualitative methods, through observation and interviews, have been helpful in conducting this research paper. The results have shown a significant effect of incorporating NLP's six-step reframing within the pedagogical framework, shedding light on its potential to empower students' self-confidence challenges commonly encountered in language learning environments. The study has shown that, even students encounter difficulties or setbacks in language learning, the incorporation of six-step reframing technique has proven to be a transformative approach. By systematically identifying dissatisfaction, establishing clear signals, alternative behaviors, eliciting positive intentions, and encouraging students' self-confidence in learning a foreign language. This psychological tool not only contributes to language proficiency but also empowers students to navigate the complexities of the EFL classroom with confidence and adaptability. [ABSTRACT FROM AUTHOR]

With the rapid growth of internet usage, a new situation has been created that enables practicing bullying. Cyberbullying has increased over the past decade, and it has the same adverse effects as face-to-face bullying, like anger, sadness, anxiety, and fear. With the anonymity people get on the internet, they tend to be more aggressive and express their emotions freely without considering the effects, which can be a reason for the increase in cyberbullying and it is the main motive behind the current study. This study presents a thorough background of cyberbullying and the techniques used to collect, preprocess, and analyze the datasets. Moreover, a comprehensive review of the literature has been conducted to figure out research gaps and effective techniques and practices in cyberbullying detection in various languages, and it was deduced that there is significant room for improvement in the Arabic language. As a result, the current study focuses on the investigation of shortlisted machine learning algorithms in natural language processing (NLP) for the classification of Arabic datasets duly collected from Twitter (also known as X). In this regard, support vector machine (SVM), Naïve Bayes (NB), Random Forest (RF), Logistic regression (LR), Bootstrap aggregating (Bagging), Gradient Boosting (GBoost), Light Gradient Boosting Machine (LightGBM), Adaptive Boosting (AdaBoost), and eXtreme Gradient Boosting (XGBoost) were shortlisted and investigated due to their effectiveness in the similar problems. Finally, the scheme was evaluated by well-known performance measures like accuracy, precision, Recall, and F1-score. Consequently, XGBoost exhibited the best performance with 89.95% accuracy, which is promising compared to the state-of-the-art. [ABSTRACT FROM AUTHOR]

Copyright of Cuaderno de Pedagogia Universitaria is the property of Pontificia Universidad Catolica Madre y Maestra and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

The fundamental method for pre-processing speech or text data that enables computers to comprehend human language is known as natural language processing. Numerous models have been developed to date to pre-process data in the English language; however, the Hindi language does not support these models. India's national tongue is Hindi. In order to help the locals, the authors of this study used supervised learning methods like Linear Regression, SVM, and Naive Bayes algorithm to investigate a dataset of complicated terms in the Hindi language. Additionally, a sophisticated Hindi word classification model is suggested employing several methods based on the forecasts as well as collective learning strategies like Random Forest, Adaboost, and Decision Tree. Depending on how well the user's language is understood, the suggested model will assist in simplifying Hindi text. Authors attempt to classify the uncharted dataset using deep learning algorithms like Bi-LSTM and GRU approaches in further processing. [ABSTRACT FROM AUTHOR]

This study proposes an 'implicit measure' of disagreement to investigate presence of any latent discord in the policy briefings of central banks across nations. We analyse Monetary policy statements of the Bank of Japan (Japan), Banco Central do Brasil (Brazil) and Central Bank of the Republic of Turkey (Türkiye) on both specific as well as overall economic outlook by using novel text mining tools. Subsequently, we explore the relationship of the proposed measure of implicit disagreement with the accuracy of growth and inflation forecasts. Our findings confirm that disagreement/discord among policymakers over varied economic aspects provides signals to forecasters and helps in aligning their forecasts better. The results of this study indicate that disagreement too can be considered as a plausible criterion that can explain the forecaster's belief thereby playing a positive role in 'forecaster learning'. [ABSTRACT FROM AUTHOR]

Attention to mental health is increasing in Indonesia, especially with the recent increase in the number of cases of stress and suicide among students. Therefore, this research aims to provide a solution to overcome mental health problems by introducing a chatbot system based on Deep Neural Networks (DNN) and BiDirectional Encoder Representation Transformers (BERT). The primary objective is to enhance accessibility and offer a more effective solution concerning the mental health of students. This chatbot utilizes Natural Language Processing (NLP) and Deep Learning to provide appropriate responses to mild mental health issues. The dataset, comprising objectives, tags, patterns, and responses, underwent processing using Indonesian language rules within NLP. Subsequently, the system was trained and tested using the DNN model for classification, integrated with the TokenSimilarity model to identify word similarities. Experimental results indicate that the DNN model yielded the best outcomes, with a training accuracy of 98.97%, validation accuracy of 71.74%, and testing accuracy of 71.73%. Integration with the TokenSimilarity model enhanced the responses provided by the chatbot. TokenSimilarity searches for input similarities from users within the knowledge generated from the training data. If the similarity is high, the input is then processed by the DNN model to provide the chatbot response. This integration of both models has proven to enhance the responsiveness of the chatbot in providing various responses even when the user inputs remain the same. The chatbot also demonstrates the capability to recognize various inputs more effectively with similar intentions or purposes. Additionally, the chatbot exhibits the ability to comprehend user inputs although there are many writing errors.

This research paper deals with self-confidence and how the application of Neuro-Linguistic Programming (NLP) technique, six-step reframing, plays a crucial role in students’ self-confidence in the English as a foreign language (EFL) classroom. It analyses the effectiveness of incorporating NLP six-step reframing on students’ self-confidence levels across different age groups, cultural backgrounds, and academic settings. This provides an opportunity for learners to gain self-confidence, helping them to truly believe in themselves, and allowing them to feel ‘seen, heard, and understood’. Reframing, drawing from Neuro-Linguistic Programming (NLP), enables learners to see mistakes as an integral parts of learning process and also helps to refine their skills which are crucial for language acquisition. The research includes sixty-six students who differ based on criteria such as age, cultural backgrounds, and learning experience. Quantitative methods through questionnaires and qualitative methods, through observation and interviews, have been helpful in conducting this research paper. The results have shown a significant effect of incorporating NLP’s six-step reframing within the pedagogical framework, shedding light on its potential to empower students’ self-confidence challenges commonly encountered in language learning environments. The study has shown that, even students encounter difficulties or setbacks in language learning, the incorporation of six-step reframing technique has proven to be a transformative approach. By systematically identifying dissatisfaction, establishing clear signals, alternative behaviors, eliciting positive intentions, and encouraging students’ self-confidence in learning a foreign language. This psychological tool not only contributes to language proficiency but also empowers students to navigate the complexities of the EFL classroom with confidence and adaptability.

Deep learning (DL) has substantially enhanced natural language processing (NLP) in healthcare research. However, the increasing complexity of DL-based NLP necessitates transparent model interpretability, or at least explainability, for reliable decision-making. This work presents a thorough scoping review of explainable and interpretable DL in healthcare NLP. The term “eXplainable and Interpretable Artificial Intelligence” (XIAI) is introduced to distinguish XAI from IAI. Different models are further categorized based on their functionality (model-, input-, output-based) and scope (local, global). Our analysis shows that attention mechanisms are the most prevalent emerging IAI technique. The use of IAI is growing, distinguishing it from XAI. The major challenges identified are that most XIAI does not explore “global” modelling processes, the lack of best practices, and the lack of systematic evaluation and benchmarks. One important opportunity is to use attention mechanisms to enhance multi-modal XIAI for personalized medicine. Additionally, combining DL with causal logic holds promise. Our discussion encourages the integration of XIAI in Large Language Models (LLMs) and domain-specific smaller models. In conclusion, XIAI adoption in healthcare requires dedicated in-house expertise. Collaboration with domain experts, end-users, and policymakers can lead to ready-to-use XIAI methods across NLP and medical tasks. While challenges exist, XIAI techniques offer a valuable foundation for interpretable NLP algorithms in healthcare.