Search

With the emerging new technologies based on Artificial Intelligence (AI) for the generation of new and paraphrasing of existing text, the identification of genuinely written text has become an important research undertaking. Past approaches to address this issue, need a significant volume of human-labeled data. Most of the approaches used in literature are either for noisy text or for clean text. Conversations in chats, text in blogs, text messages on cell phones, text exchange on Messengers, etc., are examples of noisy text that may contain misspelled words or incomplete words. The second approach focuses on clean text, which is free from the mentioned characteristics in the noisy text. As research articles do not contain noisy data, we propose a model that focuses on clean text for the identification of paraphrases in research articles. To address the problem of paraphrase detection, this work presents a novel Bidirectional Encoder Representation from Transformers (BERT) based model with fine-tuning. For word representation, Global Vectors (Glove) embeddings and contextualized Embeddings From Language Models (ELMo) are employed in this work. Initially, the model is evaluated without performing preprocessing. Later, the preprocessing step is performed before evaluating the model. Extensive experimentations are performed to evaluate the proposed model utilizing two benchmark datasets, namely, Microsoft Research Paraphrase (MSRP) and Quora Question Pairs (Quora). A comparison of the proposed model is done with four closely related state-of-the-art works. The obtained results show that Fine-tuned BERT using ELMo embeddings with preprocessing produces promising outcomes. Paraphrase identification rates achieved on MSRP and Quora datasets are 86.51% and 94.32%, respectively, which are better than the other competing methods. The proposed solution enables the identification of paraphrased text with a higher accuracy having its application in multiple domains requiring genuinely written documents. [ABSTRACT FROM AUTHOR]

Recognizing emotions in textual data is crucial in a wide range of natural language processing (NLP) applications, from consumer sentiment research to mental health evaluation. The word embedding techniques play a pivotal role in text processing. In this paper, the performance of several well-known word embedding methods is evaluated in the context of emotion recognition. The classification of emotions is further enhanced using a convolutional neural network (CNN) model because of its propensity to capture local patterns and its recent triumphs in text-related tasks. The integration of CNN with word embedding techniques introduced an additional layer to the landscape of emotion detection from text. The synergy between word embedding techniques and CNN harnesses the strengths of both approaches. CNNs extract local patterns and features from sequential data, making them well-suited for capturing relevant information within the embeddings. The results obtained with various embeddings highlight the significance of choosing synergistic combinations for optimum performance. The combination of CNNs and word embeddings proved a versatile and effective approach. [ABSTRACT FROM AUTHOR]

Analysis of the impact of the contextual embeddings usage on the text classification accuracy

Sentiment analysis (SA) involves utilizing natural language processing (NLP) methods to identify the sentiment conveyed by a given text. This study is grounded on the dataset sourced from the internet movie database (IMDB), encompassing evaluations of films and their corresponding positive or negative classifications. Our research experiment aims to ascertain the model with the highest accuracy and generality. Our research utilizes diverse classifiers, comprising unsupervised learning approaches such as Valence Aware Dictionary and sEntiment Reasoner (VADER) and Text Blob, alongside Supervised Learning methods like Naïve Bayes, which encompasses both the Bernoulli NB and Multinomial NB. Several methodologies have been utilized, including the Count Vectorizer, and the Term Frequency-Inverse Document Frequency model (TFIDF) Vectorizer. Subsequently, word embedding and bidirectional LSTM are executed, utilizing various embeddings such as the Long Short-Term Memory (LSTM) base model. Finally, GloVe embeddings achieve the best performance with an accuracy of 90.64% and a sensitivity of 91.07%.

Abstract Sentiment analysis aims to classify text based on the opinion or mentality expressed in a situation, which can be positive, negative, or neutral. Therefore, in the world, a lot of opinions are available on various social media sites, which must be gathered and analyzed to assess the general public’s opinion. Finding and monitoring comments, as well as manually extracting the information contained in them, is a difficult task due to the vast diversity of ideas on YouTube. Identifying public opinion on war topics is crucial for offering insights to opposing sides based on popular opinion and emotions about the ongoing war. To address the gap, we build a model on YouTube comment sentiment analysis of the Hamas-Israel war to determine public opinion. In this study, we address the gaps by developing a deep learning-based approach for sentiment analysis. We have collected 24,360 comments from popular YouTube News Channels including BBC, WION, Aljazeera, and others about the Hamas-Israel War using YouTube API and Google spreadsheet and labeled them by linguistic experts into three classes: positive, negative, and neutral. Then, textual comments were preprocessed using natural language processing (NLP) techniques, and features were extracted using Word2vec, FastText, and GloVe. Moreover, we have used the SMOTE data balancing technique and used different data splits, but the 80/20 train-test split ratio has the highest accuracy. For classification model building, commonly used classification algorithms LSTM, Bi-LSTM, GRU, and Hybrid of CNN and Bi-LSTM were applied, and their performance is compared. As a result, the Hybrid of CNN and Bi-LSTM with Word2vec achieved the highest performance with 95.73% accuracy for comments classifications.

In recent years, cloud computing applications have facilitated the distribution of heterogeneous, unstructured digitized data among users' social networks of varying opinions. Text processing at a large scale requires high-precision computational techniques, which increases the computational burden. The advent of big data analytics along with Natural Language Processing is a powerful factor in improving the efficiency of processing large-scale text data, using the kernel of the MapReduce big data analytics frameworks that allow parallelization of large computational operations. In this paper, we propose an intelligent sentiment prediction approach based on deep learning, batch, and streaming big data analytics. In fact, our main objective is to take advantages of the powerful tools provided by the distributed platforms, such as, Hadoop and Spark to preprocess streaming data. This involves various tasks such as cleaning the data, reducing its size, minimizing access time, and decreasing storage volume. This step prepares the big streaming data to be fully exploited by Deep Learning models. This work includes a research study on processing big data related to short volume scripts based on batch and streaming distributed frameworks as well as deep learning approaches in Natural Language Processing. We detail our idea for analyzing short texts to determine their semantic context and categorize them into pros and cons poles. There were different stages in building this model, the first involving data reduction and refinement using selected features and big data analysis tools. In the second stage, words are embedded by global vector to be computed in layers of convolutional and recurrent neural networks. The experimental study and the analysis of the results confirm the usefulness of our proposed model and its superiority over the main approaches studied in the literature. Our model achieved a performance of 96% in terms of accuracy. [ABSTRACT FROM AUTHOR]

Sentiment analysis (SA) involves utilizing natural language processing (NLP) methods to identify the sentiment conveyed by a given text. This study is grounded on the dataset sourced from the internet movie database (IMDB), encompassing evaluations of films and their corresponding positive or negative classifications. Our research experiment aims to ascertain the model with the highest accuracy and generality. Our research utilizes diverse classifiers, comprising unsupervised learning approaches such as Valence Aware Dictionary and sEntiment Reasoner (VADER) and Text Blob, alongside Supervised Learning methods like Naïve Bayes, which encompasses both the Bernoulli NB and Multinomial NB. Several methodologies have been utilized, including the Count Vectorizer, and the Term Frequency-Inverse Document Frequency model (TFIDF) Vectorizer. Subsequently, word embedding and bidirectional LSTM are executed, utilizing various embeddings such as the Long Short-Term Memory (LSTM) base model. Finally, GloVe embeddings achieve the best performance with an accuracy of 90.64% and a sensitivity of 91.07%. [ABSTRACT FROM AUTHOR]

Sentiment analysis aims to classify text based on the opinion or mentality expressed in a situation, which can be positive, negative, or neutral. Therefore, in the world, a lot of opinions are available on various social media sites, which must be gathered and analyzed to assess the general public’s opinion. Finding and monitoring comments, as well as manually extracting the information contained in them, is a difficult task due to the vast diversity of ideas on YouTube. Identifying public opinion on war topics is crucial for offering insights to opposing sides based on popular opinion and emotions about the ongoing war. To address the gap, we build a model on YouTube comment sentiment analysis of the Hamas-Israel war to determine public opinion. In this study, we address the gaps by developing a deep learning-based approach for sentiment analysis. We have collected 24,360 comments from popular YouTube News Channels including BBC, WION, Aljazeera, and others about the Hamas-Israel War using YouTube API and Google spreadsheet and labeled them by linguistic experts into three classes: positive, negative, and neutral. Then, textual comments were preprocessed using natural language processing (NLP) techniques, and features were extracted using Word2vec, FastText, and GloVe. Moreover, we have used the SMOTE data balancing technique and used different data splits, but the 80/20 train-test split ratio has the highest accuracy. For classification model building, commonly used classification algorithms LSTM, Bi-LSTM, GRU, and Hybrid of CNN and Bi-LSTM were applied, and their performance is compared. As a result, the Hybrid of CNN and Bi-LSTM with Word2vec achieved the highest performance with 95.73% accuracy for comments classifications. [ABSTRACT FROM AUTHOR]

Abstract Online platforms and social networking have increased in the contemporary years. They are now a major news source worldwide, leading to the online proliferation of Fake News (FNs). These FNs are alarming because they fundamentally reshape public opinion, which may cause customers to leave these online platforms, threatening the reputations of several organizations and industries. This rapid dissemination of FNs makes it imperative for automated systems to detect them, encouraging many researchers to propose various systems to classify news articles and detect FNs automatically. In this paper, a Fake News Detection (FND) methodology is presented based on an effective IBAVO-AO algorithm, which stands for hybridization of African Vultures Optimization (AVO) and Aquila Optimization (AO) algorithms, with an extreme gradient boosting Tree (Xgb-Tree) classifier. The suggested methodology involves three main phases: Initially, the unstructured FNs dataset is analyzed, and the essential features are extracted by tokenizing, encoding, and padding the input news words into a sequence of integers utilizing the GLOVE approach. Then, the extracted features are filtered using the effective Relief algorithm to select only the appropriate ones. Finally, the recovered features are used to classify the news items using the suggested IBAVO-AO algorithm based on the Xgb-Tree classifier. Hence, the suggested methodology is distinguished from prior models in that it performs automatic data pre-processing, optimization, and classification tasks. The proposed methodology is carried out on the ISOT-FNs dataset, containing more than 44 thousand multiple news articles divided into truthful and fake. We validated the proposed methodology’s reliability by examining numerous evaluation metrics involving accuracy, fitness values, the number of selected features, Kappa, Precision, Recall, F1-score, Specificity, Sensitivity, ROC_AUC, and MCC. Then, the proposed methodology is compared against the most common meta-heuristic optimization algorithms utilizing the ISOT-FNs. The experimental results reveal that the suggested methodology achieved optimal classification accuracy and F1-score and successfully categorized more than 92.5% of news articles compared to its peers. This study will assist researchers in expanding their understanding of meta-heuristic optimization algorithms applications for FND. Graphical Abstract

As more people express their thoughts on products on various online shopping platforms, the feelings expressed in these opinions are becoming a significant source of information for marketers and buyers. These opinions have a big impact on consumers' decision to buy the best quality product. When there are too many features or a small number of records to analyze, the decision-making process gets difficult. A recent stream of study has used the conventional quantitative star score ratings and textual content reviews in this context. In this research, a decision-making framework is proposed that relies on feature-based opinions to analyze the textual content of reviews and classify buyer's opinions, thereby assisting consumers in making long-term purchases. The framework is proposed in this paper for product purchase decision making based on feature-based opinions and deep learning. Framework consists of four components: i) Pre-processing, ii) Feature extraction, iii) Feature-based opinion classification, and iv) Decision-making. Web scraping is used to obtain the dataset of Smartphone reviews, which is subsequently clean and pre-processed using tokenization and POS tagging. From the tagged dataset, noun labeled words are retrieved, and then the probable product's features are extracted. These feature-based sentences or reviews are processed using a word embedding to generate review vectors that identify contextual information. These word vectors are used to construct hidden vectors at the word and sentence levels using a hierarchical attention method. With respect to each feature, reviews are divided into five classes: extremely positive, positive, extremely negative, negative, and neutral. The proposed method may readily detect a customer's opinion on the quality of a product based on a certain attribute, which is beneficial in making a purchase choice. [ABSTRACT FROM AUTHOR]

Many questions and answers about Islamic law are scattered on the internet and have been explained repeatedly by various sites. One solution is presented by the website www.piss-ktb.com, which creates a web-based source of information in the form of Frequently Asked Questions (FAQ). However, web-based FAQs have a weakness: users still have to browse through the available questions one by one according to the questions they want to know the answers to. Browsing through thousands of FAQs is inefficient and exhausting. Thus, a chatbot system can become a better alternative to the FAQ website. Still, chatbots are difficult to use because most of their conversations are hard to understand. A single character error will cause the system to misunderstand its meaning. In reality, users expect a chatbot that can understand everyday language. Thus, it is necessary to develop a chatbot system that can understand various common sentence combinations in everyday language and understand the meaning of words. In addition, it should be able to predict answers automatically to various kinds of questions and requests, even though the initial training data is relatively low. Therefore, this study aims to develop a system that can provide answers automatically based on user commands in natural language using Global Vectors for Word Representations (GloVe), Convolutional Neural Networks (CNN), and Transfer Learning techniques. The result shows that the use of transfer learning and the Nadam optimizer can improve the system’s performance. [ABSTRACT FROM AUTHOR]

Call centers play a key role in the management of customer relationships in the modern business world. However, the growing demand for their services presents significant challenges, particularly in terms of staffing and handling increasing call volumes. This paper addresses these issues by presenting an AI-driven text classification framework tailored for the Republic of Turkiye Ministry of Trade Call Centre (MTCC), with the aim of automatically routing calls to relevant departments. Using a specific dataset of 20,000 phone call texts collected from the MTCC, the study employs TF-IDF, Word2Vec, and GloVe text vectorization techniques and applies various machine learning algorithms such as K-Nearest Neighbours, Naive Bayes, Support Vector Machines, Adaptive Boosting, Decision Tree and Random Forest for text classification. Through a comprehensive analysis, the study answers key research questions regarding optimal classifiers and vectorization methods. The proposed solution not only improves the efficiency of MTCC's call routing but also provides researchers with practical insights regarding Turkish text classification. The results indicate that a combination of the Random Forest classifier and Word2Vec text vectorization method is the optimal model that can manage to route calls in real-time. [ABSTRACT FROM AUTHOR]

Online platforms and social networking have increased in the contemporary years. They are now a major news source worldwide, leading to the online proliferation of Fake News (FNs). These FNs are alarming because they fundamentally reshape public opinion, which may cause customers to leave these online platforms, threatening the reputations of several organizations and industries. This rapid dissemination of FNs makes it imperative for automated systems to detect them, encouraging many researchers to propose various systems to classify news articles and detect FNs automatically. In this paper, a Fake News Detection (FND) methodology is presented based on an effective IBAVO-AO algorithm, which stands for hybridization of African Vultures Optimization (AVO) and Aquila Optimization (AO) algorithms, with an extreme gradient boosting Tree (Xgb-Tree) classifier. The suggested methodology involves three main phases: Initially, the unstructured FNs dataset is analyzed, and the essential features are extracted by tokenizing, encoding, and padding the input news words into a sequence of integers utilizing the GLOVE approach. Then, the extracted features are filtered using the effective Relief algorithm to select only the appropriate ones. Finally, the recovered features are used to classify the news items using the suggested IBAVO-AO algorithm based on the Xgb-Tree classifier. Hence, the suggested methodology is distinguished from prior models in that it performs automatic data pre-processing, optimization, and classification tasks. The proposed methodology is carried out on the ISOT-FNs dataset, containing more than 44 thousand multiple news articles divided into truthful and fake. We validated the proposed methodology's reliability by examining numerous evaluation metrics involving accuracy, fitness values, the number of selected features, Kappa, Precision, Recall, F1-score, Specificity, Sensitivity, ROC_AUC, and MCC. Then, the proposed methodology is compared against the most common meta-heuristic optimization algorithms utilizing the ISOT-FNs. The experimental results reveal that the suggested methodology achieved optimal classification accuracy and F1-score and successfully categorized more than 92.5% of news articles compared to its peers. This study will assist researchers in expanding their understanding of meta-heuristic optimization algorithms applications for FND. [ABSTRACT FROM AUTHOR]

Writing essays is an important skill which enables one to clearly write the ideas and understanding of certain topic with the help of language articulation and examples. Writing essay is a skill so is the grading of those essays. It requires a lot of efforts to grade these essays and the task becomes tedious and repetitive when the student to teacher ratio is high. As with any other repetitive task, the intervention of technology for automated essay grading has been thought of long back. However, the main challenge in automated essay grading lies in the understanding of language construction, word usage and presentation of idea/ argument/ narration. Language complexity makes natural language understanding a challenging task. In this work, we show our experiments with pre-trained static word embeddings like GloVe, fastText and pre-trained contextual model Bidirectional Encoder Representations from Transformers (BERT) for the task of automated essay grading. For the regression task, we have used Long Short-Term Memory (LSTM) and Support Vector Regression (SVR) models under various feature settings framed from the learnt embeddings. The results are shown with the ASAP-AES dataset on all 8 prompts. Our work shows average Quadratic Weighted Kappa (QWK) of 0.81 and 0.71 with SVR and LSTM on in-domain test set essays, respectively. The SVR model shows a better QWK than the human-human agreement of 0.75. To the best of our knowledge, our SVR model with pre-trained BERT embeddings achieve the highest average QWK reported on ASAP-AES data set. We further show the performance of our approach with adversary samples generated using permuted essays and off-topic essays. We experimentally show that our LSTM model though does not show high QWK score with human assigned grade but is robust against the adversarial settings considered. [ABSTRACT FROM AUTHOR]

In the contemporary digital marketplace, the proliferation of online consumer reviews has a pivotal influence on purchasing decisions. Concurrently, the prevalence of spurious reviews poses a substantial risk to the integrity of e-commerce, misleading consumers, and detrimentally impacting businesses. This paper delineates a pioneering methodology for the identification of counterfeit reviews, which is based on the combination of deep learning attributes and aspect-based analytical features. The main contribution of this research is (1) proposing an aspect fusion network based on the hierarchical attention mechanism to address the problem of multiple aspects of representing review content. The aspect fusion network can help select important aspect words and fuse aspect dictionaries with word-level attention weights. (2) We build a cardinality fusion model so that the heuristic can mitigate the negative impact of random weights and intervals on the auxiliary model. The methodology integrates advanced deep learning paradigms with aspect-based sentiment analysis to detect fraudulent reviews. Specifically, the approach encompasses a dual-method strategy: initially utilizing a Convolutional Neural Network (CNN) for the extraction of profound characteristics from review texts, followed by employing aspect-based sentiment analysis tools, including Part-of-Speech (PoS) tagging and GloVe embedding, for the distillation of aspectual features. Subsequently, these split sets of features are synergized and applied in the training of various classifier layers. Eextensive experiments have been conducted on six public review datasets contrasting the previous work on authenticity and aspect analysis. The effectiveness and performance of the proposed authenticity fusion model have been verified by the detailed analyses. The proposed model outperforms the competitors with remarkable improvement on both review authenticity and aspect analysis. This innovative approach was rigorously evaluated using a dataset of Amazon reviews that encompassed both authentic and counterfeit reviews. The empirical results demonstrate that our proposed method attains a remarkable accuracy rate of 97.73%, substantially surpassing existing state-of-the-art methodologies. The study posits that the strategic fusion of deep learning attributes and aspect-based features significantly enhances the efficacy of counterfeit review detection systems, presenting a formidable tool in the arsenal against e-commerce fraud.

Social media platforms have opened avenues for communication, information sharing, and engaging with others online. Automated accounts, known as social media bots, have been observed to engage in harmful activities such as disseminating misinformation, participating in online propaganda and election interference, spreading spam, cyberbullying, and harassing people. This paper proposes a new hybrid architecture based on semantic word embedding and Recurrent Neural Networks (RNNs) to detect social media bots. The research methodology includes the use of Global Vectors (GloVe) for text representation to convert tweets into vectors and combining the Bidirectional Gated Recurrent Units (BiGRU) and Long Short-Term Memory (LSTM) algorithms for semantic text-based classification. Using the proposed architecture, the training process was conducted with two datasets, Cresci-2017 and Twibot-20. The effectiveness of the approach in detecting automated accounts was assessed using five evaluation metrics: Precision, Accuracy, Recall, and F1-score. The proposed approach showed outstanding results in identifying social media bots based only on text-based content, achieving a Precision of 100%, Accuracy of 99.73%, Recall of 99.56%, and F1-Score of 99.63% using the Twibot-20 dataset. Moreover, the proposed architecture surpassed the results obtained by the state-of-the-art approach and showed resilience to overfitting and the ability to detect social media bots effectively in unseen and recent data. This highlights the importance of utilizing deep learning methods and semantic word representations to effectively address issues related to detecting and managing social media bot operations.

Online platforms are fostering social interaction, but unfortunately, this has given rise to antisocial behaviors such as cyberbullying, trolling, and hate speech on a global scale. The detection of hate and aggression has become a vital aspect of combating cyberbullying and cyberharassment. Cyberbullying involves using aggressive and offensive language including rude, insulting, hateful, and teasing comments to harm individuals on social media platforms. Human moderation is both slow and expensive, making it impractical in the face of rapidly growing data. Automatic detection systems are essential to curb trolling effectively. This research deals with the challenge of automatically identifying cyberbullying in tweets from a publicly available cyberbullying dataset. This research work employs robustly optimized bidirectional encoder representations from the transformers approach (RoBERTa), utilizing global vectors for word representation (GloVe) word embedding features. The proposed approach is further compared with the state-of-the-art machine, deep, and transformer-based learning approaches with the FastText word embedding approach. Statistical results demonstrate that the proposed model outperforms others, achieving a 95% accuracy for detecting cyberbullying tweets. In addition, the model obtains 95%, 97%, and 96% for precision, recall, and F1 score, respectively. Results from k-fold cross-validation further affirm the supremacy of the proposed model with a mean accuracy of 95.07%.

Event Detection (ED) has long struggled with the ambiguous definition of event categories, making it challenging to accurately classify events. Previous endeavors aimed to tackle this problem by constructing prototypes for specific event categories. However, they overlooked potential correlations among instances of distinct event categories, resulting in trigger misclassifications across event types. In this research, we introduce KEPA-CRF to train enhanced event prototypes and address the issue of limited samples in few-shot event detection. By integrating external knowledge from the Glove knowledge base into the model training process, we augment synonymous examples, mitigating the problem of insufficient samples in few-shot event detection. Additionally, through prototype adversarial training, we contrast prototypes of different event categories to augment the representational capabilities of prototype vectors. Experimental results showcase that our approach attains superior performance on the benchmark dataset FewEvent, surpassing comparative models with reduced training time. [ABSTRACT FROM AUTHOR]

Defect classification is a process to classify defects based on predefined categories. It is time consuming and manual process. Many automatic defect classification methods have been proposed to speed up the process of defect classification. However, these methods have not utilized the inter relations among the defect reports. In the literature for defect classification, Term Frequency-Inverse Document Frequency and Bag of words based approaches have been proposed. In this paper, we have proposed word embedding based model for the defect classification which is proven to be better in comparison with the existing methods. We have also proposed models for inter project defect classification by considering combination of different datasets of the same domain. We tested the proposed approach on 4096 defect reports using K nearest neighbor, Random forest, Decision tree, Support vector machine, Stochastic gradient descent and Ada boost classifiers in terms of accuracy, precision, recall and F1-score. Experimental results show that Decision tree achieves highest accuracy 98.21% while trained and tested on GloVe word embedding. We have also generated new word embedding using the bug reports corpus. Further, we compare the proposed model with Lopes et.al., 2020 and results show that our model outperforms. [ABSTRACT FROM AUTHOR]

Examinations are one way of evaluating students. To ensure the production of valid exams, frameworks such as Bloom's taxonomy are utilised when preparing questions. Bloom's taxonomy is a well-known framework that categorises educational objectives into six hierarchical levels of cognitive complexity. However, manually categorising exam questions can be time-consuming and subjective. The extant literature has yet to leverage advanced deep learning methods and state-of-the-art word embedding techniques. This study utilises the effectiveness of Artificial Neural Network (ANN) and Long Short-Term Memory (LSTM) models along with GloVe, BERT and TF-IDF for automating the classification of exam questions according to the revised Bloom's taxonomy. The study collected various question types from online sources and multiple state universities in Sri Lanka, resulting in a dataset of 16,584 questions labelled manually with the aid of domain experts. The dataset was cleaned using natural language processing techniques. Three models were proposed: ANN+TF-IDF, LSTM+GloVe, and LSTM+BERT. The results of the ANOVA and post hoc pairwise comparisons using Bonferroni correction indicate that the LSTM+BERT model outperformed the other models significantly. The proposed approach provides a reliable and consistent way of evaluating students, and educators can use it to improve their teaching strategies. The findings of this study have important implications for educational institutions and can lead to more effective and efficient evaluations. [ABSTRACT FROM AUTHOR]

Each week, thousands of newspaper articles on real estate topics are read by market participants. While the market is comparatively intransparent, readers hope to find valuable information. This raises the question of whether this investment of time pays off and whether different types of newspapers are an equivalent source of information. This paper examines the relationship between news-based coverage of real estate topics respectively news-based market sentiment and total returns of the asset classes of residential, office and retail. Using methods of natural language processing, including word embedding, topic modelling and sentiment analysis, three sentiment indicators for each asset class can be derived from 137,000 articles of two trade and two daily newspapers. Our results suggest that trade newspapers outperform daily newspapers in the prediction of future total returns and that the generated sentiment indicators Granger-cause total returns. Moreover, the results indicate that daily newspapers report more negatively on rising returns in the residential market than the trade press. To the best knowledge of the authors, this is the first study to quantify news coverage and sentiment for the main real estate asset classes through means of textual analysis, and to assess different sentiments in trade and daily press. [ABSTRACT FROM AUTHOR]

One of the most difficult topics in natural language understanding (NLU) is emotion detection in text because human emotions are difficult to understand without knowing facial expressions. Because the structure of Indonesian differs from other languages, this study focuses on emotion detection in Indonesian text. The nine experimental scenarios of this study incorporate word embedding (bidirectional encoder representations from transformers (BERT), Word2Vec, and GloVe) and emotion detection models (bidirectional long short-term memory (BiLSTM), LSTM, and convolutional neural network (CNN)). With values of 88.28%, 88.42%, and 89.20% for Commuter Line, Transjakarta, and Commuter Line+Transjakarta, respectively, BERT-BiLSTM generates the highest accuracy on the data. In general, BiLSTM produces the highest accuracy, followed by LSTM, and finally CNN. When it came to word embedding, BERT embedding outperformed Word2Vec and GloVe. In addition, the BERT-BiLSTM model generates the highest precision, recall, and F1-measure values in each data scenario when compared to other models. According to the results of this study, BERT-BiLSTM can enhance the performance of the classification model when compared to previous studies that only used BERT or BiLSTM for emotion detection in Indonesian texts. [ABSTRACT FROM AUTHOR]

Background: Patients are hospitalized for extended periods, particularly in intensive care units (ICUs). As a result, the saturation probe (pulse oximeter) remains attached for an extended period and microorganisms can grow in the wet environment. If the pulse oximeters are not reprocessed, cross-infection may occur. The literature contaiudies in which gloves were used for the measurement while various SpO (peripheral arterial oxygen saturation) measurements were compared with each other. However, such comparisons have yet to be made with the results of arterial blood gas SpO measurements by pulse oximeter, considered as the gold standard. The present study aimed to compare arterial blood gas values with the fingertip saturation measurement performed by having adult patients wear gloves of different colors, one after the other, on their fingers and determining the effect of the differently colored gloves (transparent, white, black, light blue) on saturation values.Methods: The study was conducted on 54 patients in an ICU. Intra-arerial blood gas SpO results were measured. Oxygen saturatieasured while the patient 1. did not wear gloves and 2. sequentially wore a series of gloves of different colors. Paired t-test, correlation analysis, and Bland Altman charts were used to evaluate the results.Results: The mean SpO% value of the participants’ intra-arterial blood gas measurements was 97.76±2.04. The mean SpO% value obtained from the measurements of the fingers with a transparent glove was 0.43 points lower than the mean SpO% value of the intra-arterial blood gas measurements (t=0.986, p=0.61). The mean SpO% value obtained from the measurements of the fingers with a white glove was 0.9oints lower than the mean SpO% value of the intra-arterial blood gas measurements (t=1.157, p=0.093).Conclusion: Of the measurements performed with a glove, the mean SpO% value obtained from the measurements of the fingers with a transparent glove was more consistent with the mean SpO% the intra-arterial blood gas measurements than measurement of the fingers without a glove.

Twitter is a popular social media platform that allows users to share short message’s opinion and engage in real-time conversations on a wide range of topics known as tweet. However, tweets often have a complicated and unclear context, which makes it difficult to determine the actual emotion. Therefore, sentiment analysis is required to see the tendency of an opinion, whether the opinion tends to be positive, negative, or neutral. Researchers or institutions can find out how the response and emotions of an issue are happening and make good decisions. With the large user of Twitter social media in Indonesia, sentiment analysis will be carried out using deep learning Convolutional Neural Network (CNN), Term Frequency-Inverse Document Frequency (TF-IDF), Robustly Optimized BERT Pretraining Approach (RoBERTa), Synthetic Minority Over-sampling Technique (SMOTE), and Global Vector (Glove). In this research, the dataset used is trending topics with hashtags related to government policies on Twitter social media and obtained through crawling. By using 30.811 data, the result shows the highest accuracy of 95.56% using CNN with a split ratio of 90:10, baseline unigram, RoBERTa, SMOTE, and Top10 corpus tweet with an increase 10.1%.

As the mainstream language of the world, English still occupies an unshakeable prime position, and English translation is one of the essential learning content for students. The semantic network association network model is introduced in this paper, and a text analysis model for English translation is proposed. The model obtains word vectors through the GloVe word embedding model, combines the relevance measure of the Jaccard index, and applies the improved RelArtNet algorithm to calculate semantic relevance in English texts. The translated data from a prominent English test is selected as a sample to analyze the relevance of each feature value of English translation scores. From the three aspects of word surface, conceptual fidelity, and semantic expression, the textual analysis of the experimental corpus by the model yields the comprehensive scoring effect of English translation by the model. The correlation between translation length and English translation scoring is the highest, and the correlation of scoring in both English to Chinese and Chinese to English is more significant than 0.58. The overall model scoring and manual scoring of English translation are closer, with a difference of 1.59 in scoring and a correlation coefficient of greater than 0.8, which verifies the practical value of the model for scoring English translations. The English translation scoring model can help teachers review translations and students practice independently, which has important practical significance.

Due to their geometry and thermal physiology, hands are most vulnerable to cold weather injuries and loss of dexterity. Gloves are the most common for hand protection during exposure to extreme thermal and hazardous environments. Although glove microclimate properties such as area factor, air gap thickness, and contact area play a significant role in thermal protection, identifying local (at individual hand segments) glove microclimate properties is still a research gap. For the first time, the glove-microclimate properties for 16 hand segments at high spatial resolution were analyzed by employing state-of-the-art hand-held 3D scanner and post-processing techniques for different glove types. Our results clearly indicate that the glove area factor for distal phalanges is significantly higher (by 49.8 %) than that for other hand segments, which increases the heat transfer from distal phalanges. In contrast, average air gap thickness was relatively uniform across all hand segments. The glove type had a pronounced effect on glove microclimate properties, e.g., bulky and heavy cold weather protective gloves had a larger average air gap thickness and glove area factor. Regression models are also developed to estimate the glove microclimate properties from simple measurement (i.e., ease allowance). Overall, this study provides essential information for the design and development of protective gloves that can help improve safety, comfort, and dexterity. Methods and mathematical models developed in this study also contribute to facilitating extremity (e.g., hand) focused thermoregulation modeling, hazard simulation, injury prediction, ergonomic design, optimum performance (dexterity and tactility) along with thermal protection.

Extracting meaningful insights from the sheer volume of Online Consumer Reviews (OCRs) has been challenging. We aim to explore the most effective methodologies for text mining of OCRs, covering topic extraction, topic classification, and sentiment analysis. Through a comprehensive review of recent research on text mining applied to OCRs, we found that LDA2Vec can enhance the effectiveness of conventional LDA for topic extraction. Additionally, the combination of Convolutional Neural Networks (CNN) and GloVe demonstrates the best performance for topic classification, while CNN and SVM outperform other algorithms for sentiment analysis. Furthermore, the spaCy Natural Language Processing (NLP) proves to be a more effective choice for text pre-processing compared to Natural Language Toolkit (NLTK). Subsequently, we applied these refined models to a Yelp reviews dataset, assessed their performance against conventional models, and provided a comprehensive discussion of the results and limitations. The insights gained from this study can be valuable for developing effective models in OCR analysis. [ABSTRACT FROM AUTHOR]

Sentiment analysis (SA) has recently developed an automated approach for assessing sentiment, emotion, and these reviews or opinions to extract relevant and subjective information from text-based data. Analyzing sentiment on social networks, such as Twitter, has become a powerful means of learning about the users' opinions and better understanding and satisfaction. However, it consumes time and energy to disperse and collect surveys from clients, often inaccurate and inconsistent, and evaluating and improving the accuracy of the methods in sentiment analysis is being hindered by the challenges encountered in Natural Language Processing (NLP). This paper uses NLP, text analysis, biometrics, and computational linguistics to detect and extract replies, moods, or emotions from Skytrax Airline Customers' Feedback SACF data. This research uses deep learning models to analyze various approaches applied to small SACF to solve sentiment analysis problems. We applied word embedding (Glove embedding models) to improve the sentiment classification performance of a series of datasets extensively utilized for feature extractions. Finally, a comparative study has been conducted on the SACF data analysis utilizing deep learning (DL)for evaluating the performance of the different models and input features, which is Recurrent Neural Networks (RNN), long short-term memory (LSTM), Gated Recurrent Unit (GRU), 1D Convolutional Neural Networks (CONV1D), and Bidirectional Encoder Representations from Transformers (BERT) for application to big datasets in 2019. This approach was assessed using each classification technique; the precision, recall, f1-score, and accuracy metrics for sentiment analysis have been identified. And The results show that LSTM outperforms in classification accuracy; the outcome was 91%. [ABSTRACT FROM AUTHOR]

This study introduces a new wearable fiber-optic sensor glove. The glove utilizes a flexible material, polydimethylsiloxane (PDMS), and a silicone tube to encapsulate fiber Bragg gratings (FBGs). It is employed to enable the self-perception of hand posture, gesture recognition, and the prediction of grasping objects. The investigation employs the Support Vector Machine (SVM) approach for predicting grasping objects. The proposed fiber-optic sensor glove can concurrently monitor the motion of 14 hand joints comprising 5 metacarpophalangeal joints (MCP), 5 proximal interphalangeal joints (PIP), and 4 distal interphalangeal joints (DIP). To expand the measurement range of the sensors, a sinusoidal layout incorporates the FBG array into the glove. The experimental results indicate that the wearable sensing glove can track finger flexion within a range of 0° to 100°, with a modest minimum measurement error (Error) of 0.176° and a minimum standard deviation (SD) of 0.685°. Notably, the glove accurately detects hand gestures in real-time and even forecasts grasping actions. The fiber-optic smart glove technology proposed herein holds promising potential for industrial applications, including object grasping, 3D displays via virtual reality, and human–computer interaction. [ABSTRACT FROM AUTHOR]

• Leakage through the glove-protective clothing interface is critical in health care. • There is no test method available to quantify the leakage at the interfaces. • This study quantifies the fluid leakage at the coverall and glove interface. • A robotic arm was used to simulate upper extremity movements of health care workers. • Significant difference in fluid leakage amounts was found. Fluid leakage through the glove-protective clothing interface is an area of concern for many health care personnel, including emergency medical service providers, who may wear coveralls to protect themselves from multiple types of hazards. There is currently no established standard test method to specifically evaluate the barrier performance of the glove-protective clothing interface region for any personal protective equipment ensemble. This study quantifies the fluid leakage at the coverall and glove interface using single and double gloving. A robotic arm, which can simulate upper extremity movements of health care personnel, was used to test 5 coverall models and an extended examination glove model in single and double glove conditions. The results show that there was a significant difference in fluid leakage amounts between some of the coverall models and the number of glove layers studied. Findings also highlight that there is a high correlation between basis weight and stiffness of the coverall fabrics and the fluid leakage amounts. These results underline that coverall constructed from thin and less stiff fabrics can result in lower fluid leakage levels. Also, there was no significant difference in fluid leakage amounts between single and double gloves when tested with each of the coverall models, with the exception of the coveralls with the highest basis weight and stiffness. [ABSTRACT FROM AUTHOR]

World wide web is abundant with various types of information such blogs, social media posts, news articles. With this type of magnitude of online content, there is a need to deeply understand the insights of it in order to make use of the information for practical applications such as event detection, polarity, sentiment analysis and so on. Natural Language Processing (NLP) is the study of such information which is used for text classification, sentiment analysis, clustering of similar text. NLP makes use of linguistic knowledge and build machine learning models to analyse textual information. NLP finds its way in various applications like classification of online review into positive and negative without actually reading the reviews and feedback. For text analysis, there should be a way to quantify the text based on its frequency of occurrence, correlation with neighbouring words, contextual similarity of words, etc. One such way is word embedding. This study applies various word embedding techniques on tweets of popular news channels and clusters the resultant vectors using K-means algorithm. From this study, it is found out that Bidirectional Encoder Representations from Transformers (BERT) has achieved highest accuracy rate when used with K-means clustering. [ABSTRACT FROM AUTHOR]

The article investigates the possibility of identifying the presence of SKOS (Simple Knowledge Organization System) relations between concepts represented by terms on the base of their vector representation in general natural language models. Several language models of the Word2Vec and GloVe families are considered, on the basis of which an artificial neural network (ANN) classifier of SKOS relations is formed. To train and test the efficiency of the classifier, datasets formed on the basis of the DBPedia and EuroVoc thesauri are used. The experiments performed have shown the high efficiency of the classifier trained using GloVe family models, while training it with use of Word2Vec models looks impossible in the bounds of considered ANN-based classifier architecture. Based on the results, a conclusion is made about the key role of taking into account the global context of the use of terms in the text for the possibility of identifying SKOS relations. [ABSTRACT FROM AUTHOR]

Objectives: Spacesuits are designed to be reliable personal spacecraft that preserve the life and well-being of the astronaut from the extremes of space. However, materials, operating pressures, and suit design requirements often result in a risk of musculoskeletal discomfort and injury to various areas of the body. In particular, this investigation looked at fingernails and their risk of developing onycholysis. Methods: An onycholysis literature review was followed by a retrospective analysis of injury characteristics, astronaut suited training and spaceflight events, hand anthropometry, glove sizing, and astronaut demographics. Multiple logistic regression was used to assess the likelihood of onycholysis occurrence by testing potential risk variables against the dataset compiled from the retrospective data mining. Results: The duration of event exposure, type of glove used, distance (delta) between the fingertip and the tip of the glove, sex, and age were found to be significantly related to occurrence of onycholysis (whether protective or injurious). Conclusion: An initial risk formula (model) for onycholysis was developed as a result of this investigation. In addition to validation through a future study, further improvement to this onycholysis equation and spacesuit discomfort and injury in general can be aided by future investigations that lead to better definition of the threshold between safe and risky exposure for each type of risk factor. Application: This work described a potential method that can be used for EVA spacesuit glove onycholysis injury risk analysis for either iterative glove design or between glove comparisons, such as during a product downselect process. [ABSTRACT FROM AUTHOR]

In the field of natural language processing (NLP), detecting emotions or sentiments can be a challenging task, and sometimes emotions can be more complex than just positive or negative. However, detecting sarcasm in textual data adds another layer of complexity. Despite this, identifying the underlying sarcasm in the text has become a recent area of interest among NLP researchers. Headlines in newspapers often use sarcasm to engage readers, but readers may have difficulty recognizing it, leading to a misinterpretation of the news and spreading misinformation. As a result, there is an urgent need for technology that can automatically identify sarcasm with high accuracy. Recent studies in this domain have revealed a need for a robust and efficient model. Deep learning approaches have proven to be effective in sarcasm detection. In this work, we propose a novel two-stage model that uses a word-embedding technique to select relevant features followed by an advanced deep-learning architecture to classify sarcasm in news headlines. Our proposed method demonstrates promising results in identifying sarcasm in text with an accuracy rate of approximately 97 %. We have fine-tuned the hyper-parameters to increase the precision level, which enhances the efficacy of our model. Our work provides a significant contribution to the field of NLP by presenting a reliable and effective model for sarcasm detection. The comparison of our model with recent advancements indicates that our approach outperforms them. By using our model, readers can avoid misinterpretations and the spreading of misinformation. Therefore, our work can have a positive impact on society, and we believe that it can inspire future research in the field of sarcasm detection. [ABSTRACT FROM AUTHOR]

Unwanted text messages are called Spam SMSs. It has been proven that Machine Learning Models can categorize spam messages efficiently and with great accuracy. However, the lack of proper spam filtering software or misclassification of genuine SMS as spam by existing software, the use of spam detection applications has not become popular. In this paper, we propose multiple deep neural network models to classify spam messages. Tiago’s Dataset is used for this research. Initially, preprocessing step is applied to the messages in the data set, which involves lowercasing the text, tokenization, lemmatization of the text, and removal of numbers, punctuations, and stop words. These preprocessed messages are fed in two different deep learning models with simpler architectures, namely Convolution Neural Network and a hybrid Convolution Neural Network with Long Short-Term Memory Network for classification. To increase the accuracy of these two simple architectures, BUNOW and GloVe word embedding techniques are incorporated with deep learning models. BUNOW and GloVe are popular choices in sentiment analysis, but in this work, these two-word embedding techniques are tried in the context of text classification to improve accuracy. The best accuracy of 98.44% is achieved by the CNN LSTM BUNOW model after 15 epochs on a 70% - 30% train-test split. The proposed model can be used in many practical applications like real-time SMS spam detection, email spam detection, sentiment analysis, text categorization, etc.

The article investigates the possibility of identifying the presence of SKOS (Simple Knowledge Organization System) relations between concepts represented by terms on the base of their vector representation in general natural language models. Several language models of the Word2Vec and GloVe families are considered, on the basis of which an artificial neural network (ANN) classifier of SKOS relations is formed. To train and test the efficiency of the classifier, datasets formed on the basis of the DBPedia and EuroVoc thesauri are used. The experiments performed have shown the high efficiency of the classifier trained using GloVe family models, while training it with use of Word2Vec models looks impossible in the bounds of considered ANN-based classifier architecture. Based on the results, a conclusion is made about the key role of taking into account the global context of the use of terms in the text for the possibility of identifying SKOS relations.

Background. hands are used in all areas of everyday life, from simple tasks, such as the selection of an object, to complex ones, such as communication between people with speech and hearing defects. Therefore, it is necessary to find a way not only to track the movements and gestures of human hands, but also to integrate them, and gesture recognition is especially important for people who use their hands to communicate. Materials and methods. A method of organizing communication between people with hearing loss and speech defects is proposed, including the use of a robotic glove, which allows, in the future, to use this proposal for when the standard sign language is exhausted and its addition is required. Results. The connection scheme of industrially manufactured boards has been worked out: the HC-05 Bluetooth module and the Arduino Nano debugging board together with a rough, simplified version of the human robotic brush layout with fixed strain-resistant sensors. Conclusions. The proposed technique, together with the technology of robotic gloves, allows communication not only between people with speech and hearing defects, but also eliminates misunderstandings when communicating people with speech and hearing impairments with ordinary, healthy citizens.

Hate speech, characterized by intentional expressions of dissatisfaction, is a prevalent phenomenon on social media platforms, including Twitter. Its continual occurrence can foster divisions, misunderstandings, and even acts of violence between individuals and groups, particularly due to the resulting prejudice. This study investigates the occurrence of hate speech within Indonesian content on Twitter, employing a deep learning approach to detect and analyze such expressions. The Long Short-Term Memory (LSTM) method, coupled with the GloVe word embedding technique, is utilized on a dataset comprising 13,169 Indonesian tweets flagged for hate speech. Four distinct model architectures were developed through the integration of LSTM and GloVe. The findings reveal model 1 to exhibit superior performance, achieving a precision of 89%, a recall of 99%, an F-1 score of 94%, and an overall accuracy of 94.24%. It is suggested that future research explore the potential deployment of this model in web or mobile platforms for real-time analysis, thereby enhancing the capacity for immediate hate speech detection and mitigation. [ABSTRACT FROM AUTHOR]

In this paper, we propose a method exploiting syntactic structure, semantic relations and word embeddings for recognizing textual entailment. The sentence pairs are analyzed using their syntactic structure and categorization of sentences in active voice, sentences in passive voice and sentences holding copular relations. The main syntactic relations such as subject, verb and object are extracted and lemmatized using a lemmatization algorithm based on parts-of-speech. The subject-to-subject, verb-to-verb and object-to-object similarity is identified using enhanced Wordnet semantic relations. Further similarity is analyzed using modifier relation, number relation, nominal modifier relation, compound relation, conjunction relation and negative relation. The experimental evaluation of the method on Stanford Natural Language Inference dataset shows that the accuracy of the method is 1.4% more when compared to the state-of-the-art zero shot domain adaptation methods. [ABSTRACT FROM AUTHOR]

Background: Semipermeable membranes might be suitable for glove liners or comfort gloves in individuals with irritant contact dermatitis (ICD). Objectives: To evaluate the effects of different glove materials on inflammation and epidermal barrier impairment after experimental skin irritation. Methods: Nine test areas on the volar forearms of 24 healthy volunteers were irritated with sodium lauryl sulfate (1%) and afterward covered for 6 days (6 or 8 h/day) with semipermeable Sympatex (SYM), vinyl (OCC), combinations of vinyl with Sympatex (SYM/OCC) or cotton (COT/OCC), or left uncovered (CON). Up to day 10, measurements of transepidermal water loss (TEWL), erythema (a*), skin humidity (SH) and visual scoring (VS) were applied. Results: No significant differences in skin parameters were found between COT/OCC and SYM/OCC as well as between each of the combinations and CON. SYM, COT/OCC and SYM/OCC led to better results for most skin parameters than OCC alone. Conclusions: Occlusive material has a negative impact on skin barrier recovery and inflammation after skin irritation whereas SYM is not inferior to uncovered areas indicating good tolerability. Altogether, the data suggest that SYM is a useful alternative to COT as material for glove liners and comfort gloves in ICD patients. [ABSTRACT FROM AUTHOR]

Many real-world scenarios can be naturally modeled as heterogeneous graphs, which contain both symmetry and asymmetry information. How to learn useful knowledge from the graph has become one of the hot spots of research in artificial intelligence. Based on Metapath2vec algorithm, an improved Metapath2vec algorithm is presented, which combines Metapath random walk, used to capture semantics and structure information between different nodes of a heterogeneous network, and GloVe model to consider the advantage of global text representation. In order to verify the feasibility and effectiveness of the model, node clustering and link prediction experiments were conducted on the self-generated ideal dataset and the MOOC course data. The analysis of experimental data on these tasks shows that the Metapath–GloVe algorithm learns consistently better embedding of heterogeneous nodes, and the algorithm improves the node embedding performance to better characterize the heterogeneous network structure and learn the characteristics of nodes, which proves the effectiveness and scalability of the proposed method in heterogeneous network mining tasks. It is also shown through extensive experiments that the Metapath–GloVe algorithm is more efficient than the non-negative matrix decomposition algorithm (NMF), and it can obtain better clustering results and more accurate prediction results in the video recommendation task. [ABSTRACT FROM AUTHOR]

The utilization of text vectorization techniques has become essential for numerous classification tasks in present-day natural language processing. Word embedding methods commonly used today, such as Word2Vec, GloVe, etc., are based on the semantic similarity of words. WordNet, as a lexical database of words, provides a rich source of semantic information. In our article, we propose a text vectorization technique using extended text data with the data augmentation method, specifically by replacing words with their synonyms obtained from WordNet. The results obtained from text classification tasks using multiple classifiers demonstrate that expanding the corpus with this method leads to improved vector representations of words. [ABSTRACT FROM AUTHOR]

Despite the plethora of data generated on Arabic social media, research dedicated to this language remains comparatively scarce. Sentiment analysis, an extensively studied field in various languages, has seen limited development in Arabic. Existing approaches to Arabic sentiment analysis primarily employ machine learning, wherein word vector representations serve as features for model training. A significant challenge encountered in this approach is the substantial volume and sparsity of the matrix representation, attributable to the extensive vocabulary of the Arabic language. This paper proposes a novel word embedding that amalgamates the Bag of Roots (BoR) technique with Global Vector distributional representations (GloVe). This innovation is inspired by the characteristic of the Arabic language, where it is rare to find two or more words sharing the same root but conveying different sentiments. The impact of this innovative word embedding technique is highlighted through an evaluation using sentiment analysis. This involves the implementation of conventional classifiers, specifically Support Vector Machines (SVM) and Logistic Regression (LR). The results obtained demonstrate promising precision, recall, and F1-score metrics. Additionally, a significant reduction in processing time is observed when compared to other approaches referenced in literature. Thus, this paper contributes to the advancement of Arabic sentiment analysis, offering a potential pathway to overcoming the challenges associated with the large vocabulary and complex structure of the Arabic language. [ABSTRACT FROM AUTHOR]

The digital transformation of various systems has brought great convenience to our daily lives, but it has also increased the level of cyberattacks. As the number of cyberattacks has increased, so has the number of reports analyzing them, MITRE publishes the ATT&CK Matrix which analyzes the tactics and techniques of attacks based on real-world examples. As the flow of attacks has become more understandable through TTP information, researchers have been using it with deep learning models to detect or predict attacks, which makes embedding essential to train the model. In previous studies on embedding TTPs, embedding is limited to simple statistical methods such as one-hot encoding and TF-IDF. Such methods do not consider the order of TTPs and the conceptual similarity between TTPs, therefore do not capture the rich information that TTPs contain. In this paper, we propose embedding TTP with GloVe, a method using a co-occurrence matrix. To properly evaluate the semantic embedding performance of TTP, we also propose a measurement called Tactic Match Rate (TMR). In the experimental results, 8 out of 14 tactics showed a TMR of more than 0.5. Especially the “TA0007 (Discovery)” tactic showed the highest TMR of 0.87. Through correlation analysis, the experimental result shows that the reason for the different embedding performances of the tactic is affected by the frequency of the technique in the same tactic, with at most a 0.96 score. We also experimentally demonstrated that the neutrality of TTP affects learning performance.