Search

Syllabification may be considered trivial for humans, but it can prove to be a challenging task in terms of automated text analysis. In this study, we explore three approaches to syllabify words in Romanian using state-of-the-art deep learning architectures in sequence prediction, namely BiLSTM, CNN, and transformer. In contrast to previous approaches, our models take into account the part of speech of the word, which in return can weigh heavily in situations where words have the same written form, but different syllabification. Our best model obtains an accuracy of approximately 98% using a conditional random field on top of the BiLSTM architecture, surpassing all previous state-of-the-art models. Our model represents a building block for multiple smart learning ecosystems, ranging from better hyphenation software for text evaluation, to text-to-speech and speech-to-text frameworks employed in intelligent houses or personal assistants.

Reading comprehension is key to knowledge acquisition and to reinforcing memory for previous information. While reading, a mental representation is constructed in the reader’s mind. The mental model comprises the words in the text, the relations between the words, and inferences linking to concepts in prior knowledge. The automated model of comprehension (AMoC) simulates the construction of readers’ mental representations of text by building syntactic and semantic relations between words, coupled with inferences of related concepts that rely on various automated semantic models. This paper introduces the second version of AMoC that builds upon the initial model with a revised processing pipeline in Python leveraging state-of-the-art NLP models, additional heuristics for improved representations, as well as a new radiant graph visualization of the comprehension model.

The drawbacks of traditional methods of cybernetic vulnerability detection relate to the required time to identify new threats, to register them in the Common Vulnerabilities and Exposures (CVE) records, and to score them with the Common Vulnerabilities Scoring System (CVSS). These problems can be mitigated by early vulnerability detection systems relying on social media and open-source data. This paper presents a model that aims to identify emerging cybernetic vulnerabilities in cybersecurity news articles, as part of a system for automatic detection of early cybernetic threats using Open Source Intelligence (OSINT). Three machine learning models were trained on a novel dataset of 1000 labeled news articles to create a strong baseline for classifying cybersecurity articles as relevant (i.e., introducing new security threats), or irrelevant: Support Vector Machines, a Multinomial Naive Bayes classifier, and a finetuned BERT model. The BERT model obtained the best performance with a mean accuracy of 88.45% on the test dataset. Our experiments support the conclusion that Natural Language Processing (NLP) models are an appropriate choice for early vulnerability detection systems in order to extract relevant information from cybersecurity news articles.

Online searching is one of the most frequently performed actions and search engines need to provide relevant results, while maintaining scalability. In this paper we introduce a novel approach grounded in Cohesion Network Analysis in the form of a semantic search engine incorporated in our Hub-Tech platform. Our aim is to help researchers and people unfamiliar with a domain find meaningful articles online, relevant for their project scope. In addition, we integrate state-of-the-art technologies to ensure scalability and low response time, namely SOLR – for data storage and full-text search functionalities – and Akka – for parallel and distributed processing. Preliminary validations denote promising search results, the software being capable to suggest articles in approximately the same way as humans consider them most appropriate – 75% are close results and top 20% are identical to user recommendations. Moreover, Hub-Tech recommended more suitable articles than Google Scholar for our specific task of searching for articles related to a detailed description given as input query (50 + words).