Search

As electric vehicle (EV) emerges, it is important to understand how driver's driving behavior is influencing power consumption in an electric vehicle. Driver's personal driving behavior is usually quite distinctive and can be recognized by means of driving patterns after some driving cycles. This paper presents a method combining several machine learning approaches to characterize driving behaviors of electric vehicles. The driving patterns are modeled according to power consumption monitored by the battery management system (BMS), in aspects of individual driver's personal and EV-fleet operations. First, we apply an unsupervised clustering approach to characterize a driver's behaviors by formulating driving patterns. Subsequently, the resulting clustered datasets were used to train machine-learning based classifiers for classification of dataset of EV and EV-fleet driving patterns. The work aims to provide a robust solution to help identify the characteristics of specific types of EVs and their driver behaviors, in order to allow automakers and EV-subsystem providers to gather valuable driving information for product improvement.

This study aims to extract symptom profiles and functional impairments of major depressive disorder from electronic health records (EHRs). A chart review was conducted by three annotators on 500 discharge notes randomly selected from a medical center in Taiwan to compile annotated corpora for nine depressive symptoms and four types of functional impairment. Named entity recognition techniques including the dictionary-based approach., a conditional random field model, and deep learning approaches were developed for the task of recognizing depressive symptoms and functional impairments from EHRs. The results show that the average micro-F-measures of the supervised learning approaches in extracting depressive symptoms is almost perfect (>0.90) but less accurate for the extraction of functional impairment.

Graphical abstractThis work proposes a scheme to improve the self-organizing map algorithm. This is the overall flowchart of the proposed algorithm. The key ingredients include:1.A novel topic identification scheme.2.Lateral expansion using novel topic incompatibility measure.3.Hierarchical expansion scheme using novel cluster size and topic size criteria.Display Omitted HighlightsIncorporation of topic identification into SOM learning could be beneficial to text categorization task.Both lateral and hierarchical expansion during SOM learning were achieved according to criteria based on identified topics.The produced text hierarchies outperformed contemporary approaches in quality and performance on text categorization. Self-organizing maps (SOM) have been applied on numerous data clustering and visualization tasks and received much attention on their success. One major shortage of classical SOM learning algorithm is the necessity of predefined map topology. Furthermore, hierarchical relationships among data are also difficult to be found. Several approaches have been devised to conquer these deficiencies. In this work, we propose a novel SOM learning algorithm which incorporates several text mining techniques in expanding the map both laterally and hierarchically. On training a set of text documents, the proposed algorithm will first cluster them using classical SOM algorithm. We then identify the topics of each cluster. These topics are then used to evaluate the criteria on expanding the map. The major characteristic of the proposed approach is to combine the learning process with text mining process and makes it suitable for automatic organization of text documents. We applied the algorithm on the Reuters-21578 dataset in text clustering and categorization tasks. Our method outperforms two comparing models in hierarchy quality according to users' evaluation. It also receives better F1-scores than two other models in text categorization task.

In this paper, we describe our work on developing a model and method for extracting key entities from the online social messages regarding emergent events for enhancing ontology engineering, enabling a sensible solution for prevention of similar disasters. Our work started with the development of an event modelling system using a data-cluster slicing approach, which combines analytics of social data and event lifecycle algorithms, allowing for large-scale emerging novel events to be quickly and accurately analyzed. Subsequently, our system computes the energy of each collected event data sets, and then encapsulates ranked temporal, spatial and topical keywords into a structured node for event-entity extraction, in order to update event ontologies for fast response of emergent events. The preliminary experimental results demonstrate that our developed system is workable, allowing for prediction of possible evolution and early warning of critical incidents with a support of dynamic entity extraction.

With the consciousness of environmental protection is going to rising up globally, every government have seriously concerned the related issues of PM2.5. In essence, PM2.5 is the microscopic contaminated particles. The sizes of particles are just one of twenty-eighth of human's hair, in addition to penetrating the respiration system, carrying the heavy mental, dioxin and bacteria, through the blood circulation could intrude easily into the human alveoli. Furthermore, the contaminated particles may cause great damages to human health. Thus, in this work we investigate some factors which may influence the air quality related to PM2.5, including temperature, humidity, and wind speed. In particular, we collected the data of the factors in several cities in Taiwan for experimentation. After removing the outlier data samples in the database, we make use of the Support Vector Machines (SVM) and Support Vector Regression (SVR) techniques to experiment with the collected data for correlation analysis of regional air quality.

Due to the explosive growth of social-media applications, enhancing event-awareness by social mining has become extremely important. The contents of microblogs preserve valuable information associated with past disastrous events and stories. To learn the experiences from past events for tackling emerging real-world events, in this work we utilize the social-media messages to characterize real-world events through mining their contents and extracting essential features for relatedness analysis. On one hand, we established an online clustering approach on Twitter microblogs for detecting emerging events, and meanwhile we performed event relatedness evaluation using an unsupervised clustering approach. On the other hand, we developed a supervised learning model to create extensible measure metrics for offline evaluation of event relatedness. By means of supervised learning, our developed measure metrics are able to compute relatedness of various historical events, allowing the event impacts on specified domains to be quantitatively measured for event comparison. By combining the strengths of both methods, the experimental results showed that the combined framework in our system is sensible for discovering more unknown knowledge about event impacts and enhancing event awareness.

Highlights? We applied a density-based stream clustering method for mining Twitter data. ? The developed method can detect real-time and geospatial event features. ? Using the detection results can estimate the temporal and spatial impacts of events. ? Our method is well suited for awareness of large-scale events and risk management. Social networks have been regarded as a timely and cost-effective source of spatio-temporal information for many fields of application. However, while some research groups have successfully developed topic detection methods from the text streams for a while, and even some popular microblogging services such as Twitter did provide information of top trending topics for selection, it is still unable to fully support users for picking up all of the real-time event topics with a comprehensive spatio-temporal viewpoint to satisfy their information needs. This paper aims to investigate how microblogging social networks (i.e. Twitter) can be used as a reliable information source of emerging events by extracting their spatio-temporal features from the messages to enhance event awareness. In this work, we applied a density-based online clustering method for mining microblogging text streams, in order to obtain temporal and geospatial features of real-world events. By analyzing the events detected by our system, the temporal and spatial impacts of the emerging events can be estimated, for achieving the goals of situational awareness and risk management.

Highlights? We developed a fusion method to integrate text and photo types of location information. ? It combines image annotation and geographic text mining. ? Photos and texts are mapped to a unified semantic space for fusion. ? The approach can associate text and image types of documents with correct geographical zones. Due to the steady increase in the number of heterogeneous types of location information on the internet, it is hard to organize a complete overview of the geospatial information for the tasks of knowledge acquisition related to specific geographic locations. The text- and photo-types of geographical dataset contain numerous location data, such as location-based tourism information, therefore defining high dimensional spaces of attributes that are highly correlated. In this work, we utilized text- and photo-types of location information with a novel approach of information fusion that exploits effective image annotation and location based text-mining approaches to enhance identification of geographic location and spatial cognition. In this paper, we describe our feature extraction methods to annotating images, and utilizing text mining approach to analyze images and texts simultaneously, in order to carry out geospatial text mining and image classification tasks. Subsequently, photo-images and textual documents are projected to a unified feature space, in order to generate a co-constructed semantic space for information fusion. Also, we employed text mining approaches to classify documents into various categories based upon their geospatial features, with the aims to discovering relationships between documents and geographical zones. The experimental results show that the proposed method can effectively enhance the tasks of location based knowledge discovery.

With the increasing number of multilingual texts in the internet, multilingual text retrieval techniques have become an important research issue. However, the discovery of relationships between different languages remains an open problem. In this paper we propose a method, which applies the growing hierarchical self-organizing map (GHSOM) model, to discover knowledge from multilingual text documents. Multilingual parallel corpora were trained by the GHSOM to generate hierarchical feature maps. A discovery process is then applied on these maps to discover the relationships between documents of different languages. The relationships between keywords of different languages are also revealed. We conducted experiments on a set of Chinese—English bilingual parallel corpora to discover the relationships between documents of these languages. We also use such relationships to perform multilingual information retrieval tasks. The experimental results show that our multilingual text mining approach may capture conceptual relationships among documents as well as keywords written in different languages.

Traditional content-based image retrieval (CBIR) systems often fail to meet a user's need due to the 'semantic gap' between the extracted features of the systems and the user's query. The cause of the semantic gap is the failure of extracting real semantics from an image and the query. To extract semantics of images, however, is a difficult task. Most existing techniques apply some predefined semantic categories and assign the images to appropriate categories through some learning processes. Nevertheless, these techniques always need human intervention and rely on content-based features. In this paper we propose a novel approach to bridge the semantic gap which is the major deficiency of CBIR systems. We conquer the deficiency by extracting semantics of an image from the environmental texts around it. Since an image generally co-exists with accompanying texts in various formats, we may rely on such environmental texts to discover the semantics of the image. We apply a text mining process, which adopts the self-organizing map (SOM) learning algorithm as a kernel, on the environmental texts of an image to extract the semantic information from this image. Some implicit semantic information of the images can be discovered after the text mining process. We also define a semantic relevance measure to achieve the semantic-based image retrieval task. We performed experiments on a set of images which are collected from web pages and obtained promising results.

This paper presents an expansible machine learning approach applying the EV big data as the human sensor to extract driving behaviors and driving modes. A pattern recognition approach is proposed to model the driving pattern according to the energy consumption of an EV. The growing hierarchical self-organizing maps (GHSOM) is applied to learn driver's behaviors gradually in the offline process, and the clustered neurons are used as the training sets for implementing online classifiers based on support vector machine (SVM). This proposed framework would facilitate the understanding of driver's behaviors and help drivers overcome range anxiety.

In the manufacturing of semiconductor encapsulation, the production yield is one of critical issues concerned by all foundries. It is because that yield rate can directly affects the quality of the final product and the profitability. In this work we take the defect-products as samples and use machine learning techniques to classify the samples and verify the accuracy and feasibility of the experiment. We use Support Vector Machines (SVM) model to perform classification and compare the resulting accuracy with the results of Back Propagation Neural Network (BPN) model. Furthermore, we employ a statistical method namely Pearson product-moment correlation coefficient to identify the influential factors for production quality. The experimental result demonstrates that our hybrid method has great potentials for yield improvement in semiconductor manufacturing.

Recently research on text mining has attracted lots of attention from both industrial and academic fields. Text mining concerns of discovering unknown patterns or knowledge from a large text repository. The problem is not easy to tackle due to the semi-structured or even unstructured nature of those texts under consideration. Many approaches have been devised for mining various kinds of knowledge from texts. One important aspect of text mining is on automatic text categorization, which assigns a text document to some predefined category if the document falls into the theme of the category. Traditionally the categories are arranged in hierarchical manner to achieve effective searching and indexing as well as easy comprehension for human beings. The determination of category themes and their hierarchical structures were most done by human experts. In this work, we developed an approach to automatically generate category themes and reveal the hierarchical structure among them. We also used the generated structure to categorize text documents. The document collection was trained by a self-organizing map to form two feature maps. These maps were then analyzed to obtain the category themes and their structure. Although the test corpus contains documents written in Chinese, the proposed approach can be applied to documents written in any language and such documents can be transformed into a list of separated terms.

In recent years, the concept of human-in-the-loop has been utilized to support environment sensing. Along with IoT (Internet of Things) and wearable computing technologies, connecting people and devices to the internet provides a significant advantage for real-time emergency management. For development of context-aware applications, it is important to utilize higher-level semantic information, such as human activity, social emotions, and human behaviors for event monitoring. Therefore, human users may become part of sensor networks by using mobile devices and social media to report local information around them. In this work, we mainly focus on the use of social messages spreading by human users to model the real-world events, in order to incorporate human sensors into event contexts for situational awareness. First, our algorithm computes the energy of each collected event messages, and then encapsulates ranked temporal, spatial and topical keywords into a structured node, which could reinforce the alert collected from physical nodes. The experimental results show that the proposed approach is able to extract essential entities of events for incorporating human sensors into event contexts for event prevention and risk management.

In this paper, we describe our work on extracting entities from the online social messages regarding emergent events for ontology learning, which can contribute to a solution for quick response of emerging disastrous events. Our work started with the development of a real-time event detection system using a data-cluster slicing approach which combines social data analysis and early warning algorithms, allowing for quickly detecting emerging large-scale events from collected tweets. Subsequently, our system computes the energy of each collected event dataset, and then encapsulates ranked temporal, spatial and topical keywords into a structured node for event-entity extraction, in order to learn and update event ontologies for fast response of emergent events. The preliminary experimental results demonstrate that our developed system is workable, allowing for prediction of possible evolution for early warning of critical incidents with a dynamic ontology engineering.

Self-organizing map (SOM) algorithm has been applied widely in tasks such as data clustering and visualization. Two major deficiencies of classical SOM are the need of predefined map structure and the lack of hierarchy generation. Several approaches have been devised to tackle these deficiencies. One of our previous works, namely the topic-oriented self-organizing map (TOSOM), tries to remedy the classical SOM by combining topic identification process into the training phase. In this work, we will further expand the learning algorithm of TOSOM by incorporating user's constraints. Both structural and topical constraints which specified by the user could be used to guide the learning process. Preliminary experiments demonstrate improvements over previous algorithm on text categorization task.

The self-organizing map (SOM) model is a well-known neural network model with wide spread of applications. The main characteristics of SOM are two-fold, namely dimension reduction and topology preservation. Using SOM, a high-dimensional data space will be mapped to some low-dimensional space. Meanwhile, the topological relations among data will be preserved. With such characteristics, the SOM was usually applied on data clustering and visualization tasks. One major shortage of classical SOM learning algorithm is the necessity of predefined map topology. Furthermore, hierarchical relationships among data are also difficult to be revealed. In this work, we propose a novel SOM learning algorithm which incorporates several text mining techniques in expanding the map both laterally and hierarchically that could discover the relationships among documents in both perspectives. The proposed algorithm will first cluster a set of training documents using classical SOM algorithm. We then identify the topics of each cluster and use them to evaluate the criteria on expanding the map. We applied the algorithm on medium-size datasets and obtained promising result.

Nowadays lots of information are stored as Web pages for ease of sharing and searching. It is rather impractical for users to browse such gigantic amount of Web pages to obtain target information. Therefore, users often count on search engines to retrieve information they needed. Most of the search engines rely on the contents of Web pages, which are often represented by sets of keywords, to decide their relatedness to a user's query. However, such scheme is often imprecise since there is always a semantic gap between the actual semantics of a Web page and its representation. Manual annotations by human beings will certainly help since such annotations should always reflect the true meaning of the Web pages. However, ordinary annotators may not annotate a Web page with appropriate tags and thus deteriorate the quality of tags as well as the retrieval result. In this work, we propose a novel scheme for recommending tags while a user intends to annotate a Web page. Our scheme first discover the relationships across Web pages and tags based their clustering result. We then recommend tags to users according to such relationships. We tested our work on RSDC 2008 dataset and obtained promising result.

Social networks have been regarded as a timely and cost-effective source of spatio-temporal information for many fields of application. However, while some research groups have successfully developed topic detection methods from the text streams for a while, and even some popular microblogging services such as Twitter did provide information of top trending topics for selection, it is still unable to fully support users pickup all of the real-time event topics with a comprehensive spatio-temporal viewpoint to satisfy their information needs. This paper aims to enhance the understanding on how social networks can be used as a reliable source of spatio-temporal information, by analyzing the temporal and spatial dynamics of Twitter activity. In this work, we developed several algorithms for mining microblogging text stream to obtain real-time and geospatial event information. The goal of our approach is to effectively detecting and grouping emerging topics by making use of real-time messages and geolocation data provided by social network services.

With the continuously increasing needs of location information for users around the world, applications of geospatial information have gained a lot of attention in both research and commercial organizations. Extraction of semantics from the image content for geospatial information seeking and knowledge discovery has been thus becoming a critical process. Unfortunately, the available geographic images may be blurred, either too light or too dark. It is therefore often hard to extract geographic features directly from images. In this paper, we describe our developed methods in applying local scale-invariant features and bag-of-keypoints techniques to annotating images, in order to carry out image categorization and geographic knowledge discovery tasks. First, local scale-invariant features are extracted from geographic images as representative geographic features. Subsequently, the bag-of-keypoints methods are used to construct a visual vocabulary and generate feature vectors to support image categorization and annotation. The annotated images are classified by using geographic nouns. The experimental results show that the proposed approach is sensible and can effectively enhance the tasks of geographic knowledge discovery.

Online microblogging services such as Twitter allow users to post very short messages related to everything ranging from mundane daily life routines to breaking news events. This phenomenon has changed the way for information acquisition. In this paper, we present an instinctive method with a time-decay function which corresponds to the natural propagation of social networks for clustering real-time text streams collected from Twitter. Compared to most previous studies, we follow natural cascading behaviors of event lifecycle to develop a self-adaptive clustering model for online event detection. Also, we construct an expandable similarity matrix which is capable of evaluating microblogging posts with incomplete semantic features. Experimental results show that the proposed method is a sensible solution to monitoring momentous real-time events and utilizing the text streams to facilitate the management of social networking data.

One of the basic human needs is to exchange information and socialize with each other. Online microblogging services such as Twitter allow users to post very short messages related to everything ranging from mundane daily life routines to breaking news events. A key challenging issue of mining such social messages is how to analyze the real-time distributed messages and extract significant features of them in a dynamic environment. In this work, we propose a novel term weighting method, called BursT, using sliding window techniques for weighting message streams. The experimental results show that our weighting technique has an outstanding performance to reflect the shifts of concept drift. The result of this work can be extended to perform a periodic feature extraction, and also be able to integrate other sophisticated clustering methods to enhance the efficiency for real-time event mining in social networks.

Self-organizing map (SOM) learning algorithm has been widely applied in solving various tasks in pattern recognition, machine learning, and data mining, etc. Recently, it has been used to cluster documents and produced reasonable results. Traditional SOM algorithm learns from data using a fixed map. Approaches have been proposed to allow adaptable map structure. In this work, we propose a novel SOM learning algorithm that can expand the map laterally and hierarchically. The adaption of the map structure is based on topics identified from the underlying document clusters. This approach is different from traditional approaches which are typically driven by the data density of clusters. Preliminary experiment result suggested that the proposed algorithm outperforms other similar approaches.

With the increasing needs of location information, applications of geospatial information have gained a lot of attention in both research and commercial organizations Extraction of geospatial knowledge from the information content has been thus becoming a important process Among theses applications, a typical example is to discover relationships between various geospatial texts/data and specific locations In this paper, we describe a location based text mining approach using Artificial Neural Networks (ANN) to classify texts into various categories based on their geospatial features, with the aims to discovering relationships between documents and zones First, the collected documents were mapped to corresponding zones by the Adaptive Affinity Propagation (Adaptive AP) clustering techniques, then we performed framed maximize zones by means of Fuzzy ARTMAP (FAM) and Support Vector Machines (SVM) methods, allowing the results of relationships between documents and zones to be well presented Eventually, we compared our experimental results with that of baseline models using Self-organizing maps (SOM) and Learning Vector Quantization (LVQ) methods The preliminary results show that our platform framework has potential for geospatial knowledge discovery.

In this paper, we describe a location based text mining approach to classify texts into various categories based on their geospatial features, with the aims to discovering relationships between documents and zones. We first mapped documents into corresponding zones by Adaptive Affinity Propagation (Adaptive AP) clustering technique, and then framed maximize zones by means of Simplified Fuzzy ARTMAP (SFAM) and Support Vector Machines (SVM) methods. Also, we compared our experimental results with the baseline approaches of Self-organizing maps (SOM) and Learning Vector Quantization (LVQ) methods. The preliminary results show that our platform framework has the potential for geospatial data mining.

In this paper we describe our work on developing a novel technique for discovery of implicit knowledge about patents from multilingual patent information sources. In this work we developed a system platform to support locating similar and relevant multilingual patent documents. The platform was implemented using a multilingual vector space based on the latent semantic indexing (LSI) model, and utilizing collected professional Chinese-English parallel corpora for training the system model. These multilingual patent documents could then be mapped into the semantic vector space for evaluating their similarity by means of text clustering techniques. The preliminary results show that our platform framework has potential for retrieval and relatedness evaluation of multilingual patent documents.

This paper describes our work on developing a language-independent technique for discovery of implicit knowledge about patents from multilingual patent information ources. Traditional techniques of multi- and cross-language patent retrieval are mostly based on the process of translation. One major problem of those is that it is difficult to find related patents produced from other countries in a stand-alone patent information system. In this paper, we present a novel system platform to support locating similar and relevant multilingual patent documents. The platform is developed using a multilingual vector space based on the latent semantic indexing (LSI) model, and utilizing collected professional Chinese-English parallel corpora for training the system model. These multilingual patent documents can then be mapped into the semantic vector space for evaluating their similarity by means of text clustering techniques. The preliminary results show that our platform framework has potential for retrieval and relatedness evaluation of multilingual patent documents.

Multilingual information retrieval has attracted lots of attention in recent years due to the explosive increase of multilingual Web pages. It will not be easy to retrieve documents written in languages other than the query if the relationships among entities of different languages were not found. In this work, we will develop a method based on self-organizing maps to organize documents into hierarchy. When hierarchies of individual languages are developed, an alignment process is then applied on these hierarchies to discover the associations between entities of different languages. The method had been performed on a set of parallel corpora containing Chinese and English documents and obtained promising result.

The Web pages nowadays were written in various languages including English, Chinese, Spanish, etc. There are increasing needs in searching Web pages of different languages using single query. This task is called multilingual information retrieval (MLIR). However, MLIR is difficult to achieve since we need some kind of method to find the associations between linguistic elements of different languages. In this work, we provide a method based on GHSOM to discover the associations between different languages and apply this method on MLIR task. The experiments show that our method provide a promising approach to tackle MLIR task.

With the increasing amount of multilingual texts in the Internet, multilingual text retrieval techniques have become an important research issue. However, the discovery of relationships between different languages remains an open problem. In this paper we propose a method, which applies the growing hierarchical self- organizing map (GHSOM) model, to discover knowledge from multilingual text documents. Multilingual parallel corpora were trained by the GHSOM to generate hierarchical feature maps. A discovery process is then applied on these maps to discover the relationships between documents of different languages. The relationships between keywords of different languages are also revealed. We conducted experiments on a set of Chinese-English bilingual parallel corpora to discover the relationships between documents of these languages.

Research work related to plagiarism detection methods in dealing with monolingual texts (e.g. English texts) have been well established in recent years. However, little attention has been paid to facilitate plagiarism detection in cross-lingual text collections (e.g. English and Chinese texts). In this paper we present a system platform to evaluating text similarity and relatedness in multilingual text collections for plagiarism detection. First, we utilized a number of selected texts in Chinese-English parallel corpora collected from Internet to train text classifiers based on the Support Vector Machines (SVM) model. As such, the multilingual texts of unknown category can be classified by the trained classifiers. Subsequently, the resulting categorized texts were measured by means of a language-neutral clustering technique based on Self-Organizing Maps (SOM) method for evaluating semantic similarity among texts. The preliminary results show that our platform framework has the potential for cross-lingual text relatedness evaluation and plagiarism detection.

In this paper, we develop a platform framework for categorization of cancer related abstracts using support vector machines (SVMs) based text categorization techniques with a one-against-all (OAA) learning algorithm for classification decisions. The corpora for the work were selected from the Website of PubMed database. By using information derived from PubMed literature source, including topics of breast cancer, cervical cancer, gastric cancer, lung cancer, rectum cancer and esophagus cancer, we randomly selected 6,000 medical abstracts for implementing our system and performing experiments. The experimental results show that the platform model has potentials for categorization of multiple cancer related literature texts.

In this paper we discuss the implementation of the leading supervised and unsupervised approaches for multilingual text categorization. We selected support vector machines (SVM) and latent semantic indexing (LSI) techniques as representatives of supervised and unsupervised methods for system implementation, respectively. The preliminary results show that our platform models including both supervised and unsupervised learning methods have the potentials for multilingual text categorization

The WWW provides an ultimate source of information for all kinds of knowledge in various kinds of languages. There are emerging needs for searching documents in different languages, causing multilingual information retrieval an active research topic recently. The performance of such task depends on the degree of understanding for the relationships between different languages. Multilingual text mining aims at discovering interesting relationships between different languages. In this work, we applied the growing hierarchical self-organizing map model to cluster multilingual text documents and find the relationships between two languages. We use a set of parallel corpora to train the map and apply a discovering process to identify the semantic groups and hierarchical structures of keywords for these languages. The discovered knowledge can then be applied to tasks such as multilingual information retrieval and automatic multilingual thesaurus construction.

Latent Semantic Indexing is a well known technique in Information Retrieval, especially in dealing with polysemy and synonymy. LSI use SVD process to decompose the original term-document matrix into a lower dimension triplet. The triplet (the resulted matrices) is the approximation to original matrix and can capture the latent semantic relation between terms. In this paper, we propose a novel method for multilingual text categorization using Latent Semantic Indexing. The centroid of each class has been calculated in the decomposed SVD space. The similarity threshold of categorization is predefined for each centroid. Test documents with similarity measurement larger than the threshold will be labeled "Positive" (Relevant) or else would be labeled "Negative" (Non-Relevant). Experimental result indicated that the performance on the precision, recall and F1 are quite good using LSI technique to categorize the multi-language text. The F1 measurement has an average value of 70% and the precision can reach 80% using our algorithm.

One major approach for information finding in the WWW is to navigate through some web directories and browse them for the goal pages. However, such directories are generally constructed manually and have disadvantages of narrow coverage and inconsistency. In this work, we propose NaviSOM, a machine learning approach to automatically construct a navigational structure for the WWW. A self-organizing map is constructed to train the web pages and obtain two feature maps, which reveal the relationships among web pages and thematic keywords respectively. We then use these maps to develop a structure that may assist the users finding the information they need. We used a small set of web pages in the experiments and obtained promising result.

The quantification of evaluating semantic relatedness among texts has been a challenging issue that pervades much of machine learning and natural language processing. This paper presents a hybrid approach of a text-mining technique for measuring semantic relatedness among texts. In this work we develop several text classifiers using support vector machines (SVM) method to supporting acquisition of relatedness among texts. First, we utilized our developed text mining algorithms, including text mining techniques based on classification of texts in several text collections. After that, we employ various SVM classifiers to deal with evaluation of relatedness of the target documents. The results indicate that this approach can also be fitted to other research work, such as information filtering, and recategorizing resulting documents of search engine queries.

The World Wide Web (WWW) has been recognized as the ultimate and unique source of information for information retrieval and knowledge discovery communities. Tremendous amount of knowledge are recorded using various types of media, producing enormous amount of web pages in the WWW. Retrieval of required information from the WWW is thus an arduous task. Different schemes for retrieving web pages have been used by the WWW community. One of the most widely used scheme is to traverse predefined web directories to reach a user's goal. These web directories are compiled or classified folders of web pages and are usually organized into hierarchical structures. The classification of web pages into proper directories and the organization of directory hierarchies are generally performed by human experts. In this work, we provide a corpus-based method that applies a kind of text mining techniques on a corpus of web pages to automatically create web directories and organize them into hierarchies. The method is based on the self-organizing map learning algorithm and requires no human intervention during the construction of web directories and hierarchies. The experiments show that our method can produce comprehensible and reasonable web directories and hierarchies.

This paper describes a new application of a text-mining algorithm to the text sources of bilingual corpora. In the past, the majority of the approaches applied to measuring semantic relatedness was based on edge counting methods through a semantic network, such as WordNet. It is not well suited for applications in specific domains in which the standard lexical knowledge bases are not available. In this work, we propose an alternative solution for acquisition of semantic relatedness from text corpora by means of a machine learning technique, namely the self-organizing maps. This paper presents a hybrid approach to discovering a concept-based feature map containing word clusters and document clusters from multilingual text collections. Using SOM-based automatic clustering techniques, we have conducted several experiments to uncover associated documents based on Chinese-English bilingual parallel corpora, and a hybrid Chinese-English corpus. In essence, this work provides a method for automatic text clustering, which resolves some of the language difficulties in concept discovery and categorization from multilingual text corpora.

In this paper we propose a novel method to bridge the 'semantic gap' between a user's information need and the image content. The semantic gap describes the major deficiency of content-based image retrieval (CBIR) systems which use visual features extracted from images to describe the images. We conquer the deficiency by extracting semantic of an image from the environmental texts around it. Since an image generally co-exists with accompany texts in various formats, we may rely on such environmental texts to discover the semantic of the image. A text mining approach based on self-organizing maps is used to extract the semantic of an image from its environmental texts. We performed experiments on a small set of images and obtained promising results.

Recently, many approaches have been devised for mining various kinds of knowledge from texts. One important application of text mining is to identify themes and the semantic relations among these themes for text categorization. Traditionally, these themes were arranged in a hierarchical manner to achieve effective searching and indexing as well as easy comprehension for human beings. The determination of category themes and their hierarchical structures was mostly done by human experts. In this work, we developed an approach to automatically generate category themes and reveal the hierarchical structure among them. We also used the generated structure to categorize text documents. The document collection was trained by a self-organizing map to form two feature maps. We then analyzed these maps and obtained the category themes and their structure. Although the test corpus contains documents written in Chinese, the proposed approach can be applied to documents written in any language, and such documents can be transformed into a list of separated terms.

In this paper we propose a novel method to discover the semantics of an image within a web page and bridge the semantic gap between the image features and a user’s query. Since an image is always accompanied with some text segments which are closely related to the image, we propose that the semantics of the image may be discovered from such text segments through a data mining process on these texts. Based on such recognition, we applied a text mining process on the accompany texts of an image to discover the themes of this image, which constitute the semantics of this image. The self-organizing map algorithm is first applied to cluster a set of preprocessed web pages. Based on the clustering result, we design a theme identification process to identify a set of words which constitute the semantics of an image. We performed experiments on a small set of images and obtained promising results.

The paper describes a new application of a text-mining algorithm to the text sources of bilingual parallel corpora. The ultimate task, being undertaken in the context of a Chinese-English machine translation project, will be to develop a language-neutral method to discover similar documents from multilingual text collections. Using a variation of automatic clustering techniques which apply a neural net approach, namely the self-organizing maps (SOM), we have conducted several experiments to uncover associated documents based on Chinese-English bilingual parallel corpora, and a hybrid Chinese-English corpus. The experiments show some interesting results and a couple of potential ways for future work towards the field of multilingual information discovery. In addition, for exploring the impacts on linguistic issues with the machine learning approach to mining sensible linguistics elements from multilingual texts, we have examined the resulting term associations and text associations from the view of cross-lingual text similarity. To evaluate semantic relatedness of the mined bilingual texts, we applied a measure technique of semantic similarity in the resulting bilingual document clusters and word clusters. The paper presents algorithms that enable multilingual text mining based on the self-organizing map (SOM) for automatically grouping similar multilingual texts (i.e. Chinese and English texts), along with a means of measuring their semantic similarity to resolve the difficulties of syntactic and semantic ambiguity in multilingual information access.

Discusses current work using an adaptive learning algorithm to dynamically create the content of an e-commerce search engine so that the implicit knowledge extracted by the Web text mining module can be provided in the B2B (business-to-business) portal. In this paper, we develop an algorithmic approach for automatically discovering implicit customer knowledge from the Internet by means of a Web mining method. Using a variation of the automatic thesaurus generation techniques, namely the self-organizing map (SOM) neural net, we have conducted several experiments in a specific domain in which we created a functional thesaurus of numerous supplier- and product-specific terms. Further, we applied such a thesaurus in a topic hierarchy-based text database, as an organized text source of a search engine for a novel B2B e-commerce portal.

The maintenance cost is a critical issue for the success of integrating database and information retrieval systems (IRS). For a robust integration of search engines, the signature file filter can effectively eliminate the maintenance cost and offer a more natural fit between the database and text retrieval systems. Extending the usability of merged database and signature based text-retrieval systems by building on an object-oriented database management system (OODBMS) provides better and complementary advantages to both databases and information retrieval systems (IRSs). In this paper, we present a new approach for integrating OODBMSs and IRSs that maintains the flexibility and avoids overheads of mapping process, by means of encapsulating the documents and signature based IR methods into storable objects which are being stored in the database. In addition, we develop a novel signature file approach based on a statistical corpus extraction technique, which can effectively reduce false drop probability for text retrieval from the underneath document database.

Extending the usability of merged database and text-retrieval systems by building on an object-oriented database management system (OODBMS) can offer better and complementary advantages to both database and information retrieval systems (IRS). In this paper, we present a new approach for integrating OODBMSs and IRSs that maintains the flexibility and avoids overheads of mapping process, by means of wrapping the documents and encapsulating signature based IR methods into storable objects which are being stored in the database. In particular, we demonstrate how to apply such an integration approach to a special problem domain: a multi-lingual information retrieval system. In our framework, a sound platform and query facilities offered by the underlying object-oriented database can further enhance the original IR functions and be applicable to the construction of multimedia-document based digital libraries.