Search

Recently, recommender systems for various types of resource received lots of attention due to the need for finding interesting resources from gigantic body such as World Wide Web or social network services. An emerging branch of recommender systems tried to recommend resources to users according to their personality traits and received promising results. In this work, we proposed an approach on recommending computer games to players according to their identified personality traits. We first applied text mining processes on some textual contents related to the players to identify their personality traits using the Five Factor Model. The same personality recognition process was also applied on contents related to games. The games with similar personality traits to the players’ were then recommended to the players. We performed experiments on 63 players and 2050 games with data collected from Steam and obtained satisfying result.

Introduction Predicting the sentiments and emotions of people from their texts is a critical issue in cognitive computing. The explosive growth of social network services has led to a tremendous increase of textual data, increasing the demand of the advanced analysis of these data. Sentiment analysis on textual social media data emerged in recent years to fulfill the needs of areas such as national security, business, politics, and economics; however, text messages from social networks are rather different from those of traditional text documents, especially in presentation style and lengths. Therefore, it is difficult but essential to develop an effective method to explore the sentiments of social messages. Methods In this study, we first applied a self-organizing map (SOM) algorithm to cluster social messages as well as sentiment keywords. An association discovery process was then applied to discover the associations between a message and some sentiment keywords, and the sentiment of a message was determined according to such associations. Results We performed experiments on collected Twitter messages and the results’ accuracy outperformed that of a similar approach. Conclusions A sentiment analysis approach based on SOMs was proposed. The associations between messages and keywords were derived using the proposed method. The novelty of this work arises from the adoption of association discovery process in sentiment analysis.

Graphical abstractThis work proposes a scheme to improve the self-organizing map algorithm. This is the overall flowchart of the proposed algorithm. The key ingredients include:1.A novel topic identification scheme.2.Lateral expansion using novel topic incompatibility measure.3.Hierarchical expansion scheme using novel cluster size and topic size criteria.Display Omitted HighlightsIncorporation of topic identification into SOM learning could be beneficial to text categorization task.Both lateral and hierarchical expansion during SOM learning were achieved according to criteria based on identified topics.The produced text hierarchies outperformed contemporary approaches in quality and performance on text categorization. Self-organizing maps (SOM) have been applied on numerous data clustering and visualization tasks and received much attention on their success. One major shortage of classical SOM learning algorithm is the necessity of predefined map topology. Furthermore, hierarchical relationships among data are also difficult to be found. Several approaches have been devised to conquer these deficiencies. In this work, we propose a novel SOM learning algorithm which incorporates several text mining techniques in expanding the map both laterally and hierarchically. On training a set of text documents, the proposed algorithm will first cluster them using classical SOM algorithm. We then identify the topics of each cluster. These topics are then used to evaluate the criteria on expanding the map. The major characteristic of the proposed approach is to combine the learning process with text mining process and makes it suitable for automatic organization of text documents. We applied the algorithm on the Reuters-21578 dataset in text clustering and categorization tasks. Our method outperforms two comparing models in hierarchy quality according to users' evaluation. It also receives better F1-scores than two other models in text categorization task.

Recommender systems have emergedrecently in many aspects due to enormous amount of information or items existed in e-commerce or social network services. Users find it convenient if the service can recommend interesting items to them automatically. Past systems adopted users' preference or social connections for such recommendation. In this work, we will try to identify a game player's personality traits and use them to recommend games that may be interested by the player. The personality traits of a player is identified by applying a text mining process on textual contents related to the player. The same process is also applied on the comments of the games to identified the personality traits of games. Recommendation is then performed based on the similarity between the traits of the user and the game. We performed experiments on 63 players and 2050 games and obtained promising results which may demonstrate the plausibility of personality-based recommender systems.

Social bookmarking Websites are popular nowadays for they provide platforms that are easy and clear to browse and organize Web pages. Users can add tags on Web pages to allow easy comprehension and retrieval of Web pages. However, tag spams could also be added to promote the opportunity of being referenced of a Web page, which is troublesome to users for accessing uninterested Web pages. In this work, we proposed a scheme to automatically detect such tag spams using a proposed text mining approach based on self-organizing map (SOM) model. We used SOM to find the associations among Web pages as well as tags. Such associations were then used to discover the relationships between Web pages and tags. Tag spams can then be detected according to such relationships. Experiments were conducted on a set of Web pages collected from a social bookmarking site and obtained promising result.

Open election data is an emerged domain in open data for it reflects the maturity of governance and democracy. On this regard, a standardized approach for building open election data will significantly reduce the time and effort for publishing election data to the public for easy access. In this work, we will develop an initial step for building open election data, namely building election data model. The procedure and preliminary result of such task on Taiwan's election data will be described. We believe the process on building election data model could be beneficial to other authorities which intend to publicize their election data.

Nowadays most of the Web pages contain little amount of structure and supporting information that can reveal their semantics or meanings. To enable automated processing of the Web pages, semantic information such as metadata and tags regarding to each page should be added to it. Several authoring tools have been developed to help users tackling this task. However, manual or semi-automatic authoring is implausible when we intend to annotate large amount of Web pages. In this work, we proposed a method to automatically generate some descriptive metadata and tags for a Web page. The idea is to apply the self-organizing map algorithm to cluster the Web pages and discover the relationships between these clusters. In the mean time, the themes of each cluster are also identified. We then use such relationships and themes to tag the Web pages and generate metadata for the Web pages. The result of experiments shows that our method may generate semantically relevant metadata and tags for the Web pages.

With the increasing number of multilingual texts in the internet, multilingual text retrieval techniques have become an important research issue. However, the discovery of relationships between different languages remains an open problem. In this paper we propose a method, which applies the growing hierarchical self-organizing map (GHSOM) model, to discover knowledge from multilingual text documents. Multilingual parallel corpora were trained by the GHSOM to generate hierarchical feature maps. A discovery process is then applied on these maps to discover the relationships between documents of different languages. The relationships between keywords of different languages are also revealed. We conducted experiments on a set of Chinese—English bilingual parallel corpora to discover the relationships between documents of these languages. We also use such relationships to perform multilingual information retrieval tasks. The experimental results show that our multilingual text mining approach may capture conceptual relationships among documents as well as keywords written in different languages.

Traditional content-based image retrieval (CBIR) systems often fail to meet a user's need due to the 'semantic gap' between the extracted features of the systems and the user's query. The cause of the semantic gap is the failure of extracting real semantics from an image and the query. To extract semantics of images, however, is a difficult task. Most existing techniques apply some predefined semantic categories and assign the images to appropriate categories through some learning processes. Nevertheless, these techniques always need human intervention and rely on content-based features. In this paper we propose a novel approach to bridge the semantic gap which is the major deficiency of CBIR systems. We conquer the deficiency by extracting semantics of an image from the environmental texts around it. Since an image generally co-exists with accompanying texts in various formats, we may rely on such environmental texts to discover the semantics of the image. We apply a text mining process, which adopts the self-organizing map (SOM) learning algorithm as a kernel, on the environmental texts of an image to extract the semantic information from this image. Some implicit semantic information of the images can be discovered after the text mining process. We also define a semantic relevance measure to achieve the semantic-based image retrieval task. We performed experiments on a set of images which are collected from web pages and obtained promising results.

In the manufacturing of semiconductor encapsulation, the production yield is one of critical issues concerned by all foundries. It is because that yield rate can directly affects the quality of the final product and the profitability. In this work we take the defect-products as samples and use machine learning techniques to classify the samples and verify the accuracy and feasibility of the experiment. We use Support Vector Machines (SVM) model to perform classification and compare the resulting accuracy with the results of Back Propagation Neural Network (BPN) model. Furthermore, we employ a statistical method namely Pearson product-moment correlation coefficient to identify the influential factors for production quality. The experimental result demonstrates that our hybrid method has great potentials for yield improvement in semiconductor manufacturing.

In this work, an "analytical data model of mosquito vector" was developed to perform analytical computation to the character of the dengue vectors. Our goal is to investigate a way to understand how the temporal trend of collected dataset correlates with the incidence dengue as identified by national health authorities. Based upon the mosquito-vector big data collections, we investigate how changes in some specific variables such as rainfall, temperature, and humidity can dramatically affect the population of mosquito vectors, in order to provide early warnings of dengue outbreaks. Thus, our system will collectively collect online sensing data of the variables and store them in a database, in order to combine the historical big data as training datasets for analytical computation. Also, the developed model is able to merge the experimental datasets with current hot-topic information which is relevant to mosquito vectors obtained from data of social sensors (i.e. social messages). The experimental data show that our system is of great potentials in providing early warnings of dengue outbreaks.

The research on automatic hypertext construction emerges rapidly in the last decade because there exists a urgent need to translate the gigantic amount of legacy documents into web pages. Unlike traditional 'flat' texts, a hypertext contains a number of navigational hyperlinks that point to some related hypertexts or locations of the same hypertext. Traditionally, these hyperlinks were constructed by the creators of the web pages with or without the help of some authoring tools. However, the gigantic amount of documents produced each day prevent from such manual construction. Thus an automatic hypertext construction method is necessary for content providers to efficiently produce adequate information that can be used by web surfers. Although most of the web pages contain a number of non-textual data such as images, sounds, and video clips, text data still contribute the major part of information about the pages. Therefore, it is not surprising that most of automatic hypertext construction methods inherit from traditional information retrieval research. In this work, we will propose a new automatic hypertext construction method based on a text mining approach. Our method applies the self-organizing map algorithm to cluster some at text documents in a training corpus and generate two maps. We then use these maps to identify the sources and destinations of some important hyperlinks within these training documents. The constructed hyperlinks are then inserted into the training documents to translate them into hypertext form. Such translated documents will form the new corpus. Incoming documents can also be translated into hypertext form and added to the corpus through the same approach. Our method had been tested on a set of at text documents collected from a newswire site. Although we only use Chinese text documents, our approach can be applied to any documents that can be transformed to a set of index terms.

Recently research on text mining has attracted lots of attention from both industrial and academic fields. Text mining concerns of discovering unknown patterns or knowledge from a large text repository. The problem is not easy to tackle due to the semi-structured or even unstructured nature of those texts under consideration. Many approaches have been devised for mining various kinds of knowledge from texts. One important aspect of text mining is on automatic text categorization, which assigns a text document to some predefined category if the document falls into the theme of the category. Traditionally the categories are arranged in hierarchical manner to achieve effective searching and indexing as well as easy comprehension for human beings. The determination of category themes and their hierarchical structures were most done by human experts. In this work, we developed an approach to automatically generate category themes and reveal the hierarchical structure among them. We also used the generated structure to categorize text documents. The document collection was trained by a self-organizing map to form two feature maps. These maps were then analyzed to obtain the category themes and their structure. Although the test corpus contains documents written in Chinese, the proposed approach can be applied to documents written in any language and such documents can be transformed into a list of separated terms.

This paper describes our work on developing a language-independent technique for discovery of implicit knowledge from multilingual information sources. Text mining has been gaining popularity in the knowledge discovery field, particularity with the increasing availability of digital documents in various languages from all around the world. However, currently most text mining tools mainly focus only on processing monolingual documents (particularly English documents): little attention has been paid to apply the techniques to handle the documents in Asian languages, and further extend the mining algorithms to support the aspects of multilingual information sources. In this work, we attempt to develop a language-neutral method to tackle the linguistics difficulties in the text mining process. Using a variation of automatic clustering techniques, which apply a neural net approach, namely the Self-Organizing Maps (SOM), we have conducted several experiments to uncover associated documents based on a Chinese corpus, Chinese-English bilingual parallel corpora, and a hybrid Chinese-English corpus. The experiments show some interesting results and a couple of potential paths for future work in the field of multilingual information discovery. Besides, this work is expected to act as a starting point for exploring the impacts on linguistics issues with the machine-learning approach to mining sensible linguistics elements from multilingual text collections.

Open data has emerged to be a hot topic recently and attracted lots of attention from both researchers and practitioners. Many governments around the world are publishing government open data for public well-being, information disclosure, service innovation, and so on. Enormous amount of data and applications have been released and built in recent years. In accordance to such trend, authorities of Taiwan government are also striving to establish platforms for users to access and employ open data. However, the status and usage of these platforms are still unclear. This study conducts an exploratory investigation on the open data platforms in Taiwan to reveal their feasibility. Besides, we also try to assess the data quality of these platforms by examining medical facilities datasets published in these platforms. We hope that this research can provide a step stone for building better open datasets as well as platforms in Taiwan.

Proceedings from the 2013 LTEC conference in Kaohsiung, Taiwan. The papers examine diverse aspects of Learning Technology for Education in Cloud environments, including social, technical and infrastructure implications. Also addressed is the question of how cloud computing can be used to design applications to support real time on demand learning using technologies. The workshop proceedings provide opportunities for delegates to discuss the latest research in TEL (Technology Enhanced Learning) and its impacts for learners and institutions, using cloud technologies.

A structural-feature-to-structural-feature configuration is naturally constructed using a set of sampled features from a cursive pattern. These features are sampled by maximally fitting bent ellipses in local strokes. This configuration is transformed into an undirected graph to resolve the asymmetric difficulty. The compatibility associated with the graph is further formulated into a devised Hopfield network, where both interfeature and interlink similarities are incorporated into the compatibility. We operate this network to recognize a radical as a whole in a handprinted pattern to accomplish the selective attention task.

In this paper, we describe our work on extracting entities from the online social messages regarding emergent events for ontology learning, which can contribute to a solution for quick response of emerging disastrous events. Our work started with the development of a real-time event detection system using a data-cluster slicing approach which combines social data analysis and early warning algorithms, allowing for quickly detecting emerging large-scale events from collected tweets. Subsequently, our system computes the energy of each collected event dataset, and then encapsulates ranked temporal, spatial and topical keywords into a structured node for event-entity extraction, in order to learn and update event ontologies for fast response of emergent events. The preliminary experimental results demonstrate that our developed system is workable, allowing for prediction of possible evolution for early warning of critical incidents with a dynamic ontology engineering.

Self-organizing map (SOM) algorithm has been applied widely in tasks such as data clustering and visualization. Two major deficiencies of classical SOM are the need of predefined map structure and the lack of hierarchy generation. Several approaches have been devised to tackle these deficiencies. One of our previous works, namely the topic-oriented self-organizing map (TOSOM), tries to remedy the classical SOM by combining topic identification process into the training phase. In this work, we will further expand the learning algorithm of TOSOM by incorporating user's constraints. Both structural and topical constraints which specified by the user could be used to guide the learning process. Preliminary experiments demonstrate improvements over previous algorithm on text categorization task.

Nowadays, crowdsourcing has emerged as a popular and important problem-solving approach. The major difference between crowdsourcing and traditional outsourcing lies on the people which tasks were outsourced. Those people involved in crowdsourcing are generally varied in knowledge, demographic properties, and number. Many applications and services have been developed to solve various types of tasks. However, these applications and services focus on providing platforms for outsourcing to the crowd. Little has been addressed so far on the management and usage of those information produced during the crowdsourcing process. Actually, as an emerging social network application and service, the data and social interactions created during crowdsourcing should carry important and valuable knowledge. This knowledge will develop various techniques for mining messages and information of crowdsourcing process. In this work, we address several approaches to discover useful knowledge from data created for and in crowdsourcing process. We hope the outcome of this research could help discovering usable knowledge from such emerging social network services and bring benefit in constructing crowdsourcing services.

These papers on Intelligent Data Analysis and Management (IDAM) examine issues related to the research and applications of Artificial Intelligence techniques in data analysis and management across a variety of disciplines. The papers derive from the 2013 IDAM conference in Kaohsiung ,Taiwan. It is an interdisciplinary research field involving academic researchers in information technologies, computer science, public policy, bioinformatics, medical informatics, and social and behavior studies, etc. The techniques studied include (but are not limited to): data visualization, data pre-processing, data engineering, database mining techniques, tools and applications, evolutionary algorithms, machine learning, neural nets, fuzzy logic, statistical pattern recognition, knowledge filtering, and post-processing, etc.

In this work we utilize the social messages to construct an extensible event ontology model for learning the experiences and knowledge to cope with emerging real-world events. We develop a platform combining several text mining and social analysis algorithms to cooperate with our stream mining approach to detecting large-scale disastrous events from social messages, in order to achieve the aim of automatically constructing event ontology for emergency response First, we employ the developed event detection technique on Twitter social-messages to monitor the occurrence of emerging events, and record the development and evolution of detected events. Furthermore, we store the messages associated with the detected events in a repository. Through the developed algorithms for analyzing the content of social messages and ontology construction the event ontology can be established, allowing for developing relevant applications for prediction of possible evolution and impact evaluation of the events in the future immediately, in order to achieve the goals for early warning of disasters and risk management.

In this work we present a self-organization matching approach to accomplish the recognition of handprinted characters drawn with thick strokes. This approach is used to flex the unknown handprinted character toward matching its object characters gradually. The extracted character features used in the self-organization matching are center loci, orientation, and major axes of ellipses which fit the inked area of the patterns. Simulations provide encouraging results using the proposed method.

The self-organizing map (SOM) model is a well-known neural network model with wide spread of applications. The main characteristics of SOM are two-fold, namely dimension reduction and topology preservation. Using SOM, a high-dimensional data space will be mapped to some low-dimensional space. Meanwhile, the topological relations among data will be preserved. With such characteristics, the SOM was usually applied on data clustering and visualization tasks. One major shortage of classical SOM learning algorithm is the necessity of predefined map topology. Furthermore, hierarchical relationships among data are also difficult to be revealed. In this work, we propose a novel SOM learning algorithm which incorporates several text mining techniques in expanding the map both laterally and hierarchically that could discover the relationships among documents in both perspectives. The proposed algorithm will first cluster a set of training documents using classical SOM algorithm. We then identify the topics of each cluster and use them to evaluate the criteria on expanding the map. We applied the algorithm on medium-size datasets and obtained promising result.

Intelligence collection and analysis always play a major role in a company's growth. Traditional intelligence management process was most concealed and required massive human effort. It also has the disadvantages of rarity and danger. Therefore open source intelligence (OSINT) emerged as a major intelligence collection and analysis approach. Differing from traditional approach, the sources of OSINT are publicly accessible and have the properties of openness and massiveness which may result in disadvantages of inconsistency and lack of validation. For now, most of the OSINT processing is conducted manually which requires massive human effort and time cost. Automatic processing of OSINT is then unavoidable for modern applications. Although there exists software services to aid such automatic processing, the functionality and degree of automation are still immature and limited. In this work we developed an automatic processing approach for OSINT based on proposed text mining techniques. This approach may automatically identify interesting events from various aspects from which business could benefit. The major contribution of this work is that we have developed high-order mining techniques for OSINT, which will benefit domains like national security, personal knowledge management, business intelligence, e-learning, etc.

The “microblogs” archives keep a valuable collection of records for past disastrous events and related stories. To learn the experiences from past microblogging messages for coping with emerging real-world events, in this work we utilize the social-media messages to characterize events for relatedness analysis. First, we established an online clustering algorithm to detect burstiness on Twitter microblogs for monitoring large-scale events. Furthermore, we compared the features extracted from the on-going event with the ones of other past detected events. Through the developed algorithms for computing event relatedness the ranking of related events can be sorted, allowing for predicting possible evolution and impacts of the event. For performing event clustering and relatedness computation, in this work we have developed an online system platform that can immediately evaluate the significantly emergent events to achieve the goals of real-time discovery of disastrous information and early warning for crisis management.

Nowadays lots of information are stored as Web pages for ease of sharing and searching. It is rather impractical for users to browse such gigantic amount of Web pages to obtain target information. Therefore, users often count on search engines to retrieve information they needed. Most of the search engines rely on the contents of Web pages, which are often represented by sets of keywords, to decide their relatedness to a user's query. However, such scheme is often imprecise since there is always a semantic gap between the actual semantics of a Web page and its representation. Manual annotations by human beings will certainly help since such annotations should always reflect the true meaning of the Web pages. However, ordinary annotators may not annotate a Web page with appropriate tags and thus deteriorate the quality of tags as well as the retrieval result. In this work, we propose a novel scheme for recommending tags while a user intends to annotate a Web page. Our scheme first discover the relationships across Web pages and tags based their clustering result. We then recommend tags to users according to such relationships. We tested our work on RSDC 2008 dataset and obtained promising result.

Social networks have been regarded as a timely and cost-effective source of spatio-temporal information for many fields of application. However, while some research groups have successfully developed topic detection methods from the text streams for a while, and even some popular microblogging services such as Twitter did provide information of top trending topics for selection, it is still unable to fully support users pickup all of the real-time event topics with a comprehensive spatio-temporal viewpoint to satisfy their information needs. This paper aims to enhance the understanding on how social networks can be used as a reliable source of spatio-temporal information, by analyzing the temporal and spatial dynamics of Twitter activity. In this work, we developed several algorithms for mining microblogging text stream to obtain real-time and geospatial event information. The goal of our approach is to effectively detecting and grouping emerging topics by making use of real-time messages and geolocation data provided by social network services.

Social book marking Web sites have emerged recently for collecting and sharing of interesting Web sites among users. People can add Web pages to such sites as bookmarks and allow themselves as well as others to manipulate them. One of the key features of the social book marking sites is the ability of annotating a Web page when it is being bookmarked. The annotation usually contains a set of words or phrases, which are collectively known as tags, that could reveal the semantics of the annotated Web page. Efficient and effective search of Web pages can then be achieved via such tags. However, spam tags that are irrelevant to the content of Web pages often appear to deceive other users for malicious or commercial purposes. Various techniques have been devised to tackle such tag spam detection problem. Most of these techniques were able to detect a user that always annotate spam tags. However, finer levels of detection are seldom discussed. In this work, we will propose a method based on a text mining approach to discover the relations between Web pages and there tag posts. These relations are then used to compute the similarity between a Web page and its tag post to decide if it is a spam post. Preliminary experiments show that the accuracy of the post-level spam detection task is 83%.

With the continuously increasing needs of location information for users around the world, applications of geospatial information have gained a lot of attention in both research and commercial organizations. Extraction of semantics from the image content for geospatial information seeking and knowledge discovery has been thus becoming a critical process. Unfortunately, the available geographic images may be blurred, either too light or too dark. It is therefore often hard to extract geographic features directly from images. In this paper, we describe our developed methods in applying local scale-invariant features and bag-of-keypoints techniques to annotating images, in order to carry out image categorization and geographic knowledge discovery tasks. First, local scale-invariant features are extracted from geographic images as representative geographic features. Subsequently, the bag-of-keypoints methods are used to construct a visual vocabulary and generate feature vectors to support image categorization and annotation. The annotated images are classified by using geographic nouns. The experimental results show that the proposed approach is sensible and can effectively enhance the tasks of geographic knowledge discovery.

Social tags are annotations for Web pages collaboratively added by users. It will be much easier to understand the meaning of Web pages and classify them according to their tags. The precision in retrieving Web pages may also increase using such tags. Nowadays social tags are mostly annotated manually by users via social bookmarking Web sites. Such manual annotation process may produce diverse, redundant, and inconsistent tags. Besides, many tags which are inconsistent with their annotated Web pages exist and deteriorate the feasibility of social tags. In this work we will develop an automatic scheme to discover the associations between Web pages and social tags and apply such associations on applications of social tag spam detection. We applied a text mining approach based on self-organizing maps to find the relationships between Web pages and social tags. The disadvantages of manual annotation will be remedied through such relationships. The discovered associations were then used to identify social tag spams. Preliminary experiments show that the quality and usability of social tags were improved through this method.

Self-organizing map (SOM) learning algorithm has been widely applied in solving various tasks in pattern recognition, machine learning, and data mining, etc. Recently, it has been used to cluster documents and produced reasonable results. Traditional SOM algorithm learns from data using a fixed map. Approaches have been proposed to allow adaptable map structure. In this work, we propose a novel SOM learning algorithm that can expand the map laterally and hierarchically. The adaption of the map structure is based on topics identified from the underlying document clusters. This approach is different from traditional approaches which are typically driven by the data density of clusters. Preliminary experiment result suggested that the proposed algorithm outperforms other similar approaches.

With the increasing needs of location information, applications of geospatial information have gained a lot of attention in both research and commercial organizations Extraction of geospatial knowledge from the information content has been thus becoming a important process Among theses applications, a typical example is to discover relationships between various geospatial texts/data and specific locations In this paper, we describe a location based text mining approach using Artificial Neural Networks (ANN) to classify texts into various categories based on their geospatial features, with the aims to discovering relationships between documents and zones First, the collected documents were mapped to corresponding zones by the Adaptive Affinity Propagation (Adaptive AP) clustering techniques, then we performed framed maximize zones by means of Fuzzy ARTMAP (FAM) and Support Vector Machines (SVM) methods, allowing the results of relationships between documents and zones to be well presented Eventually, we compared our experimental results with that of baseline models using Self-organizing maps (SOM) and Learning Vector Quantization (LVQ) methods The preliminary results show that our platform framework has potential for geospatial knowledge discovery.

In this paper, we describe a location based text mining approach to classify texts into various categories based on their geospatial features, with the aims to discovering relationships between documents and zones. We first mapped documents into corresponding zones by Adaptive Affinity Propagation (Adaptive AP) clustering technique, and then framed maximize zones by means of Simplified Fuzzy ARTMAP (SFAM) and Support Vector Machines (SVM) methods. Also, we compared our experimental results with the baseline approaches of Self-organizing maps (SOM) and Learning Vector Quantization (LVQ) methods. The preliminary results show that our platform framework has the potential for geospatial data mining.

Due to the improvement of digital image technology and increasing amount of digital image data, the issue of automatic image annotation technology and applications becomes more and more important. In order to retrieval image efficiently, it is important to extract and represent the semantics of images. Traditional image semantics extraction and representation schemes were commonly divided into two categories, namely visual features and text annotations. However, visual feature scheme are difficult to extract and are often semantically inconsistent. On the other hand, the image semantics can be well represented by text annotations. It is also easier to retrieve images according to their annotations. The problem is annotating images are always time-consuming and requiring lots of human effort. In this thesis, we try to develop an automatic image annotation method. We adopted the Growing Hierarchical Self-Organizing Map (GHSOM) to help us discover the concealed relations between image data and annotation data, and annotate image according to such relations. We first applied GHSOM to cluster and generate hierarchies for images and annotations individually. We then proposed a hierarchical mapping method to discover the relations between image clusters and annotation clusters. New images can be annotated according to such relations. We conducted experiments using the proposed method on an image dataset and obtained promising result, which showed that our method could be plausible.

In this paper we describe our work on developing a novel technique for discovery of implicit knowledge about patents from multilingual patent information sources. In this work we developed a system platform to support locating similar and relevant multilingual patent documents. The platform was implemented using a multilingual vector space based on the latent semantic indexing (LSI) model, and utilizing collected professional Chinese-English parallel corpora for training the system model. These multilingual patent documents could then be mapped into the semantic vector space for evaluating their similarity by means of text clustering techniques. The preliminary results show that our platform framework has potential for retrieval and relatedness evaluation of multilingual patent documents.

This paper describes our work on developing a language-independent technique for discovery of implicit knowledge about patents from multilingual patent information ources. Traditional techniques of multi- and cross-language patent retrieval are mostly based on the process of translation. One major problem of those is that it is difficult to find related patents produced from other countries in a stand-alone patent information system. In this paper, we present a novel system platform to support locating similar and relevant multilingual patent documents. The platform is developed using a multilingual vector space based on the latent semantic indexing (LSI) model, and utilizing collected professional Chinese-English parallel corpora for training the system model. These multilingual patent documents can then be mapped into the semantic vector space for evaluating their similarity by means of text clustering techniques. The preliminary results show that our platform framework has potential for retrieval and relatedness evaluation of multilingual patent documents.

Web directories cluster Web pages into categories and usually organize them into hierarchies. Many users used them to browse for interesting Web pages in a coarse-to-fine manner. Nowadays most of the Web directories access monolingual Web pages and provide only monolingual interface which may limit the coverage and accessibility of Web pages for users familiar only with their native languages. Bilingual or multilingual Web directories thus may relieve such limitations. In this work, we develop an automated process to create multilingual (or bilingual, specifically) Web directories from a set of parallel corpora. We adopted the self-organizing map model to cluster the Web pages and construct Web directories for each language. A hierarchy alignment process was then applied on these monolingual hierarchies to obtain the relationships between different languages. A multilingual Web directory was then created using such relationships. We conducted experiments on a set of parallel corpora and the result demonstrated that our method could be feasible.

In this paper, we describe a two-stage hybrid approach to select gene features and produce dominant patterns for evaluating the pathological probability. To discover suitable genes as experiment samples for distinguishing the status of gene regulation, we utilized Receiver Operating Characteristic (ROC) method to eliminate non-significant genes of unapparent variation between normal tissues and tumors. Subsequently, these selected genes are clustered through an unsupervised learning algorithm to reduce overall training samples under the same condition. In addition, the resulting samples have been verified by means of experimenting with the SVM and KNN methods. The experimental results show that our approach has potentials to effectively reduce samples for microarray analysis.

Multilingual information retrieval has attracted lots of attention in recent years due to the explosive increase of multilingual Web pages. It will not be easy to retrieve documents written in languages other than the query if the relationships among entities of different languages were not found. In this work, we will develop a method based on self-organizing maps to organize documents into hierarchy. When hierarchies of individual languages are developed, an alignment process is then applied on these hierarchies to discover the associations between entities of different languages. The method had been performed on a set of parallel corpora containing Chinese and English documents and obtained promising result.

The Web pages nowadays were written in various languages including English, Chinese, Spanish, etc. There are increasing needs in searching Web pages of different languages using single query. This task is called multilingual information retrieval (MLIR). However, MLIR is difficult to achieve since we need some kind of method to find the associations between linguistic elements of different languages. In this work, we provide a method based on GHSOM to discover the associations between different languages and apply this method on MLIR task. The experiments show that our method provide a promising approach to tackle MLIR task.

With the increasing amount of multilingual texts in the Internet, multilingual text retrieval techniques have become an important research issue. However, the discovery of relationships between different languages remains an open problem. In this paper we propose a method, which applies the growing hierarchical self- organizing map (GHSOM) model, to discover knowledge from multilingual text documents. Multilingual parallel corpora were trained by the GHSOM to generate hierarchical feature maps. A discovery process is then applied on these maps to discover the relationships between documents of different languages. The relationships between keywords of different languages are also revealed. We conducted experiments on a set of Chinese-English bilingual parallel corpora to discover the relationships between documents of these languages.

Research work related to plagiarism detection methods in dealing with monolingual texts (e.g. English texts) have been well established in recent years. However, little attention has been paid to facilitate plagiarism detection in cross-lingual text collections (e.g. English and Chinese texts). In this paper we present a system platform to evaluating text similarity and relatedness in multilingual text collections for plagiarism detection. First, we utilized a number of selected texts in Chinese-English parallel corpora collected from Internet to train text classifiers based on the Support Vector Machines (SVM) model. As such, the multilingual texts of unknown category can be classified by the trained classifiers. Subsequently, the resulting categorized texts were measured by means of a language-neutral clustering technique based on Self-Organizing Maps (SOM) method for evaluating semantic similarity among texts. The preliminary results show that our platform framework has the potential for cross-lingual text relatedness evaluation and plagiarism detection.

In this paper, we develop a platform framework for categorization of cancer related abstracts using support vector machines (SVMs) based text categorization techniques with a one-against-all (OAA) learning algorithm for classification decisions. The corpora for the work were selected from the Website of PubMed database. By using information derived from PubMed literature source, including topics of breast cancer, cervical cancer, gastric cancer, lung cancer, rectum cancer and esophagus cancer, we randomly selected 6,000 medical abstracts for implementing our system and performing experiments. The experimental results show that the platform model has potentials for categorization of multiple cancer related literature texts.

We propose a method that could automatically annotating images with some keywords that could feasibly describe the semantics of the images. A set of training images as well as their annotations are trained to find the relationships between images as well as between keywords. New image could then be annotated and retrieved according to such relationships. Our preliminary experiments suggest promising result in both image annotation task and image retrieval task.

The ability to automatically identify relationships between cancer diseases and external factors from medical records for supporting cancer diagnosis would be a valuable contribution in public health fields. Unfortunately, so far little attention has been paid on such a problem domain to developing effective solutions. In this work, we propose a prototype for automating the extraction of relationships between cancer diseases and potential factors from clinical records. We describe a scheme of the system prototype that integrates cancer ontology, and developed text mining techniques, covering self-organizing maps (SOM) algorithm as well as support vector machines (SVM) methods to carry out the system development. The results show that the integration of medical ontology and the text mining platforms is capable of extracting the potential patterns and re-categorize clinical records.

In this paper we discuss the implementation of the leading supervised and unsupervised approaches for multilingual text categorization. We selected support vector machines (SVM) and latent semantic indexing (LSI) techniques as representatives of supervised and unsupervised methods for system implementation, respectively. The preliminary results show that our platform models including both supervised and unsupervised learning methods have the potentials for multilingual text categorization

The WWW provides an ultimate source of information for all kinds of knowledge in various kinds of languages. There are emerging needs for searching documents in different languages, causing multilingual information retrieval an active research topic recently. The performance of such task depends on the degree of understanding for the relationships between different languages. Multilingual text mining aims at discovering interesting relationships between different languages. In this work, we applied the growing hierarchical self-organizing map model to cluster multilingual text documents and find the relationships between two languages. We use a set of parallel corpora to train the map and apply a discovering process to identify the semantic groups and hierarchical structures of keywords for these languages. The discovered knowledge can then be applied to tasks such as multilingual information retrieval and automatic multilingual thesaurus construction.