Search

Providing a structured approach for complex product development (PD) is a challenging issue that necessitates utilizing sophisticated modeling tools and analysis techniques. One effective approach for optimizing the complex engineering system development is the cross application of modularization and sequencing analyses on the design structure matrix (DSM), which leads to a cost-effective and time-efficient PD process. In this regard, the current study presents an application-specific method for the simultaneous implementation of modularization and sequencing analyses on DSMs to find the most independent and excluded modules with the minimum feedback loops among them. To this end, we first formulate the total feedback length among the modules by introducing two new modules’ feedback criteria. Second, we propose a novel objective function combining these feedback criteria with the modularity index metric to simultaneously fulfill the sequencing and modularization goals. This objective function makes the proposed method application specific in the sense that the expert is able to adjust the importance weight of each criterion based on the project's characteristics. Third, an efficient metaheuristic algorithm named discrete particle swarm optimization simulated annealing (DPSOSA) is developed to find the optimal solution by minimizing the introduced objective function. Eventually, to evaluate the DPSOSA performance in different applications, we conduct comprehensive experiments on a total of 21 well-known real-world DSMs. The obtained results demonstrate the superiority of the proposed method over previous approaches proving its effectiveness in each of modularization, sequencing, and modularization-sequencing experiments.

In this work, we consider transferring the structure information from large networks to compact ones for dense prediction tasks in computer vision. Previous knowledge distillation strategies used for dense prediction tasks often directly borrow the distillation scheme for image classification and perform knowledge distillation for each pixel separately, leading to sub-optimal performance. Here we propose to distill structured knowledge from large networks to compact networks, taking into account the fact that dense prediction is a structured prediction problem. Specifically, we study two structured distillation schemes: i) pair-wise distillation that distills the pair-wise similarities by building a static graph; and ii) holistic distillation that uses adversarial training to distill holistic knowledge. The effectiveness of our knowledge distillation approaches is demonstrated by experiments on three dense prediction tasks: semantic segmentation, depth estimation and object detection. Code is available at: https://git.io/StructKD, Comment: v1:10 pages cvpr2019 accepted; v2:15 pages for a journal version; Code is available at: https://github.com/irfanICMLL/structure_knowledge_distillation; fix typos

Numerical weather prediction (NWP) data possess internal inaccuracies, such as low NWP wind speed corresponding to high actual wind power generation. This study is intended to reduce the negative effects of such inaccuracies by proposing a pure data-selection framework (PDF) to choose useful data prior to modeling, thus improving the accuracy of day-ahead wind power forecasting. Briefly, we convert an entire NWP training dataset into many small subsets and then select the best subset combination via a validation set to build a forecasting model. Although a small subset can increase selection flexibility, it can also produce billions of subset combinations, resulting in computational issues. To address this problem, we incorporated metamodeling and optimization steps into PDF. We then proposed a design and analysis of the computer experiments-based metamodeling algorithm and heuristic-exhaustive search optimization algorithm, respectively.Experimental results demonstrate that (1) it is necessary to select data before constructing a forecasting model; (2) using a smaller subset will likely increase selection flexibility, leading to a more accurate forecasting model; (3) PDF can generate a better training dataset than similarity-based data selection methods (e.g., K-means and support vector classification); and (4) choosing data before building a forecasting model produces a more accurate forecasting model compared with using a machine learning method to construct a model directly.

Heterogeneous domain adaptation (HDA) tackles the learning of cross-domain samples with both different probability distributions and feature representations. Most of the existing HDA studies focus on the single-source scenario. In reality, however, it is not uncommon to obtain samples from multiple heterogeneous domains. In this article, we study the multisource HDA problem and propose a conditional weighting adversarial network (CWAN) to address it. The proposed CWAN adversarially learns a feature transformer, a label classifier, and a domain discriminator. To quantify the importance of different source domains, CWAN introduces a sophisticated conditional weighting scheme to calculate the weights of the source domains according to the conditional distribution divergence between the source and target domains. Different from existing weighting schemes, the proposed conditional weighting scheme not only weights the source domains but also implicitly aligns the conditional distributions during the optimization process. Experimental results clearly demonstrate that the proposed CWAN performs much better than several state-of-the-art methods on four real-world datasets.

With the dawn of 5G network, a new set of requirements for site spectrum monitoring, cellular planning are emerging, all of which are relying on fine-grained signal map. Although with significant importance, the traditional signal map construction could be time-consuming and labor-intensive. The state-of-the arts usually employ crowdsourcing scheme and matrix completion algorithm to solve the dilemma. However, the crowdsourcing scheme usually suffers from uneven distributed and inadequate participants. To this end, in this paper, we study how to effectively reconstruct and update the signal map in the case of partially measured signal maps with smaller cost and propose a GAN-based active signal map reconstruction method (GSMAC). Our method is mainly innovative in two parts: GSMC, GAN-based signal map construction, and ACS, an active crowdsourcing scheme. Specifically, GSMC can effectively update the signal map with only a small number of observations while updating the signal map online. ACS consists of a reinforce learning-based active query mechanism which quantitatively evaluates the most valuable measurement site for reconstruction. The simulation results and real implemented data-driven experiments demonstrate the advantages and effectiveness of our approach in both accuracy and cost.

In this article, we investigate the problem of social link inference in a target location-aware social network (LSN), which aims at predicting the unobserved links between users within the network. This problem is critical for downstream applications, including network completion and friend recommendation. In addition to the network structures commonly used in general link prediction, the studies tailored for social link inference in an LSN leverage user trajectories from the spatial aspect. However, the temporal factor lying in user trajectories is largely overlooked by most of the prior studies, limiting the capabilities of capturing the temporal relevance between users. Moreover, effective user matching by fusing different views, i.e., social, spatial, and temporal factors, remains unresolved, which hinders the potential improvement of link inference. To this end, this article devises a novel multiview matching network (MVMN) by regarding each of the three factors as one view of any target user pair. MVMN enjoys the flexibility and completeness of modeling each factor by developing its suitable matching module: 1) location matching module; 2) time-series matching module; and 3) relation matching module. Each module learns a view-specific representation for matching, and MVMN fuses them for final link inference. Extensive experiments on two real-world data sets demonstrate the superiority of our approach against several competitive baselines for link prediction and sequence matching, validating the contribution of its key components.

Compressed sensing has been identified as a good candidate for user detection in grant-free non-orthogonal multiple access (NOMA) by exploiting the inherent sparsity of user activity. However, most of the existing works do not fully utilize the temporal correlation in NOMA and rely heavily on the unrealistic assumption that the number of active users is known in advance. To address these issues, we propose a temporal correlation enhanced multiuser detection scheme to achieve efficient and practical multiuser detection. Firstly, using 1 bit memory to piggyback the information whether the active users still have data to transmit, the base station can realize whether the active users in current time slot will turn to be silent or remain active. Then, to make explicit use of the temporal correlation of active user sets, a cross validation based adaptive subspace pursuit (CVASP) algorithm, is developed by utilizing the reported information on prior active users. The proposed CVASP is a highly practical algorithm that does not require any prior knowledge of the user sparsity level, as the cross validation technique could properly determine the stopping condition. Extensive simulation results demonstrate that the proposed mechanism could achieve a superier performance without requiring any prior knowledge.

Remaining useful life (RUL) prediction of aircraft engine (AE) is of great importance to improve its reliability and availability, and reduce its maintenance costs. This article proposes a novel deep bidirectional recurrent neural networks (DBRNNs) ensemble method for the RUL prediction of the AEs. In this method, several kinds of DBRNNs with different neuron structures are built to extract hidden features from sensory data. A new customized loss function is designed to evaluate the performance of the DBRNNs, and a series of the RUL values is obtained. Then, these RUL values are reencapsulated into a predicted RUL domain. By updating the weights of elements in the domain, multiple regression decision tree (RDT) models are trained iteratively. These models integrate the predicted results of different DBRNNs to realize the final RUL prognostics with high accuracy. The proposed method is validated by using C-MAPSS datasets from NASA. The experimental results show that the proposed method has achieved more superior performance compared with other existing methods.

Understanding in-network information diffusion is a fundamental problem in many applications and one of the primary challenges is to predict the information cascade size. Most of the existing models rely either on hypothesized point process (e.g., Poisson and Hawkes processes), or simply predict the information propagation via deep neural networks. However, they fail to simultaneously capture the underlying global and local structures of a cascade and the propagation uncertainty in the diffusion, which may result in unsatisfactory prediction performance. To address these, in this work we propose a novel probabilistic cascade prediction framework: Hierarchical Cascade Normalizing Flows (CasFlow). CasFlow allows a non-linear information diffusion inference and models the information diffusion process by learning the latent representation of both the structural and temporal information. It is a pattern-agnostic model leveraging normalizing flows to learn the node-level and cascade-level latent factors in an unsupervised manner. In addition, CasFlow is capable of capturing both the cascade representation uncertainty and node infection uncertainty, while enabling hierarchical pattern learning of information diffusion. Extensive experiments conducted on real-world datasets demonstrate that CasFlow reduces the prediction error to 21.0% by only observing half an hour of cascades, compared to state-of-the-art approaches, while also enabling model interpretability.

The objective of the current study is to present a comparison of techniques for the forecasting of low frequency climate oscillation indices with a focus on the Great Lakes system. A number of time series models have been tested including the traditional Autoregressive Moving Average (ARMA) model, Dynamic Linear model (DLM), Generalized Autoregressive Conditional Heteroskedasticity (GARCH) model, as well as the nonstationary oscillation resampling (NSOR) technique. These models were used to forecast the monthly El Niño-Southern Oscillation (ENSO) and Pacific Decadal Oscillation (PDO) indices which show the most significant teleconnection with the net basin supply (NBS) of the Great Lakes system from a preliminary study. The overall objective is to predict future water levels, ice extent, and temperature, for planning and decision making purposes. The results showed that the DLM and GARCH models are superior for forecasting the monthly ENSO index, while the forecasted values from the traditional ARMA model presented a good agreement with the observed values within a short lead time ahead for the monthly PDO index.

Temporal networks are ubiquitous in nature and society, and tracking the dynamics of networks is fundamental for investigating the mechanisms of systems. Dynamic communities in temporal networks simultaneously reflect the topology of the current snapshot (clustering accuracy) and historical ones (clustering drift). Current algorithms are criticized for their inability to characterize the dynamics of networks at the vertex level, independence of feature extraction and clustering, and high time complexity. In this study, we solve these problems by proposing a novel joint learning model for dynamic community detection in temporal networks (also known as jLMDC) via joining feature extraction and clustering. This model is formulated as a constrained optimization problem. Vertices are classified into dynamic and static groups by exploring the topological structure of temporal networks to fully exploit their dynamics at each time step. Then, jLMDC updates the features of dynamic vertices by preserving features of static ones during optimization. The advantage of jLMDC is that features are extracted under the guidance of clustering, promoting performance, and saving the running time of the algorithm. Finally, we extend jLMDC to detect the overlapping dynamic community in temporal networks. The experimental results on 11 temporal networks demonstrate that jLMDC improves accuracy up to 8.23% and saves 24.89% of running time on average compared to state-of-the-art methods.

Missing data widely exist in the raw or processed data, implying information loss. In many cases, missing values have to be accurately imputed for further use. In this paper, an extreme case, consecutively missing data in large-length and mainly remaining data in small-length, is discussed for time series varying with operating conditions, very universal in industrial processes. Firstly, to fully utilize the information of remaining data, a similar conditions screening scheme is provided, efficient to improve imputation accuracy. Then, multiple receding imputation via Gaussian process regression (GPR) and long short term memory (LSTM) neural network are proposed, deducing generic multiple combination imputation and bidirectional imputation structures. At last, applied for data imputation of extremely missing wind power data, condition-dependent on wind speed, imputation effects of the proposed methods are carefully compared. Simulation results reveal effectiveness of these methods to impute missing data under the extreme case, laying very important foundation for data-driven applications.

Accurate prediction of the lithium-ion battery’s future capacity and remaining useful life (RUL) is of great significance to the battery health management. To the best of our knowledge, most of the existing methods only focus on capturing the degradation trend of the battery, which results in an inaccurate prediction because of the occasional capacity regeneration phenomena in practice. To improve the prediction precision, a hybrid approach of the Grey-Markov chain model (GMCM) and the improved Gaussian process is proposed in this paper. Firstly, the historical capacity data is decomposed into two components, namely, the degradation trend and regeneration phenomena, by ensemble empirical mode decomposition. Then, the GMCM method and the multi-output mixture of Gaussian processes are developed for degradation and regeneration prediction, respectively. Lastly, an online calibration strategy is proposed for further prediction accuracy improvement. Extensive experiments are established to validate the proposed GPGM approach, with the results demonstrating that the proposed GPGM consistently outperforms other counterpart methods in terms of one-step and multi-step prediction.

Radio frequency identification technology has been widely used to verify the presence of items in many applications such as warehouse management and supply chain logistics. In these applications, the challenge of how to timely identify the missing tags (namely tag searching or missing tag identification) is a key focus. Existing missing tag identification solutions have not achieved their full potentials because collision slots have not been well explored. In this paper, we propose an approach named collision resolving based missing tag identification (CR-MTI) to break through the performance bottleneck of existing missing tag identification protocols. In CR-MTI, multiple tags are allowed to respond with different binary strings in a collision slot. Then, the reader can verify them together by using the bit tracking technology and particularly designed string, thereby significantly improve the time efficiency. CR-MTI also reduces the number of messages transmitted by the reader using customized coding. We further explore the optimal parameter settings to maximize the performance of our proposed CR-MTI. Extensive simulation results show that our proposed CR-MTI outperforms prior art in terms of time efficiency, total executive time and communication complexity.

Varied edge bundling methods have been used to reduce visual clutter in parallel coordinates plots (PCP). However, existing edge-bundled PCP do not scale well for visual analysis of multidimensional big data and often overplot the bundles in the area near the axes. In this study, we propose a scalable lightweight bundling method to support visual analysis of multidimensional big data in PCP. It helps the users discover trends and detect outliers in the data by bundling the edges between each two adjacent axes independently. We integrate human judgments into the two-dimensional data binning by novel interactions to accelerate the clustering process of the data. We use the frequency-based representation to render the clusters as histogram-like bundles to reveal the distribution of the data and eliminate the overplotting of the bundles. Based on our method, we build a lightweight web-based visual analytics system for exploring multidimensional big data in PCP. The scalability analysis of our method shows that its clustering time increases linearly with the size of the data. Its rendering time is independent of the size of the data. We conduct two case studies and a user study to compare our method with classic PCP and two state-of-the-art edge-bundled PCP.

Continues field monitoring and searching sensor data remains an imminent element emphasizes the influence of the Internet of Things (IoT). Most of the existing systems are concede spatial coordinates or semantic keywords to retrieve the entail data, which are not comprehensive constraints because of sensor cohesion, unique localization haphazardness. To address this issue, we propose deep learning inspired sensor-rank consolidation (DLi-SRC) system that enables 3-set of algorithms. First, sensor cohesion algorithm based on Lyapunov approach to accelerate sensor stability. Second, sensor unique localization algorithm based on rank-inferior measurement index to avoid redundancy data and data loss. Third, a heuristic directive algorithm to improve entail data search efficiency, which returns appropriate ranked sensor results as per searching specifications. We examined thorough simulations to describe the DLi-SRC effectiveness. The outcomes reveal that our approach has significant performance gain, such as search efficiency, service quality, sensor existence rate enhancement by 91%, and sensor energy gain by 49% than benchmark standard approaches.

Projection techniques are often used to visualize high-dimensional data, allowing users to better understand the overall structure of multi-dimensional spaces on a 2D screen. Although many such methods exist, comparably little work has been done on generalizable methods of inverse-projection -- the process of mapping the projected points, or more generally, the projection space back to the original high-dimensional space. In this paper we present NNInv, a deep learning technique with the ability to approximate the inverse of any projection or mapping. NNInv learns to reconstruct high-dimensional data from any arbitrary point on a 2D projection space, giving users the ability to interact with the learned high-dimensional representation in a visual analytics system. We provide an analysis of the parameter space of NNInv, and offer guidance in selecting these parameters. We extend validation of the effectiveness of NNInv through a series of quantitative and qualitative analyses. We then demonstrate the method's utility by applying it to three visualization tasks: interactive instance interpolation, classifier agreement, and gradient visualization.

Evidence comparing additive 3-dimensional printing (3DP) with subtractive milling for implant-supported frameworks is lacking.The purpose of this systematic review and meta-analysis was to compare the marginal fit and accuracy of complete-arch implant-supported frameworks (CA), implant-retained fixed partial dentures (IRFPDs), single implant crowns (SICs), and interim implant-retained restorations (IIRRs) by using additive manufacturing (AM) and subtractive manufacturing (SM) methods.An electronic search was performed in PubMed, ScienceDirect, Google Scholar, and the Cochrane Library for articles published up to August 2020. The authors acquired the data and evaluated the articles, and the final selection of articles was made according to the inclusion and exclusion criteria. The Methodological Index for Non-Randomized Studies (MINORS) scale was used to evaluate the quality of the included studies. Heterogeneity was evaluated, and meta-analyses with subgroup analyses were performed in the selected studies.The database search resulted in 960 articles. After removing duplicate articles (410 studies), the titles and abstracts were screened in detail, and 10 in vitro studies were selected for qualitative analysis and 9 for quantitative analysis according to the eligibility criteria. Subgroup analyses were performed to compare the 3DP versus the SM technique for different types of implant-supported frameworks (IRFPDs, SICs, IIRRs, and CA). In the IRFPDs analysis, the marginal fit accuracy of the 3DP systems was higher than that with the subtractive manufacturing method (P.001). In the subgroup analysis of SIC frameworks (P=.55) and CA (P=.67) frameworks, no significant difference was observed in the assessed techniques.The marginal fit of implant-supported frameworks manufactured by AM or SM methods is in the clinically acceptable range.

Nonoccurring behavior (NOB) studies have attracted the growing attention of scholars as a crucial part of behavioral science. As an effective method to discover both NOB and occurring behaviors (OB), negative sequential pattern (NSP) mining is successfully used in analyzing medical treatment and abnormal behavior patterns. At this time, NSP mining is still an active and challenging research domain. Most of the algorithms are inefficient in practice. Briefly, the key weaknesses of NSP mining are: 1) an inefficient positive sequential pattern (PSP) mining process, 2) a strict constraint of negative containment, and 3) the lack of an effective Negative Sequential Candidate (NSC) generation method. To address these weaknesses, we propose a highly efficient algorithm with improved techniques, named sc-NSP, to mine NSP efficiently. We first propose an improved PrefixSpan algorithm in the PSP mining process, which connects to a bitmap storage structure instead of the original structure. Second, sc-NSP loosens the frequency constraint and exploits the NSC generation method of positive and negative sequential patterns mining (PNSP) (a classic NSP mining method). Furthermore, a novel pruning strategy is designed to reduce the computational complexity of sc-NSP. Finally, sc-NSP obtains the support of NSC by using the most efficient bitwise-based calculation operation. Theoretical analyses show that sc-NSP performs particularly well on data sets with a large number of elements and items in sequence. Comparison and extensive experiments along with case studies on health data show that sc-NSP is 10 times more efficient than other state-of-the-art methods, and the number of NSPs obtained is 5 times greater than other methods.

Scientific simulations on high-performance computing (HPC) systems can generate large amounts of floating-point data per run. As compared to lossless compressors, lossy compressors, such as SZ and ZFP, can reduce data volume more aggressively while maintaining the usefulness of the data. However, a reduction ratio of more than two orders of magnitude is almost impossible without seriously distorting the data. In deep learning, the autoencoder has shown potential for data compression. Whether the autoencoder can deliver similar performance on scientific data, however, is unknown. In this paper, we for the first time conduct a comprehensive study on the use of autoencoders to compress real-world scientific data and illustrate several key findings on using autoencoders for scientific data reduction. We implement an autoencoder-based compression prototype to reduce floating-point data. Our study shows that the out-of-the-box implementation needs to be further tuned in order to achieve high compression ratios and satisfactory error bounds. Our evaluation results show that, for most test datasets, the tuned autoencoder outperforms SZ by 2 to 4X, and ZFP by 10 to 50X in compression ratios, respectively. Our practices and lessons learned in this work can direct future optimizations for using autoencoders to compress scientific data.

To utilize a huge amount of observation data based on real-world events, a data assimilation process is needed to estimate the state of the system behind the observed data. The Kalman filter is a very commonly used technique in data assimilation, but it has a problem in terms of practical use from the viewpoint of processing efficiency and estimating the deterioration in precision when applied to particularly large-scale datasets. In this paper, we propose a method that simultaneously addresses these problems and demonstrate its usefulness. The proposed method improves the processing efficiency and suppresses the deterioration in estimation precision by introducing correction processes focusing on the non-negative nature and sparseness of data in wavelet space. We show that the proposed method can accurately estimate population dynamics (MAE ≤ 3, RMSE ≤ 7) on the basis of an evaluation done using population data generated from cellular networks. In addition, the possibility of wide area abnormality detection using the proposed method is shown from a situation analysis of when Category 5 typhoon Hagibis made landfall in Japan. The proposed method has been deployed in a commercial service to estimate real-time population dynamics in Japan.

With the development of online real estate trading platforms, multi-modal housing trading data, including structural information, location, and interior image data, are being accumulated. The accurate appraisal of real estate makes sense for government officials, urban policymakers, real estate sellers, and personal purchasers. In this study, we propose an interpretable multi-modal stacking-based ensemble learning (IMSEL) method that deals with various modalities for real estate appraisals. We crawl the structural and image data of real estate in Chengdu city, China from the nations largest real estate transaction platform with the location information, including public services, within 2 km of the real estate using Baidu map. We then compare the predictive results from IMSEL with those from previous state-of-art methods in the literature in terms of the root mean square error, mean absolute percentage error, mean absolute error, and coefficient of determination (R2). The comparison results show that IMSEL outperformed the other methods. We verified the improvement of introducing a data transformation strategy and deep visual features through a 10-fold cross-validation. We also discuss the managerial implications of our research findings.

Industrial cyber-physical systems (ICPSs) are deployed in many high-value facilities recently, and the monitoring of ICPS is more and more important. However, the prerequisite of ICPS monitoring is how to obtain an accurate network structure. In addition, the structure of ICPS may change over time and the observations data are limited and noisy. These situations make the ICPS network structure identification more difficult. In this article, we proposed the algorithm of temporal network identification from sparse data (ATNISD) to address these two issues simultaneously. First, we established the temporal network analysis model from the aspect of state equation and observation equation. Then, we analyze the characteristics of temporal networks in both time domain and space domain and propose a general framework of temporal networks structure identification, which is a combinatorial optimization problem. To improve the accuracy and alleviate the computational complexity, we decompose the combinatorial problem into small independent simple problems, which can be solved efficiently. The performance of the proposed algorithm is verified on synthetic evolutionary game dynamics on both homogeneous and heterogeneous temporal networks. The experimental results show that the proposed method can efficiently solve the problem of temporal networks structure identification from sparse data.

Privacy preserving data mining has much importance in the data analysis because it maintains confidential or highly sensitive data in the purpose of data analysis. Many perturbation techniques are developed, but do not perform well. There are used for different purposes in various techniques. Though, the reconstruction of original data can be done from the samples of perturbed data. It does not always preserve the distance that exists in the original data samples. During reconstruction of the original data, some of the information is loosed which is again a complex and time consuming task for traditional data mining algorithm. Therefore, a novel hybrid data perturbation technique is introduced that overcomes the above addressed issues. The proposed paper includes a novel data perturbation technique to hybridize the traditional Geometric Data Perturbation Technique along with the Euclidean distance method to preserve privacy. It obtains the distorted or perturbed data which is sampled at different intervals depending on the levels of privacy. The proposed approach attempts to reduce the tradeoffs that persists between privacy levels, accuracy and information loss. The experimental results for this approach is implemented using real world bench mark datasets downloaded from UCI Repositories using three different data mining clustering algorithms. It is shown that clustering accuracy is similar and fairly high for the perturbed data obtained from the proposed approach when matched with the original data set clustering algorithms. The analysis were shown for different privacy levels on different data samples.

Passenger-flow anomaly detection and prediction are essential tasks for intelligent operation of the metro system. Accurate passenger-flow representation is the foundation of them. However, spatiotemporal dependencies, complex dynamic changes, and anomalies of passenger-flow data bring great challenges to data representation. Taking advantage of the time-varying characteristics of data, we propose a novel passenger-flow representation model based on low-rank dynamic mode decomposition (DMD), which also integrates the global low-rank nature and sparsity to explore the spatiotemporal consistency of data and depict abrupt data, respectively. The model can detect anomalies and predict short-term passenger flow conveniently and flexibly. For anomaly detection, we further introduce a strong temporal Toeplitz regularization to characterize the temporal periodic change of data, so as to more accurately detect anomalies. We conduct experiments with smart card transaction data from the Beijing metro system to assess the performance of the model in two use cases. In terms of anomaly detection, the experimental results demonstrate that our method can detect anomalies efficiently, especially for time sequence anomalies. As for short-term prediction, our model is superior to other methods in most cases.

Testing is the fundamental activity intentional at detecting and solving technical issues in the software source code. In software development, test suite plays a major role. A test suite is a collection of test case which describes actual input, action and an expected response to verify whether a system under test satisfies requirements correctly or not. A huge number of test cases are required for testing the software. The test cases may be redundant. So, the execution of all these test cases entails lot of effort, time and cost. So, it is necessary to make enhancement in the test suite that outcome in good coverage with less effort, time and cost. This work proposes a hybrid technique for test suite enhancement using data mining techniques. The hybrid approach is performed in three ways i) Classification based Clustering ii) Classification based Association iii) Classification based RTM approach used to make enhancement in the test suite and to improve accuracy.

With vast usage of Spatio-temporal data usage in various domains and capturing data as remote sensing, GPS, and ST data. STDM is critical for various domains such as transportation, public safety, medical and environmental statistics. In this article, ST characteristics are explained in seven different types and followed by models for STDM in different domains including medical, mobile usage, sensors, industrial area, weather analysis, data querying, traffic control. Finally, the research and future direction.

The water quality index has been universally accepted as an indicator to represent the water quality status of the surface water body comprehensively. The prevalent conventional Water Quality Indices (WQIs) suffer from limitations such as 'eclipsing' and 'ambiguity'. Artificial intelligence techniques such as artificial neural networks (ANNs) have gained importance to overcome the limitations of conventional WQIs. In the present study, the Levenberg Marquardt (LM) algorithm and the Scaled Conjugate Gradient (SCG) algorithm have been compared to develop WQI based on the ANN approach (i.e ANNWQI). It is observed that the LM algorithm outperforms the SCG algorithm for prediction of ANNWQI of Indian streams, while the Bayesian Regularization algorithm has not been found suitable for the same purpose in the present study. It is also observed that both LM and SCG algorithm gives robust predictions when the hidden layer contains ten neurons. The combination of data set partitioning of training (75%), Validation (15%), and testing (10%) have been found to give the robust performance of prediction of ANNWQI for Indian streams. The predicted ANNWQI model using the LM algorithm has a very high correlation with the measured WQI values and therefore recommended to be adopted as an effective alternative, to avoid lengthy calculations involved in prevalent conventional WQI.

This paper addresses the problem of anomaly detection for high-dimensional sensing data. The one-class support vector machine (OCSVM) is one of the most popular unsupervised methods for anomaly detection. When data are high dimensional and large scale, however, the efficiency of OCSVM-based methods in anomaly detection suffers. Although dimensionality-reduction tools, such as deep belief networks, can be applied to compress the high-dimensional data to alleviate the problem, the accuracy and timely detection are still hard to improve due to the inherent features of OCSVM. In this paper, we propose a new form of OCSVM model based on the structure of the compressed data and the characteristics of OCSVM. Based on the new model, we design both optimal and approximate methods for model training and testing. We evaluate the performance of our methods with extensive experiments on four real-world datasets. The experimental results demonstrate that our new methods, both optimal and approximate ones, not only significantly outperform the state-of-the-art in accuracy and efficiency, but also achieve the good performance without the need of manual parameter tuning. In addition, our approximate training and testing mechanism can reduce the computing time by three orders of magnitude with a negligible loss in accuracy.

Nested data structures, in which conditions include multiple trials and are fully crossed with participants, are often analyzed using repeated-measures analysis of variance or mixed-effects models. Typically, researchers are interested in determining whether there is an effect of the experimental manipulation. These kinds of analyses have different appropriate specifications for the null and alternative models, and a discussion on which is to be preferred and when is sorely lacking. van Doorn et al. (2021) performed three types of Bayes factor model comparisons on a simulated data set in order to examine which model comparison is most suitable for quantifying evidence for or against the presence of an effect of the experimental manipulation. Here, we extend their results by simulating multiple data sets for various scenarios and by using different prior specifications. We demonstrate how three different Bayes factor model comparison types behave under changes in different parameters, and we make concrete recommendations on which model comparison is most appropriate for different scenarios.

Inferential modeling has been of significance for modern manufacturing in estimating the quality-related process variables. As an effective inferential model, probabilistic slow feature analysis (PSFA) has gained attention in regression tasks to interpret dynamic properties with a slowness preference. However, PSFA is often challenged by the nonlinear sequential data due to its linear state-space structure. In this study, a new nonlinear extension of PSFA is proposed under the deep learning framework to enhance the dynamic feature extraction with limited labels, incorporating variational inference and Monte Carlo inference to derive the objective function. The proposed model considers the relevance of inputs with outputs as the input weights to upgrade prediction performance. The proposed model is verified through an industrial hydrocracking process to predict diesel yield with missing labels ranged from 0% to 50%, and the root mean squared error is reduced by at least 8.78% compared to PSFA.

The rapid growth of GPS technology and mobile devices has led to a massive accumulation of location data, bringing considerable benefits to individuals and society. One of the major usages of such data is travel time prediction, a typical service provided by GPS navigation devices and apps. Meanwhile, the constant collection and analysis of the individual location data also pose unprecedented privacy threats. We leverage the notion of geo-indistinguishability, an extension of differential privacy to the location privacy setting, and propose a procedure for privacy-preserving travel time prediction without collecting actual individual GPS trace data. We propose new concepts to examine the impact of geo-indistinguishability-based sanitization on the usefulness of GPS traces and provide analytical and experimental utility analysis for privacy-preserving travel time prediction. We also propose new metrics to measure the adversary error in learning individual GPS traces from the collected sanitized data. Our experiment results suggest that the proposed procedure provides travel time prediction with satisfactory accuracy at reasonably small privacy costs.

Searchable Symmetric Encryption (SSE), which enables users to search over encrypted data without decryption, has gained increasing attention from both academic and industrial fields. However, existing SSE schemes either have low search efficiency or cannot support multi-keyword search, dynamic updates, and result verification simultaneously. To solve these problems, we propose a Verifiable and Dynamic Multi-keyword Search (VDMS) scheme over encrypted data by using the bitmap and RSA accumulator, which provides multi-keyword search over encrypted data in an efficient, verifiable and updated way. The bitmap is used as a data structure to build the indexes, which improves the search efficiency and reduces the storage space of the indexes. The RSA accumulator and bitmap are combined to verify the correctness of results. Formal security analysis proves that our VDMS is adaptively secure against Chosen-Keyword Attacks (CKA), and empirical experiments using a real-world dataset demonstrate that our VDMS is efficient and feasible in practical applications.

Extraction of information in enterprise applications due to complex distribution of information in large identical sources. In such a scenario, a single approach or method for extracting information text would limit information needs, which would require a high level of work and time. So, it is an open problem in data analysis application to construct a suitable classification model for unsupervised datasets which having multi level of information attributes. It is vital to analyse and discover the valuable pattern information to support the accurate classification. Selection of attributes and construction of relation model always is a challenging due the increasing attribute dimensionality. So, it is important to learn and select the best attributes patterns to enhance the information association through accurate classification. In this paper, we propose an ARP-RW method for construction of Attribute Relation Pattern (ARP) through computing attributes Relation Weightage (RW) to enhance the information classification. The ARP-RW method provides the solution to identifying the relation class of the multi-attributes documents. It initially constructs an attribute relation class matrix (ARCM) utilizing the set of data collection and the RW value of the MLA. Later, it builds an ARP based on the MLA selected to perform accurate classification. The evaluation of the proposal method using the datasets of UCI Machine Learning Repository shows improvisation in comparison the existing approaches.

In the network approach to psychopathology, psychological constructs are conceptualized as networks of interacting components (e.g., the symptoms of a disorder). In this network view, interest is on the degree to which symptoms influence each other, both directly and indirectly. These direct and indirect influences are often captured with centrality indices, however, the estimation method often used with these networks, the frequentist graphical LASSO (GLASSO), has difficulty estimating (uncertainty in) these measures. Bayesian estimation might provide a solution, as it is better suited to deal with bias in the sampling distribution of centrality indices. This study therefore compares estimation of symptom networks with Bayesian GLASSO- and Horseshoe priors to estimation using the frequentist GLASSO using extensive simulations. Results showed that the Bayesian GLASSO performed better than the Horseshoe, and that the Bayesian GLASSO outperformed the frequentist GLASSO with respect to bias in edge weights, centrality measures, correlation between estimated and true partial correlations, and specificity. Sensitivity was better for the frequentist GLASSO, but performance of the Bayesian GLASSO is usually close. With respect to uncertainty in the centrality measures, the Bayesian GLASSO shows good coverage for strength and closeness centrality, but uncertainty in betweenness centrality is estimated less well.

Searchable encryption (SE) is a powerful technology that enables keyword-based search over encrypted data becomes possible. However, most SE schemes focus on exact keyword search which can not tolerate misspellings and typos. Existing fuzzy keyword search schemes only support fuzzy search within a limited similarity threshold d, the storage cost will grow exponentially or the precision of search results will greatly decrease as $d$ increases. Moreover, the current fuzzy keyword ranked search schemes consider only the keyword weight, and disregard the influence of keyword morphology similarity on the ranking. In this paper, we propose a scalable fuzzy keyword ranked search scheme over encrypted data under hybrid clouds architecture. We use the edit distance to measure the similarity of keywords and design an edit distance algorithm over the encrypted database, in which our scheme achieves fuzzy keyword search for any similarity threshold d with constant storage size and accurate search results. Furthermore, we design a two-factor ranking function combining keyword weight with keyword morphology similarity, which is utilized to rank the search results and enhance system usability. Extensive experiments are performed to demonstrate the trade-off of efficiency and security of the proposed scheme.

In practical mechanical fault detection and diagnosis, it is difficult and expensive to collect enough large-scale supervised data to train deep networks. Transfer learning can reuse the knowledge obtained from the source task to improve the performance of the target task, which performs well on small data and reduces the demand for high computation power. However, the detection performance is significantly reduced by the direct transfer due to the domain difference. Domain adaptation (DA) can transfer the distribution information from the source domain to the target domain and solve a series of problems caused by the distribution difference of data. In this survey, we review various current DA strategies combined with deep learning (DL) and analyze the principles, advantages, and disadvantages of each method. We also summarize the application of DA combined with DL in the field of fault diagnosis. This paper provides a summary of the research results and proposes future work based on analysis of the key technologies.

For emerging Industrial Internet of Things (IIoT), intelligent anomaly detection is a key step to build smart industry. Specially, explosive time series data brings enormous challenges to the information mining and processing for modern industry. How to identify and detect the multi-dimensional industrial time series anomaly is an important issue. However, most existing studies fail to handle with large amounts of unlabeled data and get the undesirable results. In this paper, we propose a novel integrated deep generative model (DGM), which is built by generative adversarial networks based on bi-directional LSTM and attention mechanism (AMBi-GAN). The structure for generator and discriminator is the bi-directional long short-term memory with attention mechanism (AMBi-LSTM), which can capture time series dependence. Reconstruction loss and generation loss test the input of sample training space and random latent space. Experimental results show that the detection performance of our proposed AMBi-GAN has the potential to improve the detection accuracy of industrial multi-dimensional time series anomaly, towards IIoT in the era of AI.

Top-k recommendation is a fundamental task in recommendation systems that is generally learned by comparing positive and negative pairs. The contrastive loss (CL) is the key in contrastive learning that has recently received more attention, and we find that it is well suited for top-k recommendations. However, CL is problematic because it treats the importance of the positive and negative samples the same . On the one hand, CL faces the imbalance problem of one positive sample and many negative samples. On the other hand, there are so few positive items in sparser datasets that their importance should be emphasized. Moreover, the other important issue is that the sparse positive items are still not sufficiently utilized in recommendations. Consequently, we propose a new data augmentation method by using multiple positive items (or samples) simultaneously with the CL loss function. Therefore, we propose a multisample-based contrastive loss (MSCL) function that solves the two problems by balancing the importance of positive and negative samples and data augmentation. Based on the graph convolution network (GCN) method, experimental results demonstrate the state-of-the-art of MSCL. The proposed MSCL is simple and can be applied in many methods. Our code is available at https://github.com/haotangxjtu/MSCL.