Search

Decision models such as the drift-diffusion model (DDM) are widely used and broadly accepted for their ability to account remarkably well for binary choices between perceptual hypotheses about a stimulus or for preferential decisions between valued options (such as snacks or consumer products), and for their response time (RT) distributions, as a function of the stimulus or the option values. The DDM is built on an evidence accumulation to bound concept, where, in the value domain, a decision maker repeatedly samples the mental representations of the values of the options on offer until satisfied that there is enough evidence in favor of one option over the other. As the value signals that drive the DDM evidence are derived from value estimates that are not known to the decision maker with certainty, repeated sequential samples are necessary to average out noise. The classic DDM typically does not allow for different options to have different levels of variability in their value representations. However, recent value-based decision studies have shown that decision makers often report levels of certainty regarding value estimates that vary across choice options. There is therefore a need to extend the DDM to include an option-specific value certainty component. We present several such DDM extensions and validate them against empirical data from four previous studies. The data supports best a DDM version in which the drift of the accumulation is based on a sort of signal-to-noise ratio of value for each option (rather than a mere accumulation of samples from the corresponding value distributions). This DDM variant accounts for the positive impact of value certainty on choice consistency and for the negative impact of value certainty on RT.

Applying chaos theory for secure digital communications is promising and it is well acknowledged that in such applications the underlying chaotic systems should be carefully chosen. However, the requirements imposed on the chaotic systems are usually heuristic, without theoretic guarantee for the resultant communication scheme. Among all the primitives for secure communications, it is well-accepted that (pseudo) random numbers are most essential. Taking the well-studied two-dimensional coupled map lattice (2D CML) as an example, this paper performs a theoretical study towards pseudo-random number generation with the 2D CML. In so doing, an analytical expression of the Lyapunov exponent (LE) spectrum of the 2D CML is first derived. Using the LEs, one can configure system parameters to ensure the 2D CML only exhibits complex dynamic behavior, and then collect pseudo-random numbers from the system orbits. Moreover, based on the observation that least significant bit distributes more evenly in the (pseudo) random distribution, an extraction algorithm E is developed with the property that, when applied to the orbits of the 2D CML, it can squeeze uniform bits. In implementation, if fixed-point arithmetic is used in binary format with a precision of $z$ bits after the radix point, E can ensure that the deviation of the squeezed bits is bounded by $2^{-z}$ . Further simulation results demonstrate that the new method not only guide the 2D CML model to exhibit complex dynamic behavior, but also generate uniformly distributed independent bits. In particular, the squeezed pseudo random bits can pass both NIST 800-22 and TestU01 test suites in various settings. This study thereby provides a theoretical basis for effectively applying the 2D CML to secure communications., Comment: 10 pages, 11figures

SYN Flood Attack is one form of distributed denial of service attack that attains the handshake process of TCP. This attack consumes all available server resources and provokes legitimate traffic which aims to make the server unavailable. It causes serious damage to cloud server and networking protocols. The main objective of this research work is to train the neural network for detecting the attack and to secure network connection. A novel binary fruit fly optimization algorithm with deep learning is proposed to predict the syn flood attack. The proposed algorithm is implemented using the KDD cup dataset. DL- BFFA algorithm has achieved 99.96% detection accuracy for detecting the SYN Flood Attack. A comparison study is conducted to validate the proposed model.

Neural network quantization has shown to be an effective way for network compression and acceleration. However, existing binary or ternary quantization methods suffer from two major issues. First, low bit-width input/activation quantization easily results in severe prediction accuracy degradation. Second, network training and quantization are always treated as two non-related tasks, leading to accumulated parameter training error and quantization error. In this work, we introduce a novel scheme, named Residual Quantization, to train a neural network with both weights and inputs constrained to low bit-width, e.g., binary or ternary values. On one hand, by recursively performing residual quantization, the resulting binary/ternary network is guaranteed to approximate the full-precision network with much smaller errors. On the other hand, we mathematically re-formulate the network training scheme in an EM-like manner, which iteratively performs network quantization and parameter optimization. During expectation, the low bit-width network is encouraged to approximate the full-precision network. During maximization, the low bit-width network is further tuned to gain better representation capability. Extensive experiments well demonstrate that the proposed quantization scheme outperforms previous low bit-width methods and achieves much closer performance to the full-precision counterpart.

The goal of supervised hashing is to construct hash mappings from collections of images and semantic annotations such that semantically relevant images are embedded nearby in the learned binary hash representations. Existing deep supervised hashing approaches that employ classification frameworks with a classification training objective for learning hash codes often encode class labels as one-hot or multi-hot vectors. We argue that such label encodings do not well reflect semantic relations among classes and instead, effective class label representations ought to be learned from data, which could provide more discriminative signals for hashing. In this article, we introduce Adaptive Labeling Deep Hashing (AdaLabelHash) that learns binary hash codes based on learnable class label representations. We treat the class labels as the vertices of a K -dimensional hypercube, which are trainable variables and adapted together with network weights during the backward network training procedure. The label representations, referred to as codewords, are the target outputs of hash mapping learning. In the label space, semantically relevant images are then expressed by the codewords that are nearby regarding Hamming distances, yielding compact and discriminative binary hash representations. Furthermore, we find that the learned label representations well reflect semantic relations. Our approach is easy to realize and can simultaneously construct both the label representations and the compact binary embeddings. Quantitative and qualitative evaluations on several popular benchmarks validate the superiority of AdaLabelHash in learning effective binary codes for image search.

Given a dataset $\cal S$ composed of g subsets with each data items belonging to one of them, $\textit{multiset membership lookup}$ takes an item e as input and outputs a binary answer whether $e\in{\cal S}$ and, in case of yes, the ID of the subset to which e belongs. Overlaid upon while more sophisticated than the canonical membership lookup, multiset membership lookup emerges as a pivotal functionality in many computing and networking paradigms. The quest to achieve high-speed, high-accuracy lookup with limited memory cost makes lookup algorithm design a challenging task, particularly when the data items arrive as a stream. In this paper, we devise compact data structures and lookup algorithms that are amendable for hardware implementation, while guaranteeing high lookup accuracy and supporting interactive query processing. We first propose $\textit{multi-hash color table}$ , a variant of Bloom filter, to encode subset IDs compactly and map the ID of an item to its subset ID. We further construct a more balanced data structure called $\textit{balanced multi-hash color table}$ to improve the compactness by integrating the state-of-the-art load balancing technique. We complete our work by addressing the case of $\textit{batch arrivals}$ and design a batched recording algorithm optimizing the memory efficiency.

Hash bit selection determines an optimal subset of hash bits from a candidate bit pool. It is formulated as a zero-one quadratic programming problem subject to binary and cardinality constraints. In this article, the problem is equivalently reformulated as a global optimization problem. A collaborative neurodynamic optimization (CNO) approach is applied to solve the problem by using a group of neurodynamic models initialized with particle swarm optimization iteratively in the CNO. Lévy mutation is used in the CNO to avoid premature convergence by ensuring initial state diversity. A theoretical proof is given to show that the CNO with the Lévy mutation operator is almost surely convergent to global optima. Experimental results are discussed to substantiate the efficacy and superiority of the CNO-based hash bit selection method to the existing methods on three benchmarks.

Currently, DNA strand displacement is often used to build neural networks or solve logical problems. While there are few studies on the use of DNA strand displacement to solve the higher order equations. In this paper, the catalysis, degradation, annihilation and adjusted reaction modules are built through DNA strand displacement. The chemical reaction networks of the corresponding higher order equations and simultaneous equations are established through these modules, and these chemical reaction networks can be used to build analog circuits to solve binary primary simultaneous equations and binary quadratic simultaneous equations. Finally, through Visual DSD software verification, this design can realize the solution of binary primary simultaneous equations and binary quadratic simultaneous equations, which provides a reference for DNA computation in the future.

In this paper, we present an efficient 3D display technique that employs current 2D TV channels. First, a gradient background depth is generated for the still region. To create a stereo effect, multiple objects are detected and segmented using the binary format. Object depth is estimated according to the object size and its location. Depth value is assigned as a proportion of the object size using the linear quantitative method. Each object size is calculated and its depth value is proportional to the size parameter. If an object is the largest one and is located in the central region, the maximum depth value is assigned. For real-time implementation, dual ARM cores perform the task using the algorithm of the proposed stereo conversion. Our results show that a low-cost embedded system can perform the proposed 3D algorithm, with a processing time of 43ms per frame. The signal from a TV channel can be sampled and converted to a 3D format display on a conventional LCD screen.

Identification of the most prominent bio-markers or genes with high classification accuracy in the high-dimensional cancerous data, is still remained as an emerging challenge for the machine learning researchers. As this challenge has two objectives, i.e. minimizing the number of genes (NoG) and maximizing the classification accuracy percentage (CAP), this problem can be modeled as binary multi-objective approach. In this work, a modified version of multi-objective Jaya algorithm, multi-objective chaotic Jaya (MOCJaya), is suggested to select the minimum NoG with high CAP. Initially, a filter approach, namely Fisher score is applied to pre-select the informative genes. Then, MOCJaya algorithm is employed for both selecting key genes and classifying the cancer data. To assess the efficacy of the designed algorithm, ten binary and multi-class cancerous datasets are considered. Here, the suggested algorithm has been compared with multi-objective chaotic Genetic Algorithm (MOCGA), multi-objective chaotic particle swarm optimization (MOCPSO), multi-objective Jaya (MOJaya), multi-objective PSO (MOPSO), and non-dominated sorting GA (NSGA-II) models. Moreover, a comparison of MOCJaya algorithm with other seventeen existing models, is also performed here. The experimental results and comparison analysis reveal that MOCJaya classifies both the positive and negative samples of the cancer datasets in high CAP with a smaller NoG.

We consider the Pareto-scheduling of two competing agents on a single machine, in which the jobs of each agent have their “own equal processing times” (shortly, OEPT). In the literature, two special versions of the OEPT model, in which the jobs have either unit or equal processing times, have been well studied, where the criteria are given by various regular objective functions without including the late work criteria. However, for equal processing times, the exact complexity of three problems is still unaddressed. Two-agent scheduling related to late work criteria is also a hot topic in recent years. This inspires our research by also including the total (weighted) late work as criteria. We show that, for equal processing times, all the problems are binary NP-hard if the criterion of one agent is the total tardiness or the total late work and the criterion of the other agent is either the total tardiness or the total late work or the weighted number of tardy jobs or the total weighted completion time. As a result, complexity classification for equal processing times is completely addressed. We further show that all the problems under the OEPT model are either polynomially solvable or ordinary NP-hard, which results in a complete complexity classification for the OEPT model.

From the dawn of the computer age, man has mass produced binary components for computers, due to which ternary or higher radix computers are not yet commercially used. It has been proved that ternary logic can be more efficient than binary logic and there are many devices in development that operate on more than two internal states. Therefore an efficient method to produce multi-valued logic on the basis of binary input provided is needed. In this article, an effective, simple, flexible, and low power consumption implementation has been proposed that can convert any binary number to a number of chosen radix. The proposed design is implemented in 32 nm TSMC CMOS. The proposed design is then evaluated in power/delay space and its performances are compared with the latest state of art designs. The proposed circuit exhibits power saving up to 92 % over previous models.

Nowadays the majority of retail customers use multiple channels. We investigate the assortment, space and inventory problem for an omni-channel retailer operating with interconnected bricks-and-mortar stores and an online shop. For this problem it becomes essential to consider customers’ demand interactions across channels. Current literature mainly focuses on single-channel assortments and ignores cross-channel substitution. We contribute the first integrated omni-channel model that determines assortments for the online and bricks-and-mortar channel with stochastic, space-elastic and out-of-assortment and out-of-stock demand both for in-channel substitution and cross-channel substitution. A specialized heuristic is developed that is based on an iterative solution of a binary problem and demand updates. Our approach achieves near-optimal results for small instances and higher objective values as an alternative heuristic for larger instances. With the full integration of channels, omni-channel retailers can realize a profit increase that mainly depends on the magnitude of substitution rates. We further show numerically that in-channel substitution has a stronger impact on profits than cross-channel substitution when costs are equal across channels.

Boolean network is a modeling tool that describes a dynamic system with binary variables and their logical transition formulas. Recent studies in precision medicine use a Boolean network to discover critical genetic alterations that may lead to cancer or target genes for effective therapies to individuals. In this paper, we study a logical inference problem in a Boolean network to find all such critical genetic alterations in a minimal (parsimonious) way. We propose a bilevel integer programming model to find a single minimal genetic alteration. Using the bilevel integer programming model, we develop a branch and bound algorithm that effectively finds all of the minimal alterations. Through a computational study with eleven Boolean networks from the literature, we show that the proposed algorithm finds solutions much faster than the state-of-the-art algorithms in large data sets.

Job shops are an important production environment for low-volume high-variety manufacturing. Its scheduling has recently been formulated as an Integer Linear Programming (ILP) problem to take advantages of popular Mixed-Integer Linear Programming (MILP) methods, e.g., branch-and-cut. When considering a large number of parts, MILP methods may experience difficulties. To address this, a critical but much overlooked issue is formulation tightening. The idea is that if problem constraints can be transformed to directly delineate the problem convex hull in the data pre-processing stage, then a solution can be obtained by using linear programming methods without much difficulty. The tightening process, however, is NP hard because of the existence of integer variables. In this paper, an innovative and systematic approach is established for the first time to tighten the formulations of individual parts, each with multiple operations, in the data pre-processing stage. It is a major extension from our previous work on problems with binary and continuous variables to integer variables. The idea is to first link integer variables to binary variables by innovatively combining constraints so that the integer variables are uniquely determined by binary variables. With binary variables and continuous only, the vertices of the convex hull can be obtained based on the vertices of the linear problem after relaxing binary requirements with proved tightness. These vertices are then converted to tight constraints for general use. This approach significantly improves and extends our previous results on tightening single-operation parts without actually achieving tightness. Numerical results demonstrate significant benefits on solution quality and computational efficiency. This approach also applies to other ILP problems with similar characteristics and fundamentally changes the way how such problems are formulated and solved.

This paper presents a new optimization-based approach to determine the class of stabilizing control structures with the necessary set of feedback links for interconnected systems. The proposed approach relies on a graph theoretic interpretation and its equivalence in terms of binary linear programs (BLP). To carry out the primary goal, first, the stabilizability of an LTI system under the decentralized control structure is presented in terms of a BLP. Next, two graph-based criteria are proposed to characterize stabilizing control structures with the required feedback links. Finally, all possible stabilizing control structures with the necessary feedback links are derived via solving a set of BLPs. In addition to the analysis of stabilizing control structures, the proposed graph-theoretic approach offers a versatile set of tools to find the simplest control structures capable of assigning the closed-loop spectrum in a totally arbitrary desired region. Simulation results illustrate the assessment of stabilizing control structures, the required additional feedback links, and the elegant generalization of the proposed approach to regional pole-placement.

Devices that measure our physical, medical and mental condition have entered our daily life recently. Such devices measure our status in a continuous manner and can be useful in predicting future medical events or can guide us towards a healthier life. It is therefore important to establish that such devices record our behaviour in a reliable manner and measure what we believe they measure. In this article, we propose to measure the reliability and validity of a newly developed measuring device in time using a longitudinal model for sequential kappa statistics. We propose a Bayesian estimation procedure. The method is illustrated by a validation study of a new accelerometer in cardiopulmonary rehabilitation patients.

Feature selection is performed to eliminate irrelevant features to reduce computational overheads. Metaheuristic algorithms have become popular for the task of feature selection due to their effectiveness and flexibility. Hybridization of two or more such metaheuristics has become popular in solving optimization problems. In this paper, we propose a hybrid wrapper feature selection technique based on binary butterfly optimization algorithm (bBOA) and Simulated Annealing (SA). The SA is combined with the bBOA in a pipeline fashion such that the best solution obtained by the bBOA is passed on to the SA for further improvement. The SA solution improves the best solution obtained so far by searching in its neighborhood. Thus the SA tries to enhance the exploitation property of the bBOA. The proposed method is tested on twenty datasets from the UCI repository and the results are compared with five popular algorithms for feature selection. The results confirm the effectiveness of the hybrid approach in improving the classification accuracy and selecting the optimal feature subset.

We propose a heuristic approach for solving binary Multiple Instance Learning (MIL) problems, whose objective is to categorize bags of instances. Considering the case with two classes of instances, on the basis of the standard MIL assumption, a bag is classified positive if it contains at least a positive instance and negative if all its instances are negative. Inspired by a well-established MIL Support Vector Machine type approach, our technique is based on iteratively separating the bags by means of successive maximum-margin spheres. Such spheres, whose number is automatically determined, are generated by computing, for each of them, the optimal radius in correspondence to a prefixed center. Numerical results are presented on a set of benchmark test problems, showing the effectiveness of our approach.

The design of binary sequences with low autocorrelation sidelobes is critically important to diverse applications including, radar and sonar as well as communications. Many computational methods have been proposed recently to design binary sequences through optimizing the integrated sidelobe level (ISL, which is a commonly used optimization metric. However, due to the high computational complexities, few of them can be used for long binary sequence designs, which are needed in, for example, low-cost commercial automotive radar systems. To improve the performance of the recently introduced FFT-based CANARY algorithm for long aperiodic binary sequence designs, we introduce a new penalty function into the ISL metric and also propose a new framework of double-loop iterations. These new ideas are also extended to design long periodic binary sequences with low autocorrelation sidelobes and long aperiodic and periodic binary sequences with low correlation zones (LCZs . The associated cost functions are still optimized efficiently via FFT-based iterations, making the proposed algorithms computationally efficient and hence suitable for long binary sequence designs. Moreover, the convergence properties and the computational complexities of these algorithms are analyzed. Numerical examples are provided to demonstrate the effectiveness of the proposed algorithms.

Human-oriented and machine-generated data in cyber-physical-social systems are often complicated graph-structured. Graph-powered learning methods are conducive to discovering valuable knowledge from large scale graph data and improving decision making processes. However, due to the neglect of diverse relations among things, most existing knowledge reasoning studies are inherently flawed and inefficient in processing the heterogeneous graphs with high-order connectivity. Tensor, as a powerful and effective tool to model high-level semantic interactions between various things, can provide high-order IoT graph with new perspectives and possibilities. Therefore, this paper innovatively proposes a collaborative Artificial Intelligence of Things data analysis and application framework based on Boolean tensors, which supports the expression and fusion of heterogeneous graph and ultimately promotes the AI processing. In this context, we focus on developing an incremental Boolean tensor factorization (IBTF) approach for efficient knowledge reasoning to meet the requirements of real-time and high level quality demands for intelligent services. To the best of our knowledge, we are the first to do this work. More concretely, we present factors update and binary features merge algorithms for the integrated graph tensors to avoid numerous repeated calculations of historical data. Experimental results on general synthetic data sets demonstrate that the IBTF approach proposed in this paper guarantees nearly equal approximate accuracy while reducing execution time by dozens and even more of times. Furthermore, experimental evaluations and interpretability analysis on real-world datasets verify the practicality of the proposed framework and approach.

Decades of research suggest that information exchange in groups and organizations can reliably improve judgment accuracy in tasks such as financial forecasting, market research, and medical decision making. However, we show that improving the accuracy of numeric estimates does not necessarily improve the accuracy of decisions. For binary-choice judgments, also known as classification tasks—for example, yes/no or build/buy decisions—social influence is most likely to grow the majority vote share, regardless of the accuracy of that opinion. As a result, initially, inaccurate groups become increasingly inaccurate after information exchange, even as they signal stronger support. We term this dynamic the “crowd classification problem.” Using both a novel data set and a reanalysis of three previous data sets, we study this process in two types of information exchange: (1) when people share votes only, and (2) when people form and exchange numeric estimates prior to voting. Surprisingly, when people exchange numeric estimates prior to voting, the binary-choice vote can become less accurate, even as the average numeric estimate becomes more accurate. Our findings recommend against voting as a form of decision making when groups are optimizing for accuracy. For those cases where voting is required, we discuss strategies for managing communication to avoid the crowd classification problem. We close with a discussion of how our results contribute to a broader contingency theory of collective intelligence. This paper was accepted by Lamar Pierce, organizations.

Fuzzing is a technique of finding bugs by executing a target program recurrently with a large number of abnormal inputs. Most of the coverage-based fuzzers consider all parts of a program equally and pay too much attention to how to improve the code coverage. It is inefficient as the vulnerable code only takes a tiny fraction of the entire code. In this article, we design and implement an evolutionary fuzzing framework called V-Fuzz, which aims to find bugs efficiently and quickly in limited time for binary programs. V-Fuzz consists of two main components: 1) a vulnerability prediction model and 2) a vulnerability-oriented evolutionary fuzzer. Given a binary program to V-Fuzz, the vulnerability prediction model will give a prior estimation on which parts of a program are more likely to be vulnerable. Then, the fuzzer leverages an evolutionary algorithm to generate inputs which are more likely to arrive at the vulnerable locations, guided by the vulnerability prediction result. The experimental results demonstrate that V-Fuzz can find bugs efficiently with the assistance of vulnerability prediction. Moreover, V-Fuzz has discovered ten common vulnerabilities and exposures (CVEs), and three of them are newly discovered.

Road detection is widely used in driving assistance and automotive driving. However, many state-of-the-art road de-tection methods are time-consuming and memory-consuming. In this paper, we propose an FPGA-based deep learning accelerator using the binary SegNet (BSegNet) with computing-near-memory (CNM) architecture for road detection at edges. The accelerator has optimized CNM architecture with massive bit-level parallel processing elements (PEs) and pipeline for low latency of the crit-ical path. The training model size of BSegNet with binary param-eters is only 2.1MB, and the BSegNet can achieve training accu-racy over 85% on KITTI and Cityscapes datasets. The RTL-level realized FPGA-accelerator can process the road detection with an energy-efficiency of 351.7 GOPs/W and only 18.70 W on-chip power.

The US Department of Energy’s fastest supercomputers and forthcoming exascale systems employ Graphics Processing Units (GPUs) to increase the computational performance of compute nodes. However, the complexity of GPU architectures makes tailoring sophisticated applications to achieve high performance on GPU-accelerated systems a major challenge. At best, prior performance tools for GPU code only provide coarse-grained tuning advice at the kernel level. In this article, we describe GPA, a performance advisor that suggests potential code optimizations at a hierarchy of levels, including individual lines, loops, and functions. To gather the fine-grained measurements needed to produce such insights, GPA uses instruction sampling and binary instrumentation to monitor execution of GPU code. At the time of this writing, GPU instruction sampling is only available on NVIDIA GPUs. To understand performance losses, GPA uses data flow analysis to approximately attribute measured instruction stalls back to their causes. GPA then analyzes patterns of stalls using information about a program’s structure and the GPU architecture to identify optimization strategies that address inefficiencies observed. GPA then employs detailed performance models to estimate the potential speedup that each optimization might provide. Experiments with benchmarks and applications show that GPA provides useful advice for tuning GPU code. We applied GPA to analyze and tune a collection of codes on NVIDIA V100 and A100 GPUs. GPA suggested optimizations that it estimates will accelerate performance across the set of codes by a geometric mean of 1.21×. Applying these optimizations suggested by GPA accelerated these codes by a geometric mean of 1.19×.

With the increasing demand for surveillance applications, pedestrian detection has been a topic of interest for many researchers in recent time. The quality of a pedestrian detector is decided in terms of detection accuracy and rate of detection. This paper presents new pedestrian detectors based on two types of classifiers, linear support vector machine and cascade of boosted classifier. These classifiers are trained by using a feature set comprising of the histogram of oriented gradients and dense local difference binary features. Both the image pyramid and non-linear scale space are used to detect pedestrians of various sizes. In order to combine the benefits of the two classifiers, a new two-stage detection scheme is also presented. The detection accuracies of the proposed detectors are studied in terms of miss-rate versus false positive per image and miss-rate versus false positive per window. The performances of the detectors are also compared with the performances of existing detectors of similar type.

Bernoulli multi-armed bandits are a reinforcement learning model used to optimize sequences of decisions with binary outcomes. Well-known bandit algorithms, including the optimal policy, assume that before a decision is made the outcomes of previous decisions are known. This assumption is often not satisfied in real-life scenarios. As demonstrated in this paper, if decision outcomes are affected by delays, the performance of existing algorithms can be severely affected. We present the first practically applicable method to compute statistically optimal decisions in the presence of outcome delays. Our method has a predictive component abstracted out into a meta-algorithm, PARDI, which significantly reduces the impact of delays on commonly used algorithms. We demonstrate empirically that PARDI-enhanced Whittle Index is nearly optimal for a wide range of Bernoulli bandit parameters and delays. In a wide spectrum of experiments it performed better than any other suboptimal algorithm, e.g., UCB1-Tuned and Thompson sampling. PARDI-enhanced Whittle Index can be used when computational requirements of the optimal policy are too high.

In this paper, we propose a Structure-adaptive Neighborhood Preserving Hashing (SNPH) method for unsupervised scalable video search. Unlike most existing hashing methods which equally encode an entire video into a binary feature vector, we propose a neighborhood attention mechanism which encodes the neighborhood-relevant content of a video to better preserve the neighborhood relationships among videos. Motivated by the fact that a video usually contains multiple shots and each shot depicts a different activity, we further develop a structure-adaptive encoder to model the hierarchical structure of the video. Specifically, the encoder adaptively divides each video into multiple segments via detecting temporal boundaries across frames and encodes these segments as a compact binary vector to capture rich structural information. We integrate the neighborhood attention mechanism into the structure-adaptive encoder to learn hash functions that jointly preserve the neighborhood relationships among videos and exploit the hierarchical structure in a video. Experimental results on three widely used benchmark datasets show that our proposed method consistently outperforms state-of-the-art unsupervised video hashing methods.

The class imbalance problem has posed a leading challenge in real-world applications. Traditional methods focus on either the data level or algorithm level to solve the binary classification problem on imbalanced data, and seldom consider searching an effective transformation for classification. Besides, the undersampling process adopted in them is always subjective and unilateral. To address the above issues, we first propose a hybrid classifier ensemble (HCE) framework to conduct binary imbalanced data classification, which mainly includes a metric-based data space transformation (MDST) and an adaptive two-stage undersampling process (ATUP). The MDST aims to find a more appropriate embedding space for original imbalance data sets, and the ATUP considers both informative and representative samples to generate balanced data sets. Furthermore, we design a progressive HCE (PHCE) framework to improve the performance of HCE by utilizing a progressive mechanism with local and global evaluation criteria to select ensemble members. Extensive comparative experiments conducted on 28 real-world data sets exhibit that our method PHCE outperforms the majority of imbalance ensemble classification approaches.

Publisher Summary The basic objectives of object measurement are application dependent. It can be used simply to provide a measure of the object morphology or structure by defining its properties in terms of area, perimeter, intensity, color, shape, etc. It can also be used to differentiate between objects by measuring and comparing their properties. Object measurements can be broadly classified as geometric measures, ones based on the histogram of the object image, and those based on the intensity of the object. Geometric measures, including those that quantify object structure, can be computed for both binary and grayscale objects. In contrast, histogram- and intensity-based measures are applicable to grayscale objects. Another category of measures, which are distance based, can be used for computing the distance between objects or between two or more components of objects.

Digital images used in business, government and medical sectors insist the need for image security against various threats. An exclusive system that can make use of color spaces has been proposed to process sensitive images based on the binary curve. The proposed Encryption systeM fOr proTecting imagEs has been coined as EMOTE. This multilayered system works on binary curves as binary operations have no carries. Since binary squaring is lightweight, it is claimed to be smaller and faster in hardware than prime-field ones. Logistic mapping has been done to perform chaotic masking, which is then followed by DNA encoding in the next layer. ECC over GF(2m) that works on the spatial domain has been chosen as it is one of the proven technique for its mathematical strength. This proposed system can facilitate both symmetric and asymmetric combination and hence hybrid. Experimental results and the histogram analysis obtained comprehend this proposed system for its extensive deployment to process sensitive images, especially in the medical domain. Ideal measures attained for MSE, PSNR values for the standard benchmark images taken from “The whole brain atlas” database from Harvard University, substantiate the proposed EMOTE system as an expedient choice for processing sensitive images.

We present a progressive approximation algorithm for the exact solution of several classes of interdiction games in which two noncooperative players (namely an attacker and a follower) interact sequentially. The follower must solve an optimization problem that has been previously perturbed by means of a series of attacking actions led by the attacker. These attacking actions aim at augmenting the cost of the decision variables of the follower’s optimization problem. The objective, from the attacker’s viewpoint, is that of choosing an attacking strategy that reduces as much as possible the quality of the optimal solution attainable by the follower. The progressive approximation mechanism consists of the iterative solution of an interdiction problem in which the attacker actions are restricted to a subset of the whole solution space and a pricing subproblem invoked with the objective of proving the optimality of the attacking strategy. This scheme is especially useful when the optimal solutions to the follower’s subproblem intersect with the decision space of the attacker only in a small number of decision variables. In such cases, the progressive approximation method can solve interdiction games otherwise intractable for classical methods. We illustrate the efficiency of our approach on the shortest path, 0-1 knapsack and facility location interdiction games. Summary of Contribution: In this article, we present a progressive approximation algorithm for the exact solution of several classes of interdiction games in which two noncooperative players (namely an attacker and a follower) interact sequentially. We exploit the discrete nature of this interdiction game to design an effective algorithmic framework that improves the performance of general-purpose solvers. Our algorithm combines elements from mathematical programming and computer science, including a metaheuristic algorithm, a binary search procedure, a cutting-planes algorithm, and supervalid inequalities. Although we illustrate our results on three specific problems (shortest path, 0-1 knapsack, and facility location), our algorithmic framework can be extended to a broader class of interdiction problems.

Natural disasters such as major storms or hurricanes can seriously threaten the resilience of large and coupled infrastructures such as power distribution and transportation systems. This paper proposes a planning (i.e., investment + operation) method for presenting the enhanced resilience of coupled transportation and power distribution systems. The proposed investment method includes capacity expansion of power lines, roads, and charging stations, and the hardening of roads and power lines. A tri-level problem is proposed and formulated to accommodate random natural disasters. The proposed model is solved by applying Benders decomposition and column-and-constraint (C&CG) algorithms. Benders decomposition will decompose the tri-level coupled problem into a single-level master problem and bi-level subproblem. However, the latter with binary variables is not a convex problem and cannot be converted to the max problem. The C&CG algorithm is applied to solve the bi-level subproblem with binary variables. The proposed resilience enhancement algorithm is tested and numerical results are provided for coupled transportation and power distribution systems with 21 electric buses and 20 roads, to validate the effectiveness of the proposed planning method.

In many practical applications, the data are class imbalanced. Accordingly, it is very meaningful and valuable to investigate the classification of imbalanced data. In the framework of binary imbalanced data classification, the synthetic minority oversampling technique (SMOTE) is the best-known oversampling method. However, for each positive sample, SMOTE generates only k synthetic samples on the lines between the positive sample and its k -nearest neighbors, resulting in three drawbacks: (1) SMOTE cannot effectively extend the training field of positive samples; (2) the generated positive samples lack diversity; (3) SMOTE does not accurately approximate the probability distribution of the positive samples. Therefore, two binary imbalanced data classification methods named BIDC1 and BIDC2 based on diversity oversampling by generative models are proposed. The BIDC1 and BIDC2 conduct diversity oversampling using extreme learning machine autoencoder and generative adversarial network, respectively. Extensive experiments on 26 data sets are conducted to compare the two methods with 14 state-of-the-art methods using five metrics: F-measure, G-means, AUC-area, MMD-score, and Silhouette-score. The experimental results demonstrate that the two methods outperform the other 14 methods.

Reduction of redundancy and improvement of error-correcting capability are essential research themes in the coding theory. The best codes constructed in various ways are recorded in a database maintained by Markus Grassl. In this paper, we propose an algorithm to construct the best code using punctured codes and a supporting method for constructing the best codes. First, we define a new evaluation function to determine deletion bits and propose an algorithm for constructing punctured linear codes. 36 best codes were constructed in the proposed algorithm, and 131 best codes were constructed by further modifying those best codes. Secondly, we evaluate the possibility of increasing the minimum distance based on the relationship between code length, information length, and minimum distance. We narrowed down the target (n,k) code to try the best code search based on the evaluation and found 30 other best codes.

Slip status of drill string is system generated binary value computed by comparison of sensor generated real time hook load value with a minimum threshold value of hook load stored in measurement system. This research article describes a novel method of slip status detection by machine vision technology which helps overcome the constraints of slip status detection with legacy measurement method. It also helps improve the real time drilling data quality and optimize and automate drilling operations. A method to detect drill string slip status with high-resolution digital camera installed on mast near rig floor is described along with backend vision processing and communication modules, which generate binary values of slip status. The binary values are transferred in real time to drilling measurement system of rig to compute other drilling parameters like bit depth, hole depth and stand counters. This method includes deploying active optical sensors at the rig floor, obtaining 1-D, 2-D, or 3D image data, and processing it to obtain the status of drill string. Reliable measurement of slip status by machine vision helps reduce non-productive time (NPT) by reliable real time surveillance of drilling operations.

Since last few years, microarray technology has got tremendous application in many bio-medical researches. However, in order to efficiently recognize and apply this technology into the bio-medical areas is still very difficult and expensive. There are many metaheuristic approaches has been developed with different biological interpretation. Despite the existence of several approaches, there is always a requirement of development of more robust and efficient approach. In this work a new metaheuristic approach is proposed implementing binary shuffled frog leaping algorithm (BSFLA) for gene selection. To obtain an optimal gene subset, 20 different combination of gene subset is extracted from the original dataset. Out of which the optimal gene subset is identified implementing KNN classifier. Superiority of these gene set is shown using few other classifiers such as ANN and SVM. The model performance is also compared with few other metaheuristic approaches such as particle swarm optimization, differential evolution and genetic algorithm.

Imbalanced data can always be observed in our daily life and various practical tasks. A lot of well-constructed machine learning methodologies may produce ineffective performance, when conducted on this kind of data. This originates from the produced high training biases that towards the majority class instances. Among all the solutions of this problem, data generation of the minority class is always considered the most effective approach. However, in all the previous works, data are always processed sample-wisely and the distribution of each single data attribute is never noticed. So, in this paper, to estimate the mechanism of how each attribute contributes to its label, we explore the potential connection between the two items by Conditional Generative Adversarial Networks (CGAN) separately and individually. Then, the constructed new instances are purified by a designed attribute-based minimax filter and the survivors are concatenated to form the eventual generated data. In other words, different from the CGAN based data generation way, the proposed approach improves it by additionally considering all the single attribute patterns of the data that to construct new instances. In addition, we extend the binary class imbalanced learning framework to multiple class one. In the experimental part, the improved model is compared against GAN, CGAN and some other standard multiple-class oversampling algorithms on several widely used datasets. Results, in terms of four common measurements, have shown that the proposed approach can produce comparable and always superior performance when compared with the competitors.

Feature selection is a significant task in the workflow of predictive modeling for data analysis. Recent advanced feature selection methods are using the power of optimization algorithms for choosing a subset of relevant features to get better classification results. Most of the optimization algorithms like genetic algorithm use many controlling parameters which need to be tuned for better performance. Tuning these parameter values is a challenging task for the feature selection process. In this paper, we have developed a new wrapper-based feature selection method called binary teaching learning based optimization (FS-BTLBO) algorithm which needs only common controlling parameters like population size, and a number of generations to obtain a subset of optimal features from the dataset. We have used different classifiers as an objective function to compute the fitness of individuals for evaluating the efficiency of the proposed system. The results have proven that FS-BTLBO produces higher accuracy with a minimal number of features on Wisconsin diagnosis breast cancer (WDBC) data set to classify malignant and benign tumors.

We consider a complex Gaussian wiretap channel with finite-resolution analog-to-digital converters (ADCs) at both the legitimate receiver and the eavesdropper. For this channel, we show that a positive secrecy rate is always achievable as long as the channel gains at the legitimate receiver and at the eavesdropper are different, regardless of the quantization levels of the ADCs. For the achievability, we first consider the case of one-bit ADCs at the legitimate receiver and apply a binary input distribution where the two input points have the same phase when the channel gain at the legitimate receiver is less than that at the eavesdropper, and otherwise the opposite phase. Then the result is generalized for the case of arbitrary finite-resolution ADCs at the legitimate receiver by translating the input distribution appropriately. For the special case of the real Gaussian wiretap channel with one-bit ADCs at both the legitimate receiver and the eavesdropper, we show that our choice of input distribution satisfies a necessary condition of optimal distributions for Wyner codes., This paper was submitted to IEEE Transactions on Information Theory, and was presented in part at ITW 2019 in Visby, Sweden in Aug 2019

The grasshopper optimization algorithm is one of the recently population-based optimization techniques inspired by the behaviours of grasshoppers in nature. It is an efficient optimization algorithm and since demonstrates excellent performance in solving continuous problems, but cannot resolve directly binary optimization problems. Many optimization problems have been modelled as binary problems since their decision variables varied in binary space such as feature selection in data classification. The main goal of feature selection is to find a small size subset of feature from a sizeable original set of features that optimize the classification accuracy. In this paper, a new binary variant of the grasshopper optimization algorithm is proposed and used for the feature subset selection problem. This proposed new binary grasshopper optimization algorithm is tested and compared to five well-known swarm-based algorithms used in feature selection problem. All these algorithms are implemented and experimented assessed on twenty data sets with various sizes. The results demonstrated that the proposed approach could outperform the other tested methods.

Manually picking regularly and densely distributed first breaks (FBs) are critical for shallow velocity-model building in seismic data processing. However, it is time consuming. We employ the fully-convolutional SegNet to address this issue and present a fast automatic seismic waveform classification method to pick densely-sampled FBs directly from common-shot gathers with sparsely distributed traces. Through feeding a large number of representative shot gathers with missing traces and the corresponding binary labels segmented by manually interpreted fully-sampled FBs, we can obtain a well-trained SegNet model. When any unseen gather including the one with irregular trace spacing is inputted, the SegNet can output the probability distribution of different categories for waveform classification. Then FBs can be picked by locating the boundaries between one class on post-FBs data and the other on pre-FBs background. Two land datasets with each over 2000 shots are adopted to illustrate that one well-trained 25-layer SegNet can favorably classify waveform and further pick fully-sampled FBs verified by the manually-derived ones, even when the proportion of randomly missing traces reaches 50%, 21 traces are missing consecutively, or traces are missing regularly.

Occupancy grids encode for hot spots on a map that is represented by a two dimensional grid of disjoint cells. The problem is to recursively update the probability that each cell in the grid is occupied, based on a sequence of sensor measurements from a moving platform. In this paper, we provide a new Bayesian framework for generating these probabilities that does not assume statistical independence between the occupancy state of grid cells. This approach is made analytically tractable through the use of binary asymmetric channel models that capture the errors associated with observing the occupancy state of a grid cell. Binary-valued measurement vectors are the thresholded output of a sensor in a radar, sonar, or other sensory system. We compare the performance of the proposed framework to that of the classical formulation for occupancy grids. The results show that the proposed framework identifies occupancy grids with lower false alarm and miss detection rates, and requires fewer observations of the surrounding area, to generate an accurate estimate of occupancy probabilities when compared to conventional formulations.

In this paper, we employ multiple wireless-powered relays to assist information transmission from a multi-antenna access point to a single-antenna receiver. The wireless relays can operate in either the passive mode via backscatter communications or the active mode via RF communications, depending on their channel conditions and energy states. We aim to maximize the overall throughput by jointly optimizing the access point's beamforming and the relays' radio modes and operating parameters. Due to the non-convex and combinatorial structure, we develop a novel optimization-driven hierarchical deep deterministic policy gradient (H-DDPG) approach to adapt the beamforming and relay strategies dynamically. The optimization-driven H-DDPG algorithm firstly decomposes the binary relay mode selection into the outer-loop deep Q-network (DQN) algorithm and then optimizes the continuous beamforming and relaying parameters by using the inner-loop DDPG algorithm. Secondly, to improve the learning efficiency, we integrate the model-based optimization into the DDPG framework by providing a better-informed target estimation for DNN training. Simulation results reveal that these two special designs ensure a more stable learning and achieve a higher reward performance, up to nearly 20%, compared to the conventional DDPG approach., Comment: 29 pages, 7 figures, 2 tables, submitted to IEEE Transactions on Wireless Communications

Target detection based on wireless sensor networks can be considered as a distributed binary hypothesis testing problem. In this paper, the evolution of detection error probability with the increase of network scale is studied for the balanced binary relay tree network with channel noise. Firstly, the iterative expressions of false-alarm probability and missed-detection probability depending on the number of tree network layers are given. Then, the iterative process of two types of error probabilities in the network space is described as a discrete nonlinear switched dynamic system, and the dynamic properties of two types of error probabilities are analyzed in a plane rectangular coordinate system. A globally attractive invariant set of the state of the dynamic system, which is not related to the channel noise, is derived. The switching mode of the system and the total error probability in the invariant set are further analyzed, and a necessary and sufficient convergence condition of the total error probability is provided. Based on this condition the following detection properties of the network are revealed: (1) as long as the channel bit error probability is not zero, the total error probability does not tend to zero with the increasing network size; (2) when the channel bit error probability is greater than 2-/3/ 2 the total error probability will continue to increase with the increase of network size.

Hyperspectral images containing tens to hundreds of bands can be used in various image classification tasks. However, due to the high data redundancy of the spectral information, the acquiring and analysis of hyperspectral images are usually relatively time-consuming and wasteful of storage space, and therefore limit the practical application of hyperspectral images. Selecting a subset of bands without sacrificing classification accuracy is a strategy to relieve such problems. In this letter, we present an optimization-based method, which can jointly optimize the band selection and the classification network parameters for hyperspectral images. The proposed method regards the discrete selection problem as a continuous constrained optimization problem and adaptively selects the informative band subsets for classification. Besides, experimental results on three public data sets show that our band selection method outperforms the state-of-the-art methods in terms of classification accuracy.

There is an urgent need to efficiently compress Light Detection and Ranging (LiDAR) point cloud geometries. However, few studies consider geometry inter-prediction for exploiting temporal correlations between different LiDAR point cloud frames. In this paper, we investigate two fundamental problems of geometry inter-prediction: motion estimation (ME) and coding structure under the inter-exploration model of geometry-based point cloud compression (G-PCC). Under the inter-exploration model of G-PCC, the key to a good ME algorithm is to design an accurate criterion for estimating the bit cost of an octree node. In the previous work, a logarithmic relationship between the prediction distortion and the bit cost was used as the criterion. We first note that the multiscale binary prediction residue, instead of the prediction distortion, is the key factor in determining the bit cost. Then, a linear relationship between the number of 1s and 0s in the multiscale binary prediction residue and the bit cost is built and used as the ME criterion. In terms of the coding structure, only the IPPP coding structure is investigated in all previous geometry inter-prediction algorithms. The use of the hierarchical coding structure is first investigated in this paper. We further propose determining the use of the IPPP or hierarchical coding structure at the group of pictures (GoP)-level based on rate distortion optimization to improve the performance. The proposed algorithms are implemented in the inter-exploration model of G-PCC. The experimental results show that compared with the inter-exploration model of G-PCC, the proposed algorithms can provide an average of 2.1% bitrate savings.

Due to high storage and calculation efficiency, hash-based methods have been widely used in image retrieval systems. Unsupervised deep hashing methods can learn the binary representations of images effectively without any annotations. The strategy of constraining hash code in the previous unsupervised methods may not fully utilize the structural information in semantic similarity. To address this problem, we propose a new strategy based on contrastive learning to capture high-level semantic similarity among features and preserve it in generated hash codes. In addition, we employ a novel framework to handle hash codes with different lengths simultaneously which is more time-saving in generating hash codes than existing methods. Extensive experiments on MIRFlickr, NUS-WIDE, and COCO benchmark datasets show that our method makes great improvement on the performance of unsupervised image retrieval.

A key issue for moth search algorithm (MS) is the ability to maintain sufficient diversity in the population so as to be able to track a dynamically changing landscape. However, for the original MS algorithm, the implicit learning mechanism of flight straightly operator focuses mainly on the global best individual, which inevitably causes a deteriorated evolution. To increase the population diversity and enhance the global search ability of MS, a binary moth search algorithm based on self-learning (SLMS) is proposed to solve an NP-hard combinatorial optimization problem with many diverse applications, the 0–1 multidimensional knapsack problem (MKP). In SLMS, a self-learning flight straightly operator is proposed to make each individual learn from any one better than itself, not just the global best individual. The performance of the proposed SLMS is validated by testing 89 different widely used benchmark instances. Experimental results show the effectiveness of the proposed SLMS in solving the MKP problem and the self-learning flight straightly operator can enhance population diversity and global search ability. The effect of transfer functions on the performance of SLMS is also investigated.