49 results on '"Carlos Hernández"'
Search Results
2. SUAVE: An Exemplar for Self-Adaptive Underwater Vehicles
- Author
-
Silva, Gustavo Rezende, Päßler, Juliane, Zwanepol, Jeroen, Alberts, Elvin, Tarifa, S. Lizeth Tapia, Gerostathopoulos, Ilias, Johnsen, Einar Broch, Corbato, Carlos Hernández, Silva, Gustavo Rezende, Päßler, Juliane, Zwanepol, Jeroen, Alberts, Elvin, Tarifa, S. Lizeth Tapia, Gerostathopoulos, Ilias, Johnsen, Einar Broch, and Corbato, Carlos Hernández
- Abstract
Once deployed in the real world, autonomous underwater vehicles (AUVs) are out of reach for human supervision yet need to take decisions to adapt to unstable and unpredictable environments. To facilitate research on self-adaptive AUVs, this paper presents SUAVE, an exemplar for two-layered system-level adaptation of AUVs, which clearly separates the application and self-adaptation concerns. The exemplar focuses on a mission for underwater pipeline inspection by a single AUV, implemented as a ROS 2-based system. This mission must be completed while simultaneously accounting for uncertainties such as thruster failures and unfavorable environmental conditions. The paper discusses how SUAVE can be used with different self-adaptation frameworks, illustrated by an experiment using the Metacontrol framework to compare AUV behavior with and without self-adaptation. The experiment shows that the use of Metacontrol to adapt the AUV during its mission improves its performance when measured by the overall time taken to complete the mission or the length of the inspected pipeline.
- Published
- 2023
- Full Text
- View/download PDF
3. A Compact Answer Set Programming Encoding of Multi-Agent Pathfinding
- Author
-
Rodrigo N. Gómez, Jorge A. Baier, and Carlos Hernández
- Subjects
Quadratic growth ,0209 industrial biotechnology ,Mathematical optimization ,General Computer Science ,Job shop scheduling ,Computer science ,multi-agent pathfinding ,General Engineering ,Answer set programming ,02 engineering and technology ,Solver ,Grid ,020901 industrial engineering & automation ,Encoding (memory) ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,General Materials Science ,lcsh:Electrical engineering. Electronics. Nuclear engineering ,Electrical and Electronic Engineering ,Pathfinding ,Boolean satisfiability problem ,lcsh:TK1-9971 - Abstract
Multi-agent pathfinding (MAPF) is the problem of finding $k$ non-colliding paths connecting $k$ given initial positions with $k$ given goal positions on a given map. In its sum-of-costs variant, the total number of moves and wait actions performed by agents before they definitely reach the goal is minimized. Not surprisingly, since MAPF is combinatorial, a number of compilations to Boolean Satisfiability (SAT) and Answer Set Programming (ASP) exist. In this article, we describe in detail the first family of compilations to ASP that solve sum-of-costs MAPF over 4-connected grids. Compared to existing ASP compilations, a distinguishing feature of our compilation is that the number of total clauses (after grounding) grow linearly with the number of agents, while existing compilations grow quadratically. In addition, the optimization objective is such that its size after grounding does not depend on the size of the grid. In our experimental evaluation, we show that our approach outperforms search-based sum-of-costs MAPF solvers when grids are congested with agents. We also show that our approach is competitive with a SAT-based approach when follow conflicts are taken into account. We also explore the potential of our solver when finding makespan-optimal solutions, in which makespan is minimized first and then cost is minimized. Our results show that makespan-optimal solutions are slightly suboptimal in most benchmarks. Moreover, our MAPF solver, when run in that mode, is faster and scales better.
- Published
- 2021
4. Assessment of a Latency-aware Routing and Spectrum Assignment Mechanism Based on Deep Reinforcement Learning
- Author
-
Carlos Hernández-Chulde, R. Martinez, Raul Munoz, Ramon Casellas, and Ricard Vilalta
- Subjects
Computer science ,business.industry ,Spectrum (functional analysis) ,Mechanism based ,Reinforcement learning ,Latency (engineering) ,Routing (electronic design automation) ,business ,Computer network - Abstract
We present a solution based on deep reinforcement learning (DRL) that jointly addresses spectrum allocation and latency constraint in EONs. The results show that using a simple network representation, this strategy outperforms typical K-Shortest Path heuristic approach and previous DRLbased approaches., The research leading to these results has received funding from MINECO Project AURORAS (RTI2018-099178) and Spanish Thematic Network Go2Edge (RED2018-102585-T).
- Published
- 2021
5. A Modeling Tool for Reconfigurable Skills in ROS
- Author
-
Mario Garzon Oviedo, Darko Bozhinoski, Esther Aguado, Ricardo Sanz, Carlos Hernández, and Andrzej Wasowski
- Subjects
Domain-specific language ,self adaptive systems ,business.industry ,Computer science ,Patrolling ,Design tool ,Maintainability ,Semantic reasoner ,Reuse ,autonomous robots ,Robot ,ontologies ,domain specific language ,Software engineering ,business ,Adaptation (computer science) ,ROS2 tool - Abstract
Known attempts to build autonomous robots rely on complex control architectures, often implemented with the Robot Operating System platform (ROS). The implementation of adaptable architectures is very often ad hoc, quickly gets cumbersome and expensive. Reusable solutions that support complex, runtime reasoning for robot adaptation have been seen in the adoption of ontologies. While the usage of ontologies significantly increases system reuse and maintainability, it requires additional effort from the application developers to translate requirements into formal rules that can be used by an ontological reasoner. In this paper, we present a design tool that facilitates the specification of reconfigurable robot skills. Based on the specified skills, we generate corresponding runtime models for self-adaptation that can be directly deployed to a running robot that uses a reasoning approach based on ontologies. We demonstrate the applicability of the tool in a real robot performing a patrolling mission at a university campus.
- Published
- 2021
6. K-Focal Search for Slow Learned Heuristics
- Author
-
Matias Greco, Jorge Toro, Carlos Hernandez, and Jorge A. Baier
- Subjects
Bounded-suboptimal search ,heuristic search ,learned heuristics ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Bounded suboptimal heuristic search is a family of search algorithms capable of solving hard combinatorial problems, returning suboptimal solutions within a given bound. Recent machine learning approaches have been shown to learn accurate heuristic functions. Learned heuristics, however, are slow to compute; concretely, given a single search state $s$ and a learned heuristic $h$ , evaluating $h(s)$ is typically very slow relative to expansion time, since state-of-the-art learned heuristics are implemented as neural networks. However, by using a Graphics Processing Unit (GPU), it is possible to compute heuristics using batched computation. Existing approaches to batched heuristic computation are specific to satisficing search and have not studied the problem in the context of bounded-suboptimal search. In this paper, we present K-Focal Search, a bounded suboptimal search algorithm that in each iteration expands $K$ states from the FOCAL list and computes the learned heuristic values of the successors using a GPU. We experiment over the 24-puzzle and Rubik’s Cube using DeepCubeA, a very effective and inadmissible learned heuristic. Our results show that K-Focal Search benefits both from batched computation and from the diversity in the search introduced by its expansion strategy. Over standard Focal Search, K-Focal Search improves runtime by a factor of 6, expansions by up to three orders of magnitude, and finds better quality solutions, keeping the theoretical guarantees of Focal Search.
- Published
- 2024
- Full Text
- View/download PDF
7. Heuristic Function to Solve The Generalized Covering TSP with Artificial Intelligence Search
- Author
-
Matias Greco and Carlos Hernández
- Subjects
0209 industrial biotechnology ,business.industry ,Computer science ,Process (computing) ,Best-first search ,02 engineering and technology ,Function (mathematics) ,Heuristic function ,Travelling salesman problem ,020901 industrial engineering & automation ,Search algorithm ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Artificial intelligence ,Heuristics ,business - Abstract
Search is a universal problem-solving method in Artificial Intelligence. Specifically, Heuristic Search algorithms, such as A*, use a heuristic function to guide the search process. The heuristic function allows algorithms to explore only a part of the search space, resulting in an efficient search process. This paper presents a new heuristic function to solve the Generalized Covering Traveling Salesman Problem (GCTSP). The heuristic function is precalculated. The method to obtain the function is pre-calculating optimal solutions consecutively to small sub-problems of the GCTSP of increasing difficulty, using an incremental Best First Search algorithm, which reuses heuristics values previously precalculated. The resultating heuristic function can be used with different heuristic search algorithms. To the best of our knowledge, this problem has not been solved with Heuristic Search. This paper is the first to present a solution to the GCTSP using Heuristic Search algorithms, such as A* and Anytime search algorithms. We evaluated different Heuristic Search algorithms. The experimental evaluation shows results of the same quality, obtained orders-of-magnitude faster than the exact methods traditionally used in Operations Research.
- Published
- 2020
8. Robotical Implementations of Collision-Free Path Planning for Terrestrial Systems using RGPPM
- Author
-
Angel Corona-Avelizapa, Miguel Garrido-Grajales, Sergio Hernandez-Mendez, and Carlos Hernández-Mejía
- Subjects
Computer Science::Robotics ,Computer science ,Collision free ,Distributed computing ,Key (cryptography) ,CPU time ,Robot ,Motion planning ,Grid ,Implementation ,Collision avoidance - Abstract
Path planning has been considered as key part for expanding the intelligent properties because it faces the problem of finding collision-free motions for robot systems from one configuration to another. Resistive Grid Path Planning Methodology (RGPPM) is a novel and reduced CPU time modelling and simulation procedure for robotic motions planning. In this paper, robotical implementations of collision-free path planning using an emerging grid-based methodology is carried out by embedded systems applications and robot application framework.
- Published
- 2019
9. PWL Window Function for Nonlinear Memristive Systems
- Author
-
Carlos Hernández-Mejía and Delia Torres-Muñoz
- Subjects
010302 applied physics ,0209 industrial biotechnology ,State variable ,Computer science ,02 engineering and technology ,Memristor ,Function (mathematics) ,Topology ,01 natural sciences ,Window function ,law.invention ,Modeling and simulation ,Nonlinear system ,Hysteresis ,Computer Science::Emerging Technologies ,020901 industrial engineering & automation ,law ,0103 physical sciences ,Electronic circuit - Abstract
Memristor and memristive circuits exhibit a hysteresis v-i characteristic, which is strongly dependent on the state variable function. In this way, controlling the state variable performance can give a more realistic description of the device. This work presents the use of a PWL window function to establish the behavior of the state variable function with the purpose of analyzing the influence of the novel window function in the characteristic curves of the memristive systems, such as: the pinched hysteresis loop and the memristance. The notion of asymmetrical window functions is introduced in order to catch sight of the advantages of the PWL window functions compared to the typical window functions. Moreover, a simple comparison regarding several window functions is achieved.
- Published
- 2019
10. Multi-Agent Pathfinding with Real-Time Heuristic Search
- Author
-
Carlos Hernández, Vadim Bulitko, William Yeoh, Devon Sigurdson, and Sven Koenig
- Subjects
Theoretical computer science ,Heuristic search algorithm ,Heuristic ,Computer science ,Bounded function ,0202 electrical engineering, electronic engineering, information engineering ,Task analysis ,020207 software engineering ,020201 artificial intelligence & image processing ,02 engineering and technology ,Pathfinding ,Task (project management) - Abstract
Multi-agent pathfinding, namely finding collision-free paths for several agents from their given start locations to their given goal locations on a known stationary map, is an important task for non-player characters in video games. A variety of heuristic search algorithms have been developed for this task. Non-real-time algorithms, such as Flow Annotated Replanning (FAR), first find complete paths for all agents and then move the agents along these paths. However, their searches are often too expensive. Real-time algorithms have the ability to produce the next moves for all agents without finding complete paths for them and thus allow the agents to move in real time. Real-time heuristic search algorithms have so far typically been developed for single-agent pathfinding. We, on the other hand, present a real-time heuristic search algorithm for multi-agent pathfinding, called Bounded Multi-Agent A* (BMAA*), that works as follows: Every agent runs an individual real-time heuristic search that updates heuristic values assigned to locations and treats the other agents as (moving) obstacles. Agents do not coordinate with each other, in particular, they neither share their paths nor heuristic values. We show how BMAA* can be enhanced by adding FAR-style flow annotations and allowing agents to push other agents temporarily off their goal locations, when necessary. In our experiments, BMAA* has higher completion rates and lower completion times than FAR.
- Published
- 2018
11. Δp-MOEA: A new multi-objective evolutionary algorithm based on the Δp indicator
- Author
-
Carlos A. Coello Coello, Adriana Menchaca-Mendez, and Carlos Hernández
- Subjects
Mathematical optimization ,Intersection (set theory) ,Evolutionary algorithm ,Boundary (topology) ,Approximation algorithm ,0102 computer and information sciences ,02 engineering and technology ,01 natural sciences ,Multi-objective optimization ,Evolutionary computation ,Set (abstract data type) ,010201 computation theory & mathematics ,0202 electrical engineering, electronic engineering, information engineering ,020201 artificial intelligence & image processing ,Algorithm ,Selection (genetic algorithm) ,Mathematics - Abstract
In this paper, we propose a new selection scheme for Multi-Objective Evolutionary Algorithms (MOEAs) based on the Δ ρ indicator. Our new selection scheme is incorporated into a MOEA giving rise to the “Δρ-MOEA.” Perhaps, one of the most important disadvantages of MOEAs based on Δ ρ is the definition of the reference set. In this work, we propose to create a reference set at each generation using e-dominance and the set of nondominated solutions found so far. Our new selection scheme uses two different techniques to select solutions according to the modified generational distance indicator or the modified inverted generational distance indicator. Our proposed Δ p -MOEA is validated using standard test functions taken from the specialized literature, having three to six objective functions and it is compared with respect to two well-known MOEAs: MOEA/D using Penalty Boundary Intersection (PBI), which is based on decomposition, and SMS-EMOA-HYPE (a version of SMS-EMOA that uses a fitness assignment scheme based on the use of an approximation of the hypervolume indicator).
- Published
- 2016
12. Fast bilateral-space stereo for synthetic defocus
- Author
-
Jonathan T. Barron, Carlos Hernández, Andrew Adams, and YiChang Shih
- Subjects
Stereo cameras ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Stereo pair ,Inference ,Context (language use) ,Space (mathematics) ,Image (mathematics) ,Depth map ,Computer Science::Computer Vision and Pattern Recognition ,Computer vision ,Artificial intelligence ,business ,Stereo camera ,ComputingMethodologies_COMPUTERGRAPHICS ,Mathematics - Abstract
Given a stereo pair it is possible to recover a depth map and use that depth to render a synthetically defocused image. Though stereo algorithms are well-studied, rarely are those algorithms considered solely in the context of producing these defocused renderings. In this paper we present a technique for efficiently producing disparity maps using a novel optimization framework in which inference is performed in “bilateral-space”. Our approach produces higher-quality “defocus” results than other stereo algorithms while also being 10 – 100× faster than comparable techniques.
- Published
- 2015
13. Depth from focus with your mobile phone
- Author
-
Carlos Hernández, Supasorn Suwajanakorn, and Steven M. Seitz
- Subjects
Focus (computing) ,Mobile phone ,Computer science ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer vision ,Artificial intelligence ,business ,Parallax ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
While prior depth from focus and defocus techniques operated on laboratory scenes, we introduce the first depth from focus (DfF) method capable of handling images from mobile phones and other hand-held cameras. Achieving this goal requires solving a novel uncalibrated DfF problem and aligning the frames to account for scene parallax. Our approach is demonstrated on a range of challenging cases and produces high quality results.
- Published
- 2015
14. Accurate Geo-Registration by Ground-to-Aerial Image Matching
- Author
-
Carlos Hernández, Yasutaka Furukawa, Qi Shan, Brian Curless, Steven M. Seitz, and Changchang Wu
- Subjects
Matching (statistics) ,business.industry ,Image matching ,Computer science ,Template matching ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,3D modeling ,Pipeline (software) ,Task (project management) ,Computer vision ,Artificial intelligence ,business ,Pose ,Aerial image - Abstract
We address the problem of geo-registering ground-based multi-view stereo models by ground-to-aerial image matching. The main contribution is a fully automated geo-registration pipeline with a novel viewpoint-dependent matching method that handles ground to aerial viewpoint variation. We conduct large-scale experiments which consist of many popular outdoor landmarks in Rome. The proposed approach demonstrates a high success rate for the task, and dramatically outperforms state-of-the-art techniques, yielding geo-registration at pixel-level accuracy.
- Published
- 2014
15. Occluding Contours for Multi-view Stereo
- Author
-
Yasutaka Furukawa, Brian Curless, Qi Shan, Steven M. Seitz, and Carlos Hernández
- Subjects
Surface (mathematics) ,business.industry ,3D reconstruction ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Computer vision ,Artificial intelligence ,Object (computer science) ,business ,AKA ,Surface reconstruction ,ComputingMethodologies_COMPUTERGRAPHICS ,Mathematics - Abstract
This paper leverages occluding contours (aka "internal silhouettes") to improve the performance of multi-view stereo methods. The contributions are 1) a new technique to identify free-space regions arising from occluding contours, and 2) a new approach for incorporating the resulting free-space constraints into Poisson surface reconstruction. The proposed approach outperforms state of the art MVS techniques for challenging Internet datasets, yielding dramatic quality improvements both around object contours and in surface detail.
- Published
- 2014
16. A fully symbolic homotopy-based memristor model for applications to circuit simulation
- Author
-
Arturo Sarmiento-Reyes, Gerardo Ulises Diaz Arango, Luis Hernandez-Martinez, Carlos Hernández-Mejía, and Hector Vazquez-Leal
- Subjects
Hardware_MEMORYSTRUCTURES ,LOOP (programming language) ,Differential equation ,Computer science ,Homotopy ,Carry (arithmetic) ,Design flow ,Memristor ,Topology ,Surfaces, Coatings and Films ,law.invention ,Computer Science::Hardware Architecture ,Computer Science::Emerging Technologies ,Hardware and Architecture ,law ,Signal Processing ,Electronic engineering ,Electronics ,Mathematics ,Electronic circuit - Abstract
Since the outcoming of the memristor, memristive systems and mem-elements in electronics, new features for analog and digital circuit design have been introduced, and as a result models for the memristor are strongly needed in order to incorporate the device to the design flow loop. In this paper, a model for the memristor is introduced, it is generated by solving the differential equation, that governs the physical functioning of the device, by using a homotopy formulation. The generated model is recast in fully symbolic form that can be used to carry out behavioral simulation of circuits containing memristors.
- Published
- 2014
17. Photo Tours
- Author
-
Avanish Kushal, Steven M. Seitz, Carlos Hernández, David Gallup, Yasutaka Furukawa, Brian Curless, and Ben Self
- Subjects
business.industry ,Computer science ,Graph theory ,Travelling salesman problem ,Computer graphics ,Tree traversal ,Feature (computer vision) ,Computer graphics (images) ,Scalability ,The Internet ,Computer vision ,Artificial intelligence ,User interface ,business ,MathematicsofComputing_DISCRETEMATHEMATICS - Abstract
This paper describes an effort to automatically create ``tours'' of thousands of the world's landmarks from geo-tagged user-contributed photos on the Internet. These photo tours take you through each site's most popular viewpoints on a tour that maximizes visual quality and traversal efficiency. This planning problem is framed as a form of the Traveling Salesman Problem on a graph with photos as nodes and transition costs on edges and pairs of edges, permitting efficient solution even for large graphs containing thousands of photos. Our approach is highly scalable and is the basis for the Photo Tours feature in Google Maps, which can be viewed at http://maps.google.com/phototours.
- Published
- 2012
18. Live 3D shape reconstruction, recognition and registration
- Author
-
George Vogiatzis, Roberto Cipolla, Frank Perbet, Oliver Woodford, Carlos Hernández, Minh-Tri Pham, Atsuto Maki, and Bjorn Stenger
- Subjects
Computer science ,business.industry ,Feature extraction ,Graphics processing unit ,Point cloud ,Cognitive neuroscience of visual object recognition ,Image registration ,Inference ,Iterative reconstruction ,Object (computer science) ,Computer graphics (images) ,Computer vision ,Artificial intelligence ,business - Abstract
We present a video-based system which interactively captures the geometry of a 3D object in the form of a point cloud, then recognizes and registers known objects in this point cloud in a matter of seconds (fig. 1). In order to achieve interactive speed, we exploit both efficient inference algorithms and parallel computation, often on a GPU. The system can be broken down into two distinct phases: geometry capture, and object inference. We now discuss these in further detail.
- Published
- 2011
19. Automatic Object Segmentation from Calibrated Images
- Author
-
Roberto Cipolla, Carlos Hernández, Neill D. F. Campbell, and George Vogiatzis
- Subjects
Computer science ,Segmentation-based object categorization ,business.industry ,Epipolar geometry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Scale-space segmentation ,Pattern recognition ,Image segmentation ,Intrinsics ,Silhouette ,Visual hull ,Computer vision ,Segmentation ,Artificial intelligence ,business - Abstract
This paper addresses the problem of automatically obtaining the object/background segmentation of a rigid 3D object observed in a set of images that have been calibrated for camera pose and intrinsics. Such segmentations can be used to obtain a shape representation of a potentially texture-less object by computing a visual hull. We propose an automatic approach where the object to be segmented is identified by the pose of the cameras instead of user input such as 2D bounding rectangles or brush-strokes. The key behind our method is a pairwise MRF framework that combines (a) foreground/background appearance models, (b) epipolar constraints and (c) weak stereo correspondence into a single segmentation cost function that can be efficiently solved by Graph-cuts. The segmentation thus obtained is further improved using silhouette coherency and then used to update the foreground/background appearance models which are fed into the next Graph-cut computation. These two steps are iterated until segmentation convergences. Our method can automatically provide a 3D surface representation even in texture-less scenes where MVS methods might fail. Furthermore, it confers improved performance in images where the object is not readily separable from the background in colour space, an area that previous segmentation approaches have found challenging.
- Published
- 2011
20. Escaping Heuristic Hollows in Real-Time Search without Learning
- Author
-
Jorge A. Baier and Carlos Hernández
- Subjects
Mathematical optimization ,Computer science ,Search algorithm ,Heuristic ,Software agent ,Computation ,Path (graph theory) ,Benchmark (computing) ,Algorithm design ,Look-ahead ,Algorithm - Abstract
Real-time search is a standard approach to solving search problems in which agents have limited sensing capabilities and must act quickly. It is well known that real-time search algorithms like LRTA* and RTA* perform poorly in regions of the search space in which the heuristic function is very imprecise. Approaches that use look ahead or learning are used to overcome this drawback. They perform more computation in the planning phase compared to LRTA* andRTA* . In this paper we propose Path Real-Time A* (PRTA* ), an algorithm that, like LRTA*, performs little computation in the planning phase, but that, unlike LRTA*, terminates even if the problem does not have a solution. We show that our algorithm outperforms LRTA* and RTA* in standard real-time benchmark problems. Furthermore, we show that in some cases, PRTA* may also outperform lookahead-orlearning-enabled algorithms but carrying out significantly less computation.
- Published
- 2010
21. Ontology-Based Engineering of Autonomous Systems
- Author
-
Julita Bermejo-Alonso, Manuel Rodríguez, Ricardo Sanz, and Carlos Hernández
- Subjects
Computer science ,computer.internet_protocol ,Intelligent decision support system ,Autonomous system (Internet) ,Mobile robot ,Ontology (information science) ,Application software ,computer.software_genre ,Domain (software engineering) ,Systems analysis ,Unified Modeling Language ,Systems engineering ,computer ,computer.programming_language - Abstract
This paper describes a work in progress on an ontology-based approach for autonomous system engineering. This is part of the ASys research programme which focuses on the development of a technology for autonomous systems product-line engineering. Such technology will comprehend from platform technology to designs of intelligent autonomous systems and support methodologies. Within this programme, a domain-ontology for autonomous systems (OASys) has been developed to describe the autonomous system's domain. OASys will be used as core software asset for the analysis, design, implementation, and run-time operation of any autonomous system. Two testbeds are being developed to test OASys's applicability: a mobile robot-based application, and the control system of a chemical reactor.
- Published
- 2010
22. Researching on combining boosting ensembles
- Author
-
Carlos Hernández-Espinosa, Mercedes Fernández-Redondo, and Joaquín Torres-Sospedra
- Subjects
Boosting (machine learning) ,Artificial neural network ,Computer science ,business.industry ,Bayesian probability ,Pattern recognition ,Machine learning ,computer.software_genre ,BrownBoost ,ComputingMethodologies_PATTERNRECOGNITION ,Key factors ,Artificial intelligence ,Gradient boosting ,business ,computer - Abstract
As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance with respect to a single network. The two key factors to design an ensemble are how to train the individual networks and how to combine them to give a single output. Boosting is a well known methodology to build an ensemble. Some boosting methods use an specific combiner (Boosting Combiner) based on the accuracy of the network. Although the Boosting combiner provides good results on boosting ensembles, the simple combiner Output Average worked better in three new boosting methods we successfully proposed in previouses papers. In this paper, we study the performance of sixteen different combination methods for ensembles previously trained with Adaptive Boosting and Average Boosting in order to see which combiner fits better on these ensembles. Finally, the results show that the accuracy of the ensembles trained with these original boosting methods can be improved by using the appropriate alternative combiner. In fact, the Output average and the Weighted average on low/medium sized ensembles provide the best results in most of the cases.
- Published
- 2008
23. Designing a Multilayer Feedforward Ensemble with the Weighted Conservative Boosting Algorithm
- Author
-
Carlos Hernández-Espinosa, Joaquín Torres-Sospedra, and Mercedes Fernández-Redondo
- Subjects
ComputingMethodologies_PATTERNRECOGNITION ,Boosting (machine learning) ,Sampling distribution ,Computer science ,business.industry ,Feed forward ,Pattern recognition ,Artificial intelligence ,Gradient boosting ,business ,Backpropagation - Abstract
In previous researches we have analysed some methods to create committees of multilayer feedforward networks trained with the backpropagation algorithm. One of the most known methods that we have studied is Adaptive Boosting. In this paper we propose a variation of this method called weighted conservative boosting based on conservative boosting. In this case, a weight which depends on the database and on the ensemble is added to the equation used to update the sampling distribution. We have tested adaptive boosting, conservative boosting and weighted conservative boosting with seven databases from the UCI repository. We have used the mean Increase of Performance and the mean percentage of error reduction to compare both methods, the results show that weighted conservative boosting is the best performing method.
- Published
- 2007
24. Mixing Aveboost and Conserboost to Improve Boosting Methods
- Author
-
Mercedes Fernández-Redondo, Carlos Hernández-Espinosa, and Joaquín Torres-Sospedra
- Subjects
Boosting (machine learning) ,Artificial neural network ,business.industry ,Computer science ,Pattern recognition ,Machine learning ,computer.software_genre ,BrownBoost ,ComputingMethodologies_PATTERNRECOGNITION ,LPBoost ,Probability distribution ,Gradient boosting ,AdaBoost ,Artificial intelligence ,business ,computer - Abstract
Adaptive boosting (Adaboost) is one of the most known methods to build an ensemble of neural networks. Adaboost has been studied and successfully improved by some authors like Breiman, Kuncheva or Oza. In this paper we briefly analyze and mix two of the most important variants of Adaboost in order to build a robuster ensemble of neural networks. The boosting methods we have studied are averaged boosting (Aveboost) and conservative boosting (Conserboost). We proposed the mixed method we have called averaged onservative boosting (ACE). In this method we apply the conservative equation used in Conserboost along with the averaged procedure used in Aveboost in order to update the sampling distrubution of Adaboost. We have tested the methods with seven databases from the UCI repository. We have used the mean increase of performance and the mean percentage of error reduction to compare both methods, the results show that the new proposed method performs better.
- Published
- 2007
25. Probabilistic visibility for multi-view stereo
- Author
-
Roberto Cipolla, Carlos Hernández, and George Vogiatzis
- Subjects
Computer science ,business.industry ,Detector ,Visibility (geometry) ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Probabilistic logic ,Boundary (topology) ,Image segmentation ,Term (time) ,Computer Science::Computer Vision and Pattern Recognition ,Computer vision ,Artificial intelligence ,business ,Image resolution - Abstract
We present a new formulation to multi-view stereo that treats the problem as probabilistic 3D segmentation. Previous work has used the stereo photo-consistency criterion as a detector of the boundary between the 3D scene and the surrounding empty space. Here we show how the same criterion can also provide a foreground/background model that can predict if a 3D location is inside or outside the scene. This model replaces the commonly used naive foreground model based on ballooning which is known to perform poorly in concavities. We demonstrate how the probabilistic visibility is linked to previous work on depth-map fusion and we present a multi-resolution graph-cut implementation using the new ballooning term that is very efficient both in terms of computation time and memory requirements.
- Published
- 2007
26. Non-rigid Photometric Stereo with Colored Lights
- Author
-
George Vogiatzis, Gabriel J. Brostow, Bjorn Stenger, Carlos Hernández, and Roberto Cipolla
- Subjects
Surface (mathematics) ,Computer science ,business.industry ,Frame (networking) ,Optical flow ,Iterative reconstruction ,Photometric stereo ,Image texture ,Computer graphics (images) ,Computer vision ,Boundary value problem ,Artificial intelligence ,business ,Structured light - Abstract
We present an algorithm and the associated capture methodology to acquire and track the detailed 3D shape, bends, and wrinkles of deforming surfaces. Moving 3D data has been difficult to obtain by methods that rely on known surface features, structured light, or silhouettes. Multispec- tral photometric stereo is an attractive alternative because it can recover a dense normal field from an un-textured surface. We show how to capture such data and register it over time to generate a single deforming surface. Experiments were performed on video sequences of un- textured cloth, filmed under spatially separated red, green, and blue light sources. Our first finding is that using zero- depth-silhouettes as the initial boundary condition already produces rather smoothly varying per-frame reconstructions with high detail. Second, when these 3D reconstructions are augmented with 2D optical flow, one can register the first frame's reconstruction to every subsequent frame.
- Published
- 2007
27. Designing a New Multilayer Feedforward Modular Network for Classification Problems
- Author
-
Carlos Hernández-Espinosa, Mercedes Fernández-Redondo, and Joaquín Torres-Sospedra
- Subjects
Physical neural network ,Computer science ,Computer Science::Neural and Evolutionary Computation ,Activation function ,computer.software_genre ,Probabilistic neural network ,Cellular neural network ,Stochastic neural network ,Quantitative Biology::Neurons and Cognition ,Artificial neural network ,business.industry ,Time delay neural network ,Deep learning ,Feed forward ,Modular neural network ,Backpropagation ,ComputingMethodologies_PATTERNRECOGNITION ,Recurrent neural network ,Feedforward neural network ,Data mining ,Artificial intelligence ,Types of artificial neural networks ,Intelligent control ,business ,computer ,Nervous system network models - Abstract
There are two different ways to create a Multiple Classification System based on neural networks. The first one is the Ensemble approach; it consists on combining the outputs of different networks which solve the same problem in a suitable manner to give a single output. The second one is the Modular approach; it consists on decomposing the problem into subproblems, the final decision is taken with the information provided by the networks. One of the most known methods to build a Modular Neural Network is the Mixture of Neural Networks. In this paper we present a Mixture of Multilayer Feedforward Networks a modular method based on Multilayer Feedforward networks. Finally, we have included a comparison among Simple Ensemble, Mixture of Neural Networks and Mixture of Multilayer Feedforward Networks. We have tested the methods with eight databases from the UCI repository and the results show that Mixture of Multilayer Feedforward Networks is the best performing method.
- Published
- 2006
28. Reconstruction in the Round Using Photometric Normals and Silhouettes
- Author
-
Carlos Hernández, Roberto Cipolla, and George Vogiatzis
- Subjects
business.industry ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Iterative reconstruction ,Reflectivity ,Visual hull ,Photometry (optics) ,Photometric stereo ,Stereopsis ,Computer Science::Computer Vision and Pattern Recognition ,Computer vision ,Artificial intelligence ,business ,Surface reconstruction ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
This paper addresses the problem of obtaining complete, detailed reconstructions of shiny textureless objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under varying illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint and produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the objects visual hull. This is then used to recover the illumination and initialise a multi-view photometric stereo scheme to obtain a closed surface reconstruction. The contributions of the paper are twofold: Firstly we describe a robust technique to estimate light directions and intensities and secondly, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and hence allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with a complete reconstruction of a challenging real object.
- Published
- 2006
29. Propagating Updates in Real-Time Search: FALCONS(k)
- Author
-
Pedro Meseguer and Carlos Hernández
- Subjects
Incremental heuristic search ,Mathematical optimization ,Search algorithm ,Computer science ,Heuristic (computer science) ,Null-move heuristic ,Beam search ,Best-first search ,Min-conflicts algorithm ,Algorithm ,Consistent heuristic - Abstract
We enhance real-time search algorithms with bounded propagation of heuristic changes. When the heuristic of the current state is updated, this change is propagated consistently up to k states not necessarily distinct. Applying this idea to FALCONS, we have develop the new FALCONS(k), an algorithm that keeps the good theoretical properties of FALCONS and improves its performance. We provide experimental results on benchmarks for real-time search, showing the benefits of our approach.
- Published
- 2006
30. A comparison of combination methods for ensembles of RBF networks
- Author
-
Joaquín Torres-Sospedra, Carlos Hernández-Espinosa, and Mercedes Fernández-Redondo
- Subjects
Radial basis function network ,Artificial neural network ,Simple (abstract algebra) ,Computer science ,business.industry ,Activation function ,Feed forward ,Pattern recognition ,Radial basis function ,Artificial intelligence ,business - Abstract
Building an ensemble of classifiers is an useful way to improve the performance. In the case of neural networks the bibliography has centered on the use of multilayer feedforward (MF). However, there are other interesting networks like radial basis functions (RBF) that can be used as elements of the ensemble. In a previous paper we presented results of different methods to build the ensemble of RBF. The results showed that the best method is in general the simple ensemble. The combination methods used in that research was averaging. In this paper we present results of fourteen different combination methods for a simple ensemble of RBF. The best performing methods are Borda count, weighted average and majority voting.
- Published
- 2006
31. New experiments on ensembles of multilayer feedforward for classification problems
- Author
-
Carlos Hernández-Espinosa, Joaquín Torres-Sospedra, and Mercedes Fernández-Redondo
- Subjects
Boosting (machine learning) ,Computer science ,business.industry ,Feed forward ,Pattern recognition ,Artificial intelligence ,business ,Backpropagation - Abstract
As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance with respect to a single network. However there are several methods to construct the ensemble. In this paper we present some new results in a comparison of twenty different methods. We have trained ensembles of 3, 9, 20 and 40 networks to show results in a wide spectrum of values. The results show that the improvement in performance above 9 networks in the ensemble depends on the method but it is usually low. Also, the best method for an ensemble of 3 networks is called "decorrelated" and uses a penalty term in the usual backpropagation function to decorrelate the network outputs in the ensemble. For the case of 9 and 20 networks the best method is conservative boosting. And finally for 40 networks the best method is Cels.
- Published
- 2006
32. A research on combination methods for ensembles of multilayer feedforward
- Author
-
Joaquín Torres-Sospedra, Carlos Hernández-Espinosa, and Mercedes Fernández-Redondo
- Subjects
Range (mathematics) ,ComputingMethodologies_PATTERNRECOGNITION ,Computer science ,business.industry ,Feed forward ,Class (philosophy) ,Artificial intelligence ,Type (model theory) ,Focus (optics) ,business ,Ensemble learning ,Simple (philosophy) - Abstract
As shown in the bibliography, training an ensemble of networks is an interesting way to improve the performance with respect to a single network. The two key factors to design an ensemble are how to train the individual networks and how to combine the different outputs of the networks to give a single output class. In this paper, we focus on the combination methods. We study the performance of fourteen different combination methods for ensembles of the type "simple ensemble" and "decorrelated". In the case of the "simple ensemble" and low number of networks in the ensemble, the method Zimmermann gets the best performance. When the number of networks is in the range of 9 and 20 the weighted average is the best alternative. Finally, in the case of the ensemble "decorrelated" the best performing method is averaging over a wide spectrum of the number of networks in the ensemble.
- Published
- 2006
33. Designing a Multilayer Feedforward Ensembles with Cross Validated Boosting Algorithm
- Author
-
Mercedes Fernández-Redondo, Carlos Hernández-Espinosa, and Joaquín Torres-Sospedra
- Subjects
Boosting (machine learning) ,Training set ,Artificial neural network ,Sampling distribution ,Computer science ,Feed forward ,Algorithm design ,Data mining ,AdaBoost ,computer.software_genre ,computer - Abstract
In previous researches we have analysed some methods to create committees of multilayer feedforward networks trained with the Back Propagation algorithm. One of the most known methods that we have studied is Adaptive Boosting. In this paper we present a variation of this method called Crossboost. In this version of AdaBoost, we have used k-cross-fold validation over the whole learning set to generate an specific training set and validation set for each network of the committee. In the new method, the data set used to train the ith-network is selectively sampled from its specific training set, the sampling distribution is calculated over the whole learning set. The diversity of a committee generated with our method increases respect the original method because each network has its specific validation set. We have tested Adaboost and Crossboost with ten databases from the UCI repository. We have used the mean percentage of error reduction to compare both methods, the results show that Crossboost performs better.
- Published
- 2006
34. Hyperspectral image classification by ensembles of multilayer feedforward networks
- Author
-
Joaquín Torres-Sospedra, Carlos Hernández-Espinosa, and Mercedes Fernández-Redondo
- Subjects
Contextual image classification ,Pixel ,Artificial neural network ,Computer science ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Feed forward ,Hyperspectral imaging ,Pattern recognition ,Spectral bands ,Ensemble learning ,Support vector machine ,ComputingMethodologies_PATTERNRECOGNITION ,Computer Science::Computer Vision and Pattern Recognition ,Artificial intelligence ,business - Abstract
A hyperspectral image is used in remote sensing to identify different type of coverts on the Earth surface. It is composed of pixels and each pixel consists of spectral bands of the electromagnetic reflected spectrum. Neural networks and ensemble techniques have been applied to remote sensing images with a low number of spectral bands per pixel (less than 20). In this paper, we apply different ensemble methods of multilayer feedforward networks to images of 224 spectral bands per pixel, where the classification problem is clearly different. We conclude that in general, there is an improvement by the use of an ensemble. For databases with low number of classes and pixels, the improvement is lower and similar for all ensemble methods. However, for databases with a high number of classes and pixels, the improvement depends strongly on the ensemble method. We also present results of the classification of support vector machines (SVM) and see that a neural network is a useful alternative to SVM.
- Published
- 2005
35. A comparison of ensemble methods for multilayer feedforward networks
- Author
-
Mamen Ortiz-Gómez, Mercedes Fernández-Redondo, and Carlos Hernández-Espinosa
- Subjects
Artificial neural network ,business.industry ,Computer science ,Feed forward ,Pattern recognition ,Artificial intelligence ,Function (mathematics) ,business ,Decorrelation ,Ensemble learning ,Backpropagation ,Term (time) - Abstract
Training an ensemble of networks is an interesting way to improve the performance with respect to a single network. However there are several methods to construct the ensemble and there are no complete results showing which one could be the most appropriate. In this paper we present a comparison of eleven different methods. We have trained ensembles of a reduced number of networks (3 and 9) because in this case the computational cost is not high and the method is suitable for applications. The results show that the improvement in performance from three to nine networks is marginal. Also, the best method is called "Decorrelated" and uses a penalty term in the usual backpropagation function to decorrelate the network outputs in the ensemble.
- Published
- 2004
36. Silhouette and stereo fusion for 3D object modeling
- Author
-
Francis Schmitt and Carlos Hernández Esteban
- Subjects
Sequence ,Vector flow ,business.industry ,Computer science ,3D reconstruction ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Pattern recognition ,Iterative reconstruction ,Computational geometry ,Texture (geology) ,Visual hull ,Silhouette ,Image texture ,Computer Science::Computer Vision and Pattern Recognition ,Signal Processing ,Object model ,Computer vision ,Computer Vision and Pattern Recognition ,Artificial intelligence ,business ,Texture mapping ,Software ,Mathematics ,ComputingMethodologies_COMPUTERGRAPHICS - Abstract
In this paper, we present a new approach to high quality 3D object reconstruction. Starting from a calibrated sequence of color images, the algorithm is able to reconstruct both the 3D geometry and the texture. The core of the method is based on a deformable model, which defines the framework where texture and silhouette information can be fused. This is achieved by defining two external forces based on the images: a texture driven force and a silhouette driven force. The texture force is computed in two steps: a multi-stereo correlation voting approach and a gradient vector flow diffusion. Due to the high resolution of the voting approach, a multi-grid version of the gradient vector flow has been developed. Concerning the silhouette force, a new formulation of the silhouette constraint is derived. It provides a robust way to integrate the silhouettes in the evolution algorithm. As a consequence, we are able to recover the contour generators of the model at the end of the iteration process. Finally, a texture map is computed from the original images for the reconstructed 3D model.
- Published
- 2004
37. Interval arithmetic inversion: a new rule extraction algorithm
- Author
-
Mamen Ortiz-Gómez, Mercedes Fernández-Redondo, and Carlos Hernández-Espinosa
- Subjects
Artificial neural network ,business.industry ,Time delay neural network ,Computer science ,Deep learning ,Feed forward ,Pattern recognition ,Interval arithmetic ,Probabilistic neural network ,Recurrent neural network ,Generalized Hebbian Algorithm ,Delta rule ,Feedforward neural network ,Artificial intelligence ,business - Abstract
In this paper we propose a new algorithm for rule extraction from a trained Multilayer Feedforward network. The algorithm is based on an interval arithmetic network inversion for particular target outputs. The types of rules extracted are N-dimensional intervals in the input space. We have performed experiments with four databases and the results are very interesting. One rule extracted by the algorithm can cover 86% of the neural network output and in other cases sixty four rules cover 100% of the neural network output.
- Published
- 2004
38. On the design of constructive training algorithms for multilayer feedforward
- Author
-
Mercedes Fernández-Redondo and Carlos Hernández-Espinosa
- Subjects
Physical neural network ,Artificial neural network ,Time delay neural network ,Computer science ,business.industry ,Deep learning ,Computer Science::Neural and Evolutionary Computation ,Feed forward ,Machine learning ,computer.software_genre ,Constructive ,Rprop ,Backpropagation ,Probabilistic neural network ,Recurrent neural network ,Multilayer perceptron ,Feedforward neural network ,Artificial intelligence ,Types of artificial neural networks ,Stochastic neural network ,business ,computer - Abstract
The usual way to determine the number of hidden units in multilayer feedforward networks is by a trial and error procedure. An alternative is to use constructive algorithms which change the neural network structure during training. In this paper we propose a new constructive algorithm, explore several design alternatives and conclude that this new constructive algorithm is a better alternative than the procedure of trial and error for designing a neural network.
- Published
- 2003
39. Neural networks input selection by using the training set
- Author
-
Carlos Hernández Espinosa and Mercedes Fernández Redondo
- Subjects
Training set ,Artificial neural network ,Computational complexity theory ,Computer science ,business.industry ,Fuzzy set ,Feature selection ,Mutual information ,Information theory ,Machine learning ,computer.software_genre ,Pattern recognition (psychology) ,Feedforward neural network ,Artificial intelligence ,business ,computer - Abstract
We present a review of feature selection methods based on an analysis of the training set. The focus is on the methods which have been applied to neural networks. We also present a methodology that allows evaluation and comparison of feature selection methods. This methodology is applied to the 7 reviewed methods in a total of 15 different real world classification problems. The result is an ordering of methods according to performance. From this ordering it is clearly concluded which method is the best and should be used. The best methods are based on information theory concepts like gd-distance and mutual information. We also discuss the applicability and computational complexity of the methods.
- Published
- 2003
40. Generalization capability of one and two hidden layers
- Author
-
Mercedes Fernández Redondo and Carlos Hernández Espinosa
- Subjects
Artificial neural network ,Generalization ,business.industry ,Computer science ,Feedforward neural network ,Artificial intelligence ,business ,Algorithm ,Measure (mathematics) ,Transfer function - Abstract
We present an experimental comparison of the generalization capability of one and two hidden layers multilayer feedforward neural networks. We used sixteen different real world problems in order to measure the generalization of both architectures. For each problem and architecture we carefully selected, by a trial and error procedure, the minimal network which solves the problem. Several runs with different initial conditions were obtained in order to get an average performance with an error. According to our results, the generalization capability of a one hidden layer network is better than the one of two hidden layers network. Furthermore, two hidden layer networks are more prone to fall into bad local minimum.
- Published
- 2003
41. Input selection by multilayer feedforward trained networks
- Author
-
Carlos Hernández Espinosa and Mercedes Fernández Redondo
- Subjects
Neural gas ,Computer science ,Time delay neural network ,business.industry ,Deep learning ,Feature extraction ,Feed forward ,Feature selection ,Pattern recognition ,Machine learning ,computer.software_genre ,Probabilistic neural network ,Recurrent neural network ,Multilayer perceptron ,Feature (machine learning) ,Feedforward neural network ,Artificial intelligence ,business ,computer - Abstract
We review feature selection methods based on the analysis of a trained multilayer feedforward neural network. Furthermore, we present a methodology that allows experimentally evaluating and comparing feature selection methods. This methodology was applied to the 19 reviewed methods and we evaluated the usefulness of these methods for selecting the appropriate features in the case of using a multilayer feedforward as a pattern recognition method. We used a total number of 15 different real world classification problems in our experiments. From the result of the comparison, we conclude which methods perform better and should be used, and discuss their applicability.
- Published
- 2003
42. A comparison between two interval arithmetic learning algorithms
- Author
-
Mercedes Fernández Redondo and Carlos Hernández Espinosa
- Subjects
Theoretical computer science ,Training set ,Artificial neural network ,Computer science ,Generalization ,Feed forward ,Algorithm design ,Algorithm ,Backpropagation ,Interval arithmetic - Abstract
Two generalizations of multilayer feedforward and backpropagation to interval arithmetic were proposed several years ago. These generalizations have several applications like the codification of rules in the training set, "don't care attributes", missing inputs, etc. There are two generalizations what means that there are two different training algorithms and there is no way, at first, to consider one of them better than the other. We present an in depth comparison between the two training algorithms. We have used a total number of 75 different problems and five different performance definitions for the comparison. The results are that the performance of the algorithms depends on the performance definition, but we can consider one of them as the "usual" one and in this sense one algorithm outperforms the other.
- Published
- 2003
43. A comparison among feature selection methods based on trained networks
- Author
-
Mercedes Fernández Redondo and Carlos Hernández Espinosa
- Subjects
Computational complexity theory ,Artificial neural network ,Time delay neural network ,business.industry ,Computer science ,Deep learning ,Feed forward ,Feature selection ,Machine learning ,computer.software_genre ,Probabilistic neural network ,Feedforward neural network ,Artificial intelligence ,business ,computer - Abstract
We present a review of feature selection methods, based on the analysis of a trained multilayer feedforward network, which have been applied to neural networks. Furthermore, a methodology that allows evaluating and comparing feature selection methods is carefully described. This methodology is applied to the 19 reviewed methods in a total of 15 different real world classification problems. We present an ordination of methods according to their performance and it is clearly concluded which method performs better and should be used. We also discuss the applicability and computational complexity of the methods.
- Published
- 2003
44. Multilayer feedforward weight initialization
- Author
-
Mercedes Fernández-Redondo and Carlos Hernández-Espinosa
- Subjects
business.industry ,Computer science ,Generalization ,Hyperbolic function ,Feed forward ,Feedforward neural network ,Initialization ,Artificial intelligence ,business ,Transfer function ,Algorithm ,Backpropagation - Abstract
We present the results of an experimental comparison among seven different weight initialization methods in twelve different problems. The comparison is performed by measuring the speed of convergence, the generalization capability and the probability of successful convergence. It is not usual to find an evaluation of the three properties in the literature on weight initialization. The training algorithm was backpropagation with a hyperbolic tangent transfer function. We found that the performance can be improved with respect to the usual initialization scheme.
- Published
- 2002
45. A comparison among output codification schemes
- Author
-
Carlos Hernández-Espinosa and Mercedes Fernández-Redondo
- Subjects
Computer science ,Feed forward ,Data mining ,computer.software_genre ,computer - Abstract
We present an empirical comparison among four different schemes of coding the outputs of a multilayer feedforward networks. Results are obtained for eight different classification problems from the UCI repository machine learning databases. Our results show that the usual codification is superior to the rest in the case of using one output unit per class. However, if we use several output units per class we can obtain an improvement in the generalization performance depending on the problem and in this case the noisy codification seems to be more appropriate.
- Published
- 2002
46. Multipath Adaptive A*: Factors That Influence Performance in Goal-Directed Navigation in Unknown Terrain
- Author
-
Carlos Hernandez Ulloa, Jorge A. Baier, and Roberto Asin-Acha
- Subjects
MPAA* ,D* ,D*Lite ,D*ExtraLite ,incremental heuristic search ,goal-directed navigation ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Incremental heuristic search algorithms are a class of heuristic search algorithms applicable to the problem of goal-directed navigation. D* and D*Lite are among the most well-known algorithms for this problem. Recently, two new algorithms have been shown to outperform D*Lite in relevant benchmarks: Multi-Path Adaptive A* (MPAA*) and D*ExtraLite. Existing empirical evaluations, unfortunately, do not allow to obtain meaningful conclusions regarding the strengths and weaknesses of these algorithms. Indeed, in the paper introducing D*ExtraLite, it is shown that D*Lite outperforms MPAA* in benchmarks in which the authors of MPAA* claim superiority over D*Lite. The existence of published contradictory data unfortunately does not allow practitioners to make decisions over which algorithm to use given a specific application. In this paper, we analyze two factors that significantly influence the performance of MPAA*, explaining why it is possible to obtain very different results depending on such factors. We identify a configuration of MPAA* which, in the majority of the benchmark problems we use, exhibits superior performance when compared to both D*Lite and D*ExtraLite. We conclude that MPAA* should be the algorithm of choice in goal-directed navigation scenarios in which the heuristic is accurate, whereas D*ExtraLite should be preferred when the heuristic is inaccurate.
- Published
- 2020
- Full Text
- View/download PDF
47. On the combination of weight-decay and input selection methods
- Author
-
Mercedes Fernández-Redondo and Carlos Hernández-Espinosa
- Subjects
Probabilistic neural network ,business.industry ,Computer science ,Time delay neural network ,Weight decay ,Feed forward ,Pattern recognition ,Artificial intelligence ,Variation (game tree) ,Input selection ,business - Abstract
We present the results of a research on the combination of weight-decay and input selection methods based on the analysis of a trained multilayer feedforward network. This combination has been proposed and suggested by some other authors. The influence of weight-decay in seventeen different input selection methods is empirically analyzes with a total of eight classification problems. We show that the performance variation by introducing weight-decay strongly depends on the particular input selection method. The use of weight-decay can even deteriorate the efficiency of a method. Furthermore, it seems that weight-decay improves the performance of the worst input selection methods and deteriorate the performance of the best ones. In that sense, it diminishes the performance differences among different methods. We conclude that the combination of weight-decay and this type of input selection methods should be avoided.
- Published
- 2000
48. Diagnosis of vocal and voice disorders by the speech signal
- Author
-
Juan Ignacio Godino-Llorente, Pedro Gómez-Vilda, Carlos Hernández-Espinosa, and Santiago Aguilera-Navarro
- Subjects
Signal processing ,ComputingMethodologies_PATTERNRECOGNITION ,Rehabilitation ,Artificial neural network ,Computer science ,Speech recognition ,medicine.medical_treatment ,SIGNAL (programming language) ,medicine ,Speech processing - Abstract
We present a neural network application to the diagnosis of vocal and voice disorders, these disorders should be diagnosed in the early stage and normally cause changes in the voice signal. So we use acoustic parameters extracted from the voice as inputs for the neural network. In this paper, we focus our application on the distinction between pathologic and nonpathologic voices. The performance of the neural network is very good, 100% percent correct in the test. Furthermore, we have used neural network techniques to reduce the initial number of inputs (35), we conclude that only two acoustic parameters are needed for the classification between normal and pathological voices. The application can be a very useful diagnostic tool because it is noninvasive, makes possible to develop an automatic computer-based diagnosis system, is objective and can also be useful for evaluation of surgical, pharmacological and rehabilitation processes. Finally, we discuss the limitation of our work and possible future research.
- Published
- 2000
49. A comparison among weight initialization methods for multilayer feedforward networks
- Author
-
Carlos Hernández-Espinosa and Mercedes Fernández-Redondo
- Subjects
Mathematical optimization ,Computer science ,Generalization ,Conjugate gradient method ,Feed forward ,Initialization ,Algorithm ,Backpropagation - Abstract
In this paper we present the results of a comparison among six different weight initialization methods with two training algorithms and six databases. The comparison is performed by measuring the three following aspects: speed of convergence, generalization and probability of convergence. The two training algorithms are Backpropagation (BP) and another one that uses conjugate gradient and dynamical learning rate adaptation (NE). We found the best weight initialization scheme for the (BP) algorithm. The speed of convergence can be improved with respect to the usual initialization, but the two other aspects are similar. For the NE algorithm it is concluded that its performance depends on the initialization much more than BP. Its generalization and probability of convergence can be considered lower than BP and the different weight initialization schemes could not improve this drawback. On the other hand it is faster.
- Published
- 2000
Catalog
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.