Search

This contribution discusses the influence of different barrier update strategies on the performance and robustness of an interior point algorithm for single-crystal plasticity at small strains. To this end, single-crystal plasticity is first briefly presented in the framework of a primal-dual interior point algorithm to outline the general algorithmic structure. The manner in which the barrier parameter is modified within the interior point method, steering the penalization of constraints, plays a crucial role for the robustness and efficiency of the overall algorithm. In this paper, we compare and analyze different strategies in the framework of crystal plasticity. In a thorough analysis of a numerical example covering a broad range of settings in monocrystals, we investigate robust hyperparameter ranges and identify the most efficient and robust barrier parameter update strategies. [ABSTRACT FROM AUTHOR]

In this work, we address a novel and practical problem of automatically generating a room design from given room function and basic geometry, which can be described as picking appropriate objects from a given database, and placing the objects with a group of pre-defined criteria. We formulate both object selection and placement problems as probabilistic models. The object selection is first formulated as a supervised generative model, to take room function into consideration. Object placement problem is then formulated as a Bayesian model, where parameters are inferred with Maximizing a Posteriori (MAP) objective. We solve the placement problem efficiently by introducing a solver based on Markov Chain Monte Carlo with a specific proposal function designed for the problem. [ABSTRACT FROM AUTHOR]

In this paper, an efficient hybrid method for solving constrained numerical and engineering optimization problems is presented. The proposed hybrid method uses a combination of three methods a genetic algorithm (GA), particle swarm optimization (PSO), and symbiotic organisms search (SOS) to find desired solution of problems in a complex design space and to control the feasibility of finding solutions using the penalty function method. There are three alternative phases in the proposed algorithm: GA, which develops and selects the best population for the next phases, PSO, which obtains the experiences for each appropriate solution and updates them, the SOS, which performs symbiotic interaction updates in real-world populations. For constraint handling, the penalty function method was used with same values to control the parameters based on the problem. The proposed algorithm was tested on a set of constrained problems from previous studies. Normality and non-parametric tests were performed on the proposed method. the obtained results have showed that the proposed method is able to score the best rank among the CEC 2010 competition algorithms. It is able to solve most of these numerical and engineering design problems up to the best desired solutions and reach the minimum number of function evaluations. The proposed method had a showed better performance than the 𝜀 DEag, which was the winner of the CEC 2010 competition. [ABSTRACT FROM AUTHOR]

In this paper, based on a new smoothing function, the general box constrained variational inequalities are solved by a smoothing Newton algorithm with a nonmonotone line search. The proposed algorithm is proved to be globally and locally superlinearly convergent under suitable assumptions. The preliminary numerical results are reported. [ABSTRACT FROM AUTHOR]

Numerical methods for computing plausibility and belief distributions of consequences of a subjective model are considered. More precisely, related constrained optimization problems are studied. Error estimates of the proposed algorithms are obtained. Techniques for taking into account the information about the consequence available to the researcher for improving the accuracy of computations are discussed. [ABSTRACT FROM AUTHOR]

In the context of change-point detection, addressed by Total Variation minimization strategies, an efficient on-the-fly algorithm has been designed leading to exact solutions for univariate data. In this contribution, an extension of such an on-the-fly strategy to multivariate data is investigated. The proposed algorithm relies on the local validation of the Karush-Kuhn-Tucker conditions on the dual problem. Showing that the non-local nature of the multivariate setting precludes to obtain an exact on-the-fly solution, we devise an on-the-fly algorithm delivering an approximate solution, whose quality is controlled by a practitioner-tunable parameter, acting as a trade-off between quality and computational cost. Performance assessment shows that high quality solutions are obtained on-the-fly while benefiting of computational costs several orders of magnitude lower than standard iterative procedures. The proposed algorithm thus provides practitioners with an efficient multivariate change-point detection on-the-fly procedure. [ABSTRACT FROM PUBLISHER]

A trust-region algorithm in association with line search filter technique for solving nonlinear equality constrained programming is proposed in this paper. In the current iteration, the trial step providing sufficient descent is generated by solving a corresponding trust-region subproblem. Then, the step size is decided by backtracking line search together with filter technique to obtain the next iteration point. The advantage of this method is that resolving trust-region subproblem many times to determine a new iteration point in traditional trust-region method can be avoided and hence the expensive computation can be lessened. And the difficult decisions in regard to the choice of penalty parameters in the merit functions can be avoided by using filter technique. Second order correction steps are introduced in the proposed algorithm to overcome Maratos effect. Convergence analysis shows that fast local convergence can be achieved under some mild assumptions. The preliminary numerical results are reported. [ABSTRACT FROM AUTHOR]

In this article, we consider the problem of finding a solution of a nonsmooth constrained (and not necessarily square) system of equations. We first reformulate the original problem as an equivalent system of equations with nonnegative constraints, and then present a smoothing projected Levenberg-Marquardt type algorithm to solve the reformulated system, which solves a strictly convex quadratic program at each iteration. We show that this algorithm not only converges globally, but also converges locally superlinearly under an error bound assumption that is much weaker than the standard nonsingularity condition. Some numerical results for the presented algorithm indicate that the algorithm works quite well in practice. [ABSTRACT FROM PUBLISHER]

The article considers optimization of mixed constraints for a controlled system that describes countrylevel economic growth driven by technological progress. An algorithm is proposed, reducing this problem to an equivalent general optimization problem in a normed space, which in turn is solved by an iterative method based on N. N. Krasovskii's extremal shift method. Calculation results are reported for the economy of Japan in the second half of the twentieth century. [ABSTRACT FROM AUTHOR]

The authors propose a dwindling filter algorithm with Zhou's modified subproblem for nonlinear inequality constrained optimization. The feasibility restoration phase, which is always used in the traditional filter method, is not needed. Under mild conditions, global convergence and local superlinear convergence rates are obtained. Numerical results demonstrate that the new algorithm is effective. [ABSTRACT FROM AUTHOR]

Abstract: The linear least squares (LLS) technique is widely used in time-difference-of-arrival based positioning because of its computational efficiency. Two-step weighted least squares (2WLS) and constrained weighted least squares (CWLS) algorithms are two common LLS schemes where an additional variable is introduced to obtain linear equations. However, they both have the same measurement matrix that becomes ill-conditioned when the sensor geometry is a uniform circular array and the source is close to the array center. In this paper, a new CWLS estimator is proposed to circumvent this problem. The main strategy is to separate the source coordinates and the additional variable to different sides of the linear equations where the latter is first solved via a quadratic equation. In doing so, the matrix to be inverted has a smaller condition number than that of the conventional LLS approach. The performance of the proposed method is analyzed in the presence of zero-mean white Gaussian disturbances. Numerical examples are also included to evaluate its localization accuracy by comparing with the existing 2WLS and CWLS algorithms as well as the Cramér–Rao lower bound. [Copyright &y& Elsevier]

Abstract: A simple three-term conjugate gradient algorithm which satisfies both the descent condition and the conjugacy condition is presented. This algorithm is a modification of the Hestenes and Stiefel algorithm (Hestenes and Stiefel, 1952) [10], or that of Hager and Zhang (Hager and Zhang, 2005) [23] in such a way that the search direction is descent and it satisfies the conjugacy condition. These properties are independent of the line search. Also, the algorithm could be considered as a modification of the memoryless BFGS quasi-Newton method. The new approximation of the minimum is obtained by the general Wolfe line search, now using a standard acceleration technique developed by Andrei (2009) [27]. For uniformly convex functions, under standard assumptions, the global convergence of the algorithm is proved. Numerical comparisons of the suggested three-term conjugate gradient algorithm versus six other three-term conjugate gradient algorithms, using a set of 750 unconstrained optimization problems, show that all these computational schemes have similar performances, the suggested one being slightly faster and more robust. The proposed three-term conjugate gradient algorithm substantially outperforms the well-known Hestenes and Stiefel conjugate gradient algorithm, as well as the more elaborate CG_DESCENT algorithm. Using five applications from the MINPACK-2 test problem collection (Averick et al., 1992) [25], with variables, we show that the suggested three-term conjugate gradient algorithm is the top performer versus CG_DESCENT. [Copyright &y& Elsevier]

In recent years, convex optimization methods were successfully applied for various image processing tasks and a large number of first-order methods were designed to minimize the corresponding functionals. Interestingly, it was shown recently in Grewenig et al. () that the simple idea of so-called 'superstep cycles' leads to very efficient schemes for time-dependent (parabolic) image enhancement problems as well as for steady state (elliptic) image compression tasks. The 'superstep cycles' approach is similar to the nonstationary (cyclic) Richardson method which has been around for over sixty years. In this paper, we investigate the incorporation of superstep cycles into the projected gradient method. We show for two problems in compressive sensing and image processing, namely the LASSO approach and the Rudin-Osher-Fatemi model that the resulting simple cyclic projected gradient algorithm can numerically compare with various state-of-the-art first-order algorithms. However, due to the nonlinear projection within the algorithm convergence proofs even under restrictive assumptions on the linear operators appear to be hard. We demonstrate the difficulties by studying the simplest case of a two-cycle algorithm in ℝ with projections onto the Euclidean ball. [ABSTRACT FROM AUTHOR]

Abstract: We present a class of trust region algorithms that do not use any penalty function or a filter for nonlinear equality constrained optimization. In each iteration, the infeasibility is controlled by a progressively decreasing upper limit and trial steps are computed by a Byrd–Omojokun-type trust region strategy. Measures of optimality and infeasibility are computed, whose relationship serves as a criterion on which the algorithm decides which one to focus on improving. As a result, the algorithm keeps a balance between the improvements on optimality and feasibility even if no restoration phase which is required by filter methods is used. The framework of the algorithm ensures the global convergence without assuming regularity or boundedness on the iterative sequence. By using a second order correction strategy, Marato’s effect is avoided and fast local convergence is shown. The preliminary numerical results are reported. [Copyright &y& Elsevier]

Abstract: In this paper, a trust-region sequential quadratic programming algorithm with a modified filter acceptance mechanism is proposed for nonlinear equality constrained optimization. The most important advantage of the proposed algorithm is its avoidance of any feasibility restoration phase, a necessity in traditional filter methods. We solve quadratic programming subproblems based on the well-known Byrd–Omojokun trust-region method. Inexact solutions to these subproblems are allowed. Under some standard assumptions, global convergence of the proposed algorithm is established. Numerical results show our approach is potentially useful. [Copyright &y& Elsevier]

A modified parallel variable distribution (PVD) algorithm for solving large-scale constrained optimization problems is developed, which modifies quadratic subproblem QP1 at each iteration instead of the QP01 of the SQP-type PVD algorithm proposed by C. A. Sagastiz'abal and M. V. Solodov in 2002.The algorithm can circumvent the difficulties associated with the possible inconsistency of QP01 subproblem of the original SQP method. Moreover, we introduce a nonmonotone technique instead of the penalty function to carry out the line search procedure with more flexibly. Under appropriate conditions, the global convergence of the method is established. In the final part, parallel numerical experiments are implemented on CUDA based on GPU (Graphics Processing unit). [ABSTRACT FROM AUTHOR]

Motivated by the method of Su and Pu (2009), we present an improved nonmonotone filter trust region algorithm for solving nonlinear equality constrained optimization. In our algorithmamodified nonmonotone filter technique is proposed and the restoration phase is not needed. At every iteration, in common with the composite-step SQP methods, the step is viewed as the sum of two distinct components, a quasinormal step and a tangential step. Amore relaxed accepted condition for trial step is given and a crucial criterion is weakened. Under some suitable conditions, the global convergence is established. In the end, numerical results show our method is effective. [ABSTRACT FROM AUTHOR]

Abstract: In this paper, we consider numerical simulation to a class of constrained dynamic problems where the overall dynamics are determined by the interactions between two sub-systems. We present an iterative algorithm that naturally decouples the computation of the two sub-systems and that ensures an accurate and efficient solution procedure. We conduct rigorous error analysis for the convergence of the iterative algorithm, and verify the analytical results through careful numerical tests. [Copyright &y& Elsevier]

Abstract: A new trust-region algorithm for solving a constrained optimization problem is introduced. In this algorithm, an active set strategy is used together with multiplier method to convert the computation of the trial step to easy trust-region subproblem similar to this for the unconstrained case. A convergence theory for this algorithm is presented. Under reasonable assumptions, it is shown that the algorithm is globally convergent. In particular, it is shown that, in the limit, a subsequence of the iteration sequence satisfies one of four types of stationary conditions. Namely, the infeasible Mayer–Bliss conditions, Fritz John’s conditions, the infeasible Fritz John’s conditions or KKT conditions. Preliminary numerical experiment on the algorithm is presented. The performance of the algorithm is reported. The numerical results show that our approach is of value and merit further investigation. [Copyright &y& Elsevier]

Abstract: Simple modifications of the limited-memory BFGS method (L-BFGS) for large scale unconstrained optimization are considered, which consist in corrections (derived from the idea of conjugate directions) of the used difference vectors, utilizing information from the preceding iteration. For quadratic objective functions, the improvement of convergence is the best one in some sense and all stored difference vectors are conjugate for unit stepsizes. Global convergence of the algorithm is established for convex sufficiently smooth functions. Numerical experiments indicate that the new method often improves the L-BFGS method significantly. [Copyright &y& Elsevier]

Abstract: This paper introduces the concept and characterization of Disturbance-Dwell-Time invariance (DDT-invariance) and Constraint Admissible DDT-invariance (CADDT-invariance) for constrained systems with additive disturbance under dwell-time switching. Using the characterization, necessary and sufficient conditions for DDT-invariance and algorithms for the computation of the minimal and maximal constraint admissible convex DDT-invariant sets are provided. Numerical examples of such sets for several systems are also provided. [Copyright &y& Elsevier]

Abstract: In this paper, we propose a new penalty-free-type method for nonlinear equality constrained problems. The new algorithm uses trust region framework and feasibility safeguarding technique. Moreover, it has no choice of penalty parameter and penalty function as a merit function, and it does not use the filter technique to avoid the penalty function either. We analyze the global convergence of the main algorithm under the standard assumptions. The preliminary numerical tests are reported. [Copyright &y& Elsevier]

Abstract: A modified Artificial Bee Colony algorithm to solve constrained numerical optimization problems is presented in this paper. Four modifications related with the selection mechanism, the scout bee operator, and the equality and boundary constraints are made to the algorithm with the aim to modify its behavior in a constrained search space. Six performance measures found in the specialized literature are employed to analyze different capabilities in the proposed algorithm such as the ability and cost to generate feasible solutions, the capacity and cost to locate the feasible global optimum solution and the competency to improve feasible solutions. Three experiments, including a comparison with state-of-the-art algorithms, are considered in the test design where twenty four well-known benchmark problems with different features are utilized. The overall results show that the proposed algorithm differs in its behavior with respect to the original Artificial Bee Colony algorithm but its performance is improved, mostly in problems with small feasible regions due to the presence of equality constraints. [Copyright &y& Elsevier]

Abstract: The solution of the augmented Lagrangian related system is a key ingredient of many iterative algorithms for the solution of saddle-point problems in constrained optimization with quasi-Newton methods. However, such problems are ill-conditioned when the penalty parameter tends to zero, whereas the error vanishes as . We present a new fast method based on a splitting penalty scheme to solve such problems with a judicious prediction–correction method. We prove that, due to the adapted right-hand side, the solution of the correction step only requires the approximation of operators independent of , when is taken sufficiently small. Hence, the proposed method is as cheaper as tends to zero. We apply the two-step scheme to efficiently solve the saddle-point problem with a penalty method. Indeed, that fully justifies the interest of the vector penalty-projection methods recently proposed by Angot et al. (2008) to solve the unsteady incompressible Navier–Stokes equations, for which we give the stability result and some quasi-optimal error estimates. Moreover, the numerical experiments confirm both the theoretical analysis and the efficiency of the proposed method which produces a fast splitting solution to augmented Lagrangian or penalty problems, possibly used as a suitable preconditioner to the fully coupled system. [Copyright &y& Elsevier]

Abstract: In this paper, a new line search filter algorithm for equality constrained optimization is presented. The approach belongs to the class of inexact Newton-like methods. It can also be regarded as an inexact version of generic sequential quadratic programming (SQP) methods. The trial step is obtained by truncatedly solving the primal–dual system based on any robust and efficient linear system solver. Practical termination tests for the linear system solver are established to ensure global convergence. Preliminary numerical results demonstrate the approach is potentially useful. [Copyright &y& Elsevier]

Abstract: We consider an efficient trust-region framework which employs a new nonmonotone line search technique for unconstrained optimization problems. Unlike the traditional nonmonotone trust-region method, our proposed algorithm avoids resolving the subproblem whenever a trial step is rejected. Instead, it performs a nonmonotone Armijo-type line search in direction of the rejected trial step to construct a new point. Theoretical analysis indicates that the new approach preserves the global convergence to the first-order critical points under classical assumptions. Moreover, superlinear and quadratic convergence are established under suitable conditions. Numerical experiments show the efficiency and effectiveness of the proposed approach for solving unconstrained optimization problems. [Copyright &y& Elsevier]

Considering that the global optimal solutions often locate on or near the boundary of the feasible region for many constrained optimization problems, a novel genetic algorithm was proposed in this paper. The basic idea of the proposed algorithm was to put feasible solutions and infeasible solutions into two different containers respectively. Subsequently, a new designed crossover operator (named inward-outward crossover operator) was used to a feasible solution and a infeasible solution, then a line search along a potential decent direction was used to improve the offspring so as to find a good solution on or near to the boundary of feasible region. By this search procedure, the possibility for obtaining the globally optimal solution is obviously enhanced, and similarly, the convergent speed is also strengthened. The "particle swarm mutation" inherited the advantages of Particle Swarm Optimization (PSO) algorithm and searched for the potential solution along the direction of the best current particle and the direction of the best individual of the whole swarm in the past. Selection operator retained a constant rate of infeasible solutions. Numerical results indicate that the proposed algorithm can be efficient to get global optimal solutions or near to them in smaller population and less iteration times. [ABSTRACT FROM AUTHOR]

Abstract: The league championship algorithm (LCA) is a new algorithm originally proposed for unconstrained optimization which tries to metaphorically model a League championship environment wherein artificial teams play in an artificial league for several weeks (iterations). Given the league schedule, a number of individuals, as sport teams, play in pairs and their game outcome is determined given known the playing strength (fitness value) along with the team formation (solution). Modelling an artificial match analysis, each team devises the required changes in its formation (a new solution) for the next week contest and the championship goes for a number of seasons. In this paper, we adapt LCA for constrained optimization. In particular: (1) a feasibility criterion to bias the search toward feasible regions is included besides the objective value criterion; (2) generation of multiple offspring is allowed to increase the probability of an individual to generate a better solution; (3) a diversity mechanism is adopted, which allows infeasible solutions with a promising objective value precede the feasible solutions. Performance of LCA is compared with comparator algorithms on benchmark problems where the experimental results indicate that LCA is a very competitive algorithm. Performance of LCA is also evaluated on well-studied mechanical design problems and results are compared with the results of 21 constrained optimization algorithms. Computational results signify that with a smaller number of evaluations, LCA ensures finding the true optimum of these problems. These results encourage that further developments and applications of LCA would be worth investigating in the future studies. [Copyright &y& Elsevier]

Abstract: In this paper we propose an iterative algorithm to solve large size linear inverse ill posed problems. The regularization problem is formulated as a constrained optimization problem. The dual Lagrangian problem is iteratively solved to compute an approximate solution. Before starting the iterations, the algorithm computes the necessary smoothing parameters and the error tolerances from the data. The numerical experiments performed on test problems show that the algorithm gives good results both in terms of precision and computational efficiency. [Copyright &y& Elsevier]

We consider an implementation of a recursive model-based active-set trust-region method for solving bound-constrained nonlinear non-convex optimization problems without derivatives using the technique of self-correcting geometry proposed in K. Scheinberg and Ph.L. Toint [Self-correcting geometry in model-based algorithms for derivative-free unconstrained optimization. SIAM Journal on Optimization, (to appear), 2010]. Considering an active-set method in bound-constrained model-based optimization creates the opportunity of saving a substantial amount of function evaluations. It allows US to maintain much smaller interpolation sets while proceeding optimization in lower-dimensional subspaces. The resulting algorithm is shown to be numerically competitive. [ABSTRACT FROM AUTHOR]

Abstract: We present an algorithm which robustly computes the intersection curve(s) of an underconstrained piecewise polynomial system consisting of equations with unknowns. The solution of such a system is typically a curve in . This work extends the single solution test of Hanniel and Elber (2007) for a set of algebraic constraints from zero-dimensional solutions to univariate solutions, in . Our method exploits two tests: a no-loop test (NLT) and a single-component test (SCT) that together isolate and separate domains where the solution curve consists of just one single component. For such domains, a numerical curve tracing is applied. If one of those tests fails, is subdivided. Finally, the single components are merged together and, consequently, the topological configuration of the resulting curve is guaranteed. Several possible applications of the solver, namely solving the surface–surface intersection problem, computing 3D trisector curves, flecnodal curves or kinematic simulations in 3D are also discussed. [Copyright &y& Elsevier]

Abstract: In this paper, an active set limited BFGS algorithm is proposed for bound constrained optimization. The global convergence will be established under some suitable conditions. Numerical results show that the given method is effective. [Copyright &y& Elsevier]

Abstract: In this paper, we use a projected gradient algorithm to solve a nonlinear operator equation with -norm constraint. Gradient iterations with -norm constraints have been studied recently both in the context of inverse problem and of compressed sensing. In this paper, the constrained gradient iteration is implemented via a projected operator. We establish the -norm convergence of sequence constructed by the constrained gradient iteration when . The performance of the method is testified by a numerical example. [Copyright &y& Elsevier]

Abstract: A domain decomposition method (DDM) is presented to solve the distributed optimal control problem. The optimal control problem essentially couples an elliptic partial differential equation with respect to the state variable and a variational inequality with respect to the constrained control variable. The proposed algorithm, called SA–GP algorithm, consists of two iterative stages. In the inner loops, the Schwarz alternating method (SA) is applied to solve the state and co-state variables, and in the outer loops the gradient projection algorithm (GP) is adopted to obtain the control variable. Convergence of iterations depends on both the outer and the inner loops, which are coupled and affected by each other. In the classical iteration algorithms, a given tolerance would be reached after sufficiently many iteration steps, but more iterations lead to huge computational cost. For solving constrained optimal control problems, most of the computational cost is used to solve PDEs. In this paper, a proposed iterative number independent of the tolerance is used in the inner loops so as to save a lot of computational cost. The convergence rate of -error of control variable is derived. Also the analysis on how to choose the proposed iteration number in the inner loops is given. Some numerical experiments are performed to verify the theoretical results. [Copyright &y& Elsevier]

Abstract: We develop and study the high-order conservative and monotone optimization-based remap (OBR) of a scalar conserved quantity (mass) between two close meshes with the same connectivity. The key idea is to phrase remap as a global inequality-constrained optimization problem for mass fluxes between neighboring cells. The objective is to minimize the discrepancy between these fluxes and the given high-order target mass fluxes, subject to constraints that enforce physically motivated bounds on the associated primitive variable (density). In so doing, we separate accuracy considerations, handled by the objective functional, from the enforcement of physical bounds, handled by the constraints. The resulting OBR formulation is applicable to general, unstructured, heterogeneous grids. Under some weak requirements on grid proximity, but not on the cell types, we prove that the OBR algorithm is linearity preserving in one, two and three dimensions. The paper also examines connections between the OBR and the recently proposed flux-corrected remap (FCR), Liska et al. . We show that the FCR solution coincides with the solution of a modified version of OBR (M-OBR), which has the same objective but a simpler set of box constraints derived by using a “worst-case” scenario. Because M-OBR (FCR) has a smaller feasible set, preservation of linearity may be lost and accuracy may suffer for some grid configurations. Our numerical studies confirm this, and show that OBR delivers significant increases in robustness and accuracy. Preliminary efficiency studies of OBR reveal that it is only a factor of 2.1 slower than FCR, but admits 1.5 times larger time steps. [Copyright &y& Elsevier]

Abstract: This paper proposes a line search filter reduced Hessian method for nonlinear equality constrained optimization. The feature of the presented algorithm is that the reduced Hessian method is used to produce a search direction, a backtracking line search procedure to generate step size, some filtered rules to determine step acceptance, second order correction technique to reduce infeasibility and overcome the Maratos effects. It is shown that this algorithm does not suffer from the Maratos effects by using second order correction step, and under mild assumptions fast convergence to second order sufficient local solutions is achieved. The numerical experiment is reported to show the effectiveness of the proposed algorithm. [Copyright &y& Elsevier]

Abstract: The paper introduces a smoothing technique for a lower order penalty function for constrained optimization problems (COP). It is proved that the optimal solution to the smoothed penalty optimization problem is a -approximate optimal solution to the original optimization problem under some mild assumptions. Based on the smoothed penalty function, an algorithm for solving COP is proposed and some numerical examples are given. [Copyright &y& Elsevier]

Abstract: A novel modified differential evolution algorithm (NMDE) is proposed to solve constrained optimization problems in this paper. The NMDE algorithm modifies scale factor and crossover rate using an adaptive strategy. For any solution, if it is at a standstill, its own scale factor and crossover rate will be adjusted in terms of the information of all successful solutions. We can obtain satisfactory feasible solutions for constrained optimization problems by combining the NMDE algorithm and a common penalty function method. Experimental results show that the proposed algorithm can yield better solutions than those reported in the literature for most problems, and it can be an efficient alternative to solving constrained optimization problems. [Copyright &y& Elsevier]

We propose a new fast algorithm for solving one of the standard approaches to ill-posed linear inverse problems (IPLIP), where a (possibly nonsmooth) regularizer is minimized under the constraint that the solution explains the observations sufficiently well. Although the regularizer and constraint are usually convex, several particular features of these problems (huge dimensionality, nonsmoothness) preclude the use of off-the-shelf optimization tools and have stimulated a considerable amount of research. In this paper, we propose a new efficient algorithm to handle one class of constrained problems (often known as basis pursuit denoising) tailored to image recovery applications. The proposed algorithm, which belongs to the family of augmented Lagrangian methods, can be used to deal with a variety of imaging IPLIP, including deconvolution and reconstruction from compressive observations (such as MRI), using either total-variation or wavelet-based (or, more generally, frame-based) regularization. The proposed algorithm is an instance of the so-called alternating direction method of multipliers, for which convergence sufficient conditions are known; we show that these conditions are satisfied by the proposed algorithm. Experiments on a set of image restoration and reconstruction benchmark problems show that the proposed algorithm is a strong contender for the state-of-the-art. [ABSTRACT FROM AUTHOR]

Abstract: In this paper, we propose a trust region method for unconstrained optimization that can be regarded as a combination of conic model, nonmonotone and line search techniques. Unlike in traditional trust region methods, the subproblem of our algorithm is the conic minimization subproblem; moreover, our algorithm performs a nonmonotone line search to find the next iteration point when a trial step is not accepted, instead of resolving the subproblem. The global and superlinear convergence results for the algorithm are established under reasonable assumptions. Numerical results show that the new method is efficient for unconstrained optimization problems. [ABSTRACT FROM AUTHOR]

This paper describes a new direct search method for solving non-standard constrained optimization problems for which standard methodologies do not work properly. Our method (the Rational Iterative Multisection-RIM-algorithm) consists of different stages that can be interpreted as solutions according to different precision requirements. We have performed an application of RIM method to the case of public inputs provision. We prove that the RIM approach and standard methodologies achieve the same results with regular optimization problems while the RIM algorithm takes advantage over others comparable direct-search methods when facing non-standard optimization problems. [ABSTRACT FROM AUTHOR]

Abstract: The aim of this paper is to incorporate the preconditioned gradient path in a nonmonotone stabilization algorithm for unconstrained optimization. The global convergence and locally superlinear convergence are established for this class of algorithms. Finally, we report in details the numerical results which show the effectiveness of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Abstract: A numerical algorithm is presented to solve the constrained weighted energy problem from potential theory. As one of the possible applications of this algorithm, we study the convergence properties of the rational Lanczos iteration method for the symmetric eigenvalue problem. The constrained weighted energy problem characterizes the region containing those eigenvalues that are well approximated by the Ritz values. The region depends on the distribution of the eigenvalues, on the distribution of the poles, and on the ratio between the size of the matrix and the number of iterations. Our algorithm gives the possibility of finding the boundary of this region in an effective way. We give numerical examples for different distributions of poles and eigenvalues and compare the results of our algorithm with the convergence behavior of the explicitly performed rational Lanczos algorithm. [ABSTRACT FROM AUTHOR]

A modified version of the method of moving asymptotes is proposed based on the spectral parameter used in the updating of a key parameter of the model. The second-order information present in the spectral parameter is thus included in the model functions that define the rational approximations. Numerical experiments indicate that the idea is promising in the sense that the cost-benefit of computing the spectral parameter is worth it for reducing the total effort of the algorithm when compared with the original version. [ABSTRACT FROM AUTHOR]

Abstract: New accelerated nonlinear conjugate gradient algorithms which are mainly modifications of Dai and Yuan’s for unconstrained optimization are proposed. Using the exact line search, the algorithm reduces to the Dai and Yuan conjugate gradient computational scheme. For inexact line search the algorithm satisfies the sufficient descent condition. Since the step lengths in conjugate gradient algorithms may differ from 1 by two orders of magnitude and tend to vary in a very unpredictable manner, the algorithms are equipped with an acceleration scheme able to improve the efficiency of the algorithms. Computational results for a set consisting of 750 unconstrained optimization test problems show that these new conjugate gradient algorithms substantially outperform the Dai–Yuan conjugate gradient algorithm and its hybrid variants, Hestenes–Stiefel, Polak–Ribière–Polyak, CONMIN conjugate gradient algorithms, limited quasi-Newton algorithm LBFGS and compare favorably with CG_DESCENT. In the frame of this numerical study the accelerated scaled memoryless BFGS preconditioned conjugate gradient ASCALCG algorithm proved to be more robust. [Copyright &y& Elsevier]

We say that $X=[x_{ij}]_{i,j=1}^n$ is symmetric centrosymmetric if x ij = x ji and x n − j + 1, n − i + 1, 1 ≤ i, j ≤ n. In this paper we present an efficient algorithm for minimizing || AXA T − B|| where ||·|| is the Frobenius norm, A ∈ ℝ m× n, B ∈ ℝ m× m and X ∈ ℝ n× n is symmetric centrosymmetric with a specified central submatrix [ x ij] p ≤ i, j ≤ n − p. Our algorithm produces a suitable X such that AXA T = B in finitely many steps, if such an X exists. We show that the algorithm is stable any case, and we give results of numerical experiments that support this claim. [ABSTRACT FROM AUTHOR]

Abstract: Optimization of directional over-current relay (DOCR) settings is an important problem in electrical engineering. The optimization model of the problem turns out to be non-linear and highly constrained in which two settings namely time dial setting (TDS) and plug setting (PS) of each relay are considered as decision variables; the sum of the operating times of all the primary relays, which are expected to operate in order to clear the faults of their corresponding zones, is considered as an objective function. In the present study, three models are considered namely IEEE 3-bus model, IEEE 4-bus model and IEEE 6-bus model. To solve the problem, we have applied five newly developed versions of differential evolution (DE) called modified DE versions (MDE1, MDE2, MDE3, MDE4, and MDE5). The results are compared with the classical DE algorithm and with five more algorithms available in the literature; the numerical results show that the modified DE algorithms outperforms or perform at par with the other algorithms. [Copyright &y& Elsevier]

Abstract: In this paper, a new feasible primal–dual interior point algorithm for solving inequality constrained optimization problems is presented. At each iteration, the algorithm solves only two or three reduced systems of linear equations with the same coefficient matrix. The searching direction is feasible and the object function is monotone decreasing. The proposed algorithm is proved to possess global and superlinear convergence under mild conditions. Finally, some numerical experiments with the algorithm are reported. [Copyright &y& Elsevier]