Search

Motion blur in dynamic scenes is an important yet challenging research topic. Recently, deep learning methods have achieved impressive performance for dynamic scene deblurring. However, the motion information contained in a blurry image has yet to be fully explored and accurately formulated because: (i) the ground truth of dynamic motion is difficult to obtain; (ii) the temporal ordering is destroyed during the exposure; and (iii) the motion estimation from a blurry image is highly ill-posed. By revisiting the principle of camera exposure, motion blur can be described by the relative motions of sharp content with respect to each exposed position. In this paper, we define exposure trajectories, which represent the motion information contained in a blurry image and explain the causes of motion blur. A novel motion offset estimation framework is proposed to model pixel-wise displacements of the latent sharp image at multiple timepoints. Under mild constraints, our method can recover dense, (non-)linear exposure trajectories, which significantly reduce temporal disorder and ill-posed problems. Finally, experiments demonstrate that the recovered exposure trajectories not only capture accurate and interpretable motion information from a blurry image, but also benefit motion-aware image deblurring and warping-based video extraction tasks. Codes are available on https://github.com/yjzhang96/Motion-ETR. [ABSTRACT FROM AUTHOR]

This article considers the problem of estimating the trajectory of a ballistic target in the reentry phase using 2-D measurements (azimuth and elevation angles) from a moving passive sensor. Previous works investigated the estimation problem of an object in the thrusting and initial ballistic phase from a single fixed passive sensor. This article shows that the 3-D trajectory in the reentry phase can be obtained by estimating the target's state at the end of the observation interval. The 7-d motion parameter vector (velocity azimuth angle, velocity elevation angle, drag coefficient, target speed, and 3-D position) is estimated by the maximum likelihood (ML) estimator with numerical search. Then we can predict the future position at an arbitrary time and the impact point of the target. The observability of the system for a sensor on a fast aircraft moving with constant velocity or maneuvering is verified via the invertibility of the Fisher information matrix. This is a major extension of the applicability of the recent observability proof for a stationary passive sensor observing a target in a gravitational field. The Cramer–Rao lower bound for the estimated parameters is evaluated and it shows that the estimates are statistically efficient. The angle estimation performance for the ML estimator is also compared with that of the polynomial fitting method. Simulation results illustrate the effectiveness of the proposed method. [ABSTRACT FROM AUTHOR]

In this article, we present an optimization-based framework for multicopter trajectory planning subject to geometrical configuration constraints and user-defined dynamic constraints. The basis of the framework is a novel trajectory representation built upon our novel optimality conditions for unconstrained control effort minimization. We design linear-complexity operations on this representation to conduct spatial–temporal deformation under various planning requirements. Smooth maps are utilized to exactly eliminate geometrical constraints in a lightweight fashion. A variety of state-input constraints are supported by the decoupling of dense constraint evaluation from sparse parameterization and the backward differentiation of flatness map. As a result, this framework transforms a generally constrained multicopter planning problem into an unconstrained optimization that can be solved reliably and efficiently. Our framework bridges the gaps among solution quality, planning efficiency, and constraint fidelity for a multicopter with limited resources and maneuvering capability. Its generality and robustness are both demonstrated by applications to different flight tasks. Extensive simulations and benchmarks are also conducted to show its capability of generating high-quality solutions while retaining the computation speed against other specialized methods by orders of magnitude. [ABSTRACT FROM AUTHOR]

Optimizing k-space sampling trajectories is a promising yet challenging topic for fast magnetic resonance imaging (MRI). This work proposes to optimize a reconstruction method and sampling trajectories jointly concerning image reconstruction quality in a supervised learning manner. We parameterize trajectories with quadratic B-spline kernels to reduce the number of parameters and apply multi-scale optimization, which may help to avoid sub-optimal local minima. The algorithm includes an efficient non-Cartesian unrolled neural network-based reconstruction and an accurate approximation for backpropagation through the non-uniform fast Fourier transform (NUFFT) operator to accurately reconstruct and back-propagate multi-coil non-Cartesian data. Penalties on slew rate and gradient amplitude enforce hardware constraints. Sampling and reconstruction are trained jointly using large public datasets. To correct for possible eddy-current effects introduced by the curved trajectory, we use a pencil-beam trajectory mapping technique. In both simulations and in- vivo experiments, the learned trajectory demonstrates significantly improved image quality compared to previous model-based and learning-based trajectory optimization methods for $10\times $ acceleration factors. Though trained with neural network-based reconstruction, the proposed trajectory also leads to improved image quality with compressed sensing-based reconstruction. [ABSTRACT FROM AUTHOR]

Placing robotsoutside controlled conditions requires versatile movement representations that allow robots to learn new tasks and adapt them to environmental changes. The introduction of obstacles or the placement of additional robots in the workspace and the modification of the joint range due to faults or range-of-motion constraints are typical cases, where the adaptation capabilities play a key role for safely performing the robot’s task. Probabilistic movement primitives (ProMPs) have been proposed for representing adaptable movement skills, which are modeled as Gaussian distributions over trajectories. These are analytically tractable and can be learned from a small number of demonstrations. However, both the original ProMP formulation and the subsequent approaches only provide solutions to specific movement adaptation problems, e.g., obstacle avoidance, and a generic, unifying, probabilistic approach to adaptation is missing. In this article, we develop a generic probabilistic framework for adapting ProMPs. We unify previous adaptation techniques, for example, various types of obstacle avoidance, via-points, and mutual avoidance, in one single framework and combine them to solve complex robotic problems. Additionally, we derive novel adaptation techniques such as temporally unbound via-points and mutual avoidance. We formulate adaptation as a constrained optimization problem, where we minimize the Kullback–Leibler divergence between the adapted distribution and the distribution of the original primitive,while we constrain the probability mass associated with undesired trajectories to be low. We demonstrate our approach on several adaptation problems on simulated planar robot arms and seven-degree-of-freedom Franka Emika robots in a dual-robot-arm setting. [ABSTRACT FROM AUTHOR]

Previous deep learning-based video stabilizers require a large scale of paired unstable and stable videos for training, which are difficult to collect. Traditional trajectory-based stabilizers, on the other hand, divide the task into several sub-tasks and tackle them subsequently, which are fragile in textureless and occluded regions regarding the usage of hand-crafted features. In this paper, we attempt to tackle the video stabilization problem in a deep unsupervised learning manner, which borrows the divide-and-conquer idea from traditional stabilizers while leveraging the representation power of DNNs to handle the challenges in real-world scenarios. Technically, DUT is composed of a trajectory estimation stage and a trajectory smoothing stage. In the trajectory estimation stage, we first estimate the motion of keypoints, initialize and refine the motion of grids via a novel multi-homography estimation strategy and a motion refinement network, respectively, and get the grid-based trajectories via temporal association. In the trajectory smoothing stage, we devise a novel network to predict dynamic smoothing kernels for trajectory smoothing, which can well adapt to trajectories with different dynamic patterns. We exploit the spatial and temporal coherence of keypoints and grid vertices to formulate the training objectives, resulting in an unsupervised training scheme. Experiment results on public benchmarks show that DUT outperforms state-of-the-art methods both qualitatively and quantitatively. The source code is available at https://github.com/Annbless/DUTCode. [ABSTRACT FROM AUTHOR]

As an increasing number of asteroids are being discovered, detecting them using limited propulsion resources and time has become an urgent problem in the aerospace field. However, there is no universal fast asteroid sequence selection method that finds the trajectories for multiple low-thrust spacecraft for detecting a large number of asteroids. Furthermore, the calculation efficiency of the traditional trajectory optimization method is low, and it requires a large number of iterations. Therefore, this study combines Monte Carlo tree search (MCTS) with spacecraft trajectory optimization. A fast MCTS pruning algorithm is proposed, which can quickly complete asteroid sequence selection and trajectory generation for multispacecraft exploration of multiple asteroids. By combining the Bezier shape-based (SB) method and MCTS, this study realizes the fast search of the exploration sequence and the efficient optimization of the continuous transfer trajectories. In the simulation example, compared with the traversal algorithm, the MCTS pruning algorithm obtained the global optimal detection sequence of the search tree in a very short time. Under the same conditions, the Bezier SB method obtained the transfer trajectory with a better performance index faster than the finite Fourier series SB method. Performances of the proposed method are illustrated through a complex asteroid multiflyby mission design. [ABSTRACT FROM AUTHOR]

Intelligent reflecting surface (IRS) cooperated with the simultaneous wireless information and power transfer (SWIPT) can reinforce the desired signal and deal with the energy supply problem effectively. By leveraging the on-demand mobility of unmanned aerial vehicles (UAVs), the IRS cooperated SWIPT can be deployed in more flexible and reliable scenarios. In this article, we investigate the UAV-mounted IRS-assisted SWIPT for Internet of Things (IoT) networks. In particular, a UAV-mounted IRS is deployed to assist the information transmission and power transfer from the access point to several IoT devices simultaneously. Taking full advantage of the UAV-mounted IRS in attending multiple IoT devices flexibly, a time division multiple access (TDMA)-based scheduling protocol is proposed to serve different IoT devices alternatively during the UAV flying along an optimized trajectory with the information and power transfer executed. Then, an optimization problem of maximizing the minimum average achievable rate of multiple devices is formulated with the specific energy harvesting requirement guaranteed. To solve the nonconvex problem, we leverage the successive convex approximation and block coordinate descent methods to develop an iterative algorithm. Simulation results demonstrate that with the help of the more flexible and reliable UAV-mounted IRS, the minimum achievable rate of the IoT network can be significantly improved. [ABSTRACT FROM AUTHOR]

Due to their promising applications and intriguing characteristics, Unmanned Aerial Vehicles (UAVs) can be dispatched as flying base stations to serve multiple energy-constrained Internet-of-Things (IoT) sensors. Moreover, to ensure fresh data collection while providing sustainable energy support to a large set of IoT devices, a required number of UAVs should be deployed to carry out these two tasks efficiently and promptly. Indeed, the data collection requires that UAVs first make Wireless Energy Transfer (WET) to supply IoT devices with the necessary energy in the downlink. Then, IoT devices perform Wireless Information Transmission (WIT) to UAVs in the uplink based on the harvested energy. However, it turns out that when the same UAV performs WIT and WET, its energy usage and the data collection time are severely penalized. Worse yet, it is difficult to efficiently coordinate between UAVs to improve the performance in terms of WET and WIT. This work proposes to divide UAVs into two teams to behave as data collectors and energy transmitters, respectively. A Multi-Agent Deep Reinforcement Learning (MADRL) method, called TEAM, is leveraged to jointly optimize both teams’ trajectories, minimize the expected Age of Information (AoI), maximize the throughput of IoT devices, minimize the energy utilization of UAVs, and enhance the energy transfer. Simulation results depict that TEAM can effectively synchronize UAV teams and adapt their trajectories while serving a large-scale dynamic IoT environment. [ABSTRACT FROM AUTHOR]

The control objective of the vertical plane underactuated manipulator (VPUM) is generally to swing up the end point (EP) from the vertical down equilibrium point (VDEP) to the vertical up equilibrium point (VUEP), and finally, to stabilize it at the VUEP. The zone control methods are usually used to achieve this control objective, but the problem of these methods is that they cannot find a unified zone range, and it is easy to appear singularity in the motion process. In this article, for two-link VPUMs, we propose a control strategy based on trajectory planning and optimization, which does not need to divide the zone range, avoids the singularity problem, and can achieve the control objective quickly and smoothly. We design the trajectory by using the time scale method for the active link according to the initial and target states. Then, we obtain the trajectory parameters by employing differential evolution algorithm to ensure that the passive link can also move from the initial states to the target states simultaneously. We design a sliding mode tracking controller to make the active link move along the designed trajectory, so the EP is moved to VUEP. Meantime, we design a sliding mode stabilization controller to ensure that the system is stable at VUEP. Finally, the universality and robustness of the proposed method are proved by simulations. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle (UAV)-enabled communication has emerged as an irreplaceable technology in military, disaster relief and emergency scenarios. This correspondence investigates the average throughput in a UAV-enabled cognitive radio network, where the UAV is regarded as a dedicated secondary user to enhance the network coverage and spectral efficiency. Based on the probabilistic line-of-sight channel, we exploit the joint design of UAV trajectory and resource allocation to maximize the average throughput under the constraints of co-channel interference and completion time. The original problem is a mixed integer non-convex problem which is generally NP-hard. We first decompose the primal problem into a bilevel programming problem, and then propose an efficient high-quality algorithm based on the particle swarm optimization approach. The optimized trajectory reveals the trade-off between throughput and co-channel interference. Numerical results verify the superiority of the proposed algorithm as compared to other benchmark schemes. [ABSTRACT FROM AUTHOR]

3D human trajectory reconstruction in an indoor scene is critical in various applications, such as indoor navigation and human activity recognition. This task is challenging due to occlusion and clutters of indoor scenes, flexible human body joints, and severe lack of relevant datasets. Although several methods have been proposed to reconstruct a 3D human trajectory, they either can recover only 2D positions or require human initiative cooperation. In this paper, we propose a novel framework for 3D human trajectory reconstruction in an indoor scene using monocular surveillance videos and static point clouds without any initiative cooperation. The proposed framework consists of three modules: 3D pose estimation, depth regression, and trajectory reconstruction. We first estimate 3D pose from videos. Especially, we reconstruct a half-body 3D pose to deal with the occlusion problem. Then, we propose a depth regression approach to iteratively regress the depth of a 3D pose. Unlike data-driven approaches, our depth regression approach does not require training data and can be integrated into any 3D pose model. Finally, we exploit the geometric constraints from the point cloud to optimize the 3D trajectory. We evaluated the 3D pose estimation and depth regression modules on the H3.6M datasets. Due to the lack of evaluation datasets, we also built a trajectory dataset to evaluate the trajectory reconstruction performance. Empirical evaluation shows that our framework achieves accurate trajectory reconstruction results on real-world videos. [ABSTRACT FROM AUTHOR]

Planning high-speed trajectories for UAVs in unknown environments requires algorithmic techniques that enable fast reaction times to guarantee safety as more information about the environment becomes available. The standard approaches that ensure safety by enforcing a “stop” condition in the free-known space can severely limit the speed of the vehicle, especially in situations where much of the world is unknown. Moreover, the ad-hoc time and interval allocation scheme usually imposed on the trajectory also leads to conservative and slower trajectories. This work proposes FASTER (Fast and Safe Trajectory Planner) to ensure safety without sacrificing speed. FASTER obtains high-speed trajectories by enabling the local planner to optimize in both the free-known and unknown spaces. Safety is ensured by always having a safe back-up trajectory in the free-known space. The MIQP formulation proposed also allows the solver to choose the trajectory interval allocation. FASTER is tested extensively in simulation and in real hardware, showing flights in unknown cluttered environments with velocities up to 7.8 m/s, and experiments at the maximum speed of a skid-steer ground robot (2 m/s). [ABSTRACT FROM AUTHOR]

This article describes a topological approach to generating families of open- and closed-loop walking gaits for underactuated 2-D and 3-D biped walkers subject to configuration inequality constraints, physical holonomic constraints (e.g., closed-loop linkages), and virtual holonomic constraints (user-defined constraints enforced through feedback control). Our method constructs implicitly defined manifolds of feasible periodic gaits within a state-time-control space that parameterizes the biped’s hybrid trajectories. Since equilibrium configurations of the biped often belong to such manifolds, we use equilibria as “templates” from which to grow the gait families. Equilibria are reliable seeds for the construction of gait families, eliminating the need for random, intuited, or bio-inspired initial guesses at feasible trajectories in an optimization framework. We demonstrate the approach on several 2-D and 3-D biped walkers. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle (UAV)-enabled wireless power transfer (WPT) is a viable solution to remotely charge several energy receivers (ERs) in areas with intermittent access to a source of energy. However, given the limited available energy in the on-board battery of the UAV, which is mainly required to suffice propulsion energy consumption, the UAV struggles to roam seamlessly for long intervals. A key challenge is thus to efficiently use the limited battery energy, and accordingly prolong the UAV’s endurance, via controlling the underlying associated parameters such as cruising velocity. To further extend the battery lifetime, the UAV can also harness other sources of sustainable energy, such as sunlight, via solar energy harvesting. This paper studies a UAV-enabled WPT system, where a rotary-wing UAV transfers radio frequency (RF) wireless energy to several ERs at known locations. To offer uninterrupted seamless service, the UAV also harvests solar energy using solar panels. Considering the propulsion energy consumption of the UAV, we maximize the minimum average power received among all ERs over a finite cycle duration by jointly optimizing the UAV’s time allocation between harvesting and charging, flight trajectory as well as velocity, and transmit power allocation. Due to the non-convexity of the problem, we utilize the block coordinate descent (BCD) and successive convex approximation (SCA) methods. Numerical results show that the proposed solution outperforms benchmark schemes. [ABSTRACT FROM AUTHOR]

Satellite and unmanned aerial vehicle (UAV) networks have been introduced as enhanced approaches to provide dynamic control, massive connections and global coverage for future wireless communication systems. This paper considers a coordinated satellite-UAV communication system, where the UAV performs the environmental reconnaissance task with the assistance of satellites in a hostile jamming environment. To fulfill this task, the UAV needs to realize autonomous trajectory control and upload the collected data to the satellite. With the aid of the uploading data, the satellite builds the environment situation map integrating the beam quality, jamming status, and traffic distribution. Accordingly, we propose a closed-loop anti-jamming dynamic trajectory optimization approach, which is divided into three stages. Firstly, a coarse trajectory planning is made according to the limited prior information and preset points. Secondly, the flight control between two adjacent preset points is formulated as a Markov decision process, and reinforcement learning (RL) based automatic flying control algorithms are proposed to explore the unknown hostile environment and realize autonomous and precise trajectory control. Thirdly, based on the collected data during the UAV’s flight, the satellite utilizes an environment situation estimating algorithm to build an environment situation map, which is used to reselect the preset points for the first stage and provide better initialization for the RL process in the second stage. Simulation results verify the validity and superiority of the proposed approach. [ABSTRACT FROM AUTHOR]

This article presents MADER, a 3-D decentralized and asynchronous trajectory planner for UAVs that generates collision-free trajectories in environments with static obstacles, dynamic obstacles, and other planning agents. Real-time collision avoidance with other dynamic obstacles or agents is done by performing outer polyhedral representations of every interval of the trajectories and then including the plane that separates each pair of polyhedra as a decision variable in the optimization problem. MADER uses our recently developed MINVO basis to obtain outer polyhedral representations with volumes 2.36 and 254.9 times, respectively, smaller than the Bernstein or B-Spline bases used extensively in the planning literature. Our decentralized and asynchronous algorithm guarantees safety with respect to other agents by including their committed trajectories as constraints in the optimization and then executing a collision check-recheck scheme. Finally, extensive simulations in challenging cluttered environments show up to a 33.9% reduction in the flight time, and a 88.8% reduction in the number of stops compared to the Bernstein and B-Spline bases, shorter flight distances than centralized approaches, and shorter total times on average than synchronous decentralized approaches. [ABSTRACT FROM AUTHOR]

Despite the wide utilization of unmanned aerial vehicles (UAVs), UAV communications are susceptible to eavesdropping due to air-ground line-of-sight channels. Intelligent reflecting surface (IRS) is capable of reconfiguring the propagation environment, and thus is an attractive solution for integrating with UAV to facilitate the security in wireless networks. In this paper, we investigate the secure transmission design for an IRS-assisted UAV network in the presence of an eavesdropper. With the aim at maximizing the average secrecy rate, the trajectory of UAV, the transmit beamforming, and the phase shift of IRS are jointly optimized. To address this sophisticated problem, we decompose it into three sub-problems and resort to an iterative algorithm to solve them alternately. First, we derive the closed-form solution to the active beamforming. Then, with the optimal transmit beamforming, the passive beamforming optimization problem of fractional programming is transformed into corresponding parametric sub-problems. Moreover, the successive convex approximation is applied to deal with the non-convex UAV trajectory optimization problem by reformulating a convex problem which serves as a lower bound for the original one. Simulation results validate the effectiveness of the proposed scheme and the performance improvement achieved by the joint trajectory and beamforming design. [ABSTRACT FROM AUTHOR]

Unmanned aerial vehicle (UAV)-aided two-way relay networks with multiple terrestrial user pairs is investigated, where a fix-wing UAV is served as a two-way relay to assist information transmission. We aim to maximize the total rate of the two-way relay networks while the quality of service (QoS) being guaranteed. A novel relay strategy, namely time-slots pairing, is proposed by exploiting physical-layer network coding (PNC) protocol. Specifically, the UAV receives and buffers the signals from the scheduled user pair when the UAV approaches one of them, then forwards the modulated signal when the UAV is close to the other. As a result, a non-convex total rate maximization problem is formulated by joint trajectory design and resource optimization. To solve this problem, we first decompose it into three sub-problems, and then a three-step iterative algorithm that can effectively handle the non-convex problem with no worse than a polynomial complexity is developed leveraging the block coordinate descent (BCD) technique and successive convex approximation (SCA) method. Simulation results finally illustrate that: 1) Compared with amplify-and-forward (AF) or decode-and-forward (DF) protocols, the proposed design based on PNC protocol can significantly improve the total rate of the two-way relay networks; 2) the time-slots pairing relay strategy always achieves a significant enhancement on performance than the traditional non-time-slots pairing relay strategy; 3) the time-slots pairing relay strategy is more favorable for the mobile PNC relay networks since it can well resist the degradation of the entire networks caused by users’ increased service quality requirements. [ABSTRACT FROM AUTHOR]

This article presents a distributed, efficient, scalable, and real-time motion planning algorithm for a large group of agents moving in 2-D or 3-D spaces. This algorithm enables autonomous agents to generate individual trajectories independently with only the relative position information of neighboring agents. Each agent applies a force-based control that contains two main terms: 1) collision avoidance and 2) navigational feedback. The first term keeps two agents separate with a certain distance, while the second term attracts each agent toward its goal location. Compared with existing collision-avoidance algorithms, the proposed force-based motion planning (FMP) algorithm can find collision-free motions with lower transition time, free from velocity state information of neighboring agents. It leads to less computational overhead. The performance of proposed FMP is examined over several dense and complex 2-D and 3-D benchmark simulation scenarios, with results outperforming existing methods. [ABSTRACT FROM AUTHOR]

This article extends the optimal covariance steering (CS) problem for linear stochastic systems subject to chance constraints so as to account for an optimal allocation of the risk. Previous works have assumed a uniform risk allocation in order to cast the optimal control problem as a semidefinite program, which can be solved efficiently using standard SDP solvers. An iterative risk allocation (IRA) formalism is used to solve the optimal risk allocation problem for CS using a two-stage approach. The upper-stage of IRA optimizes the risk, which is a convex problem, while the lower-stage optimizes the controller with the new constraints. The process is applied iteratively until the optimal risk allocation that achieves the lowest total cost is obtained. The proposed framework results in solutions that tend to maximize the terminal covariance, while still satisfying the chance constraints, thus leading to less conservative solutions than previous methodologies. In this article, we consider both polyhedral and cone state chance constraints. Finally, we demonstrate the approach to a spacecraft rendezvous problem and compare the results with other competing approaches. [ABSTRACT FROM AUTHOR]

In the article, we present an efficient optimization framework that solves trajectory optimization problems by decoupling state variables from timing variables, thereby decomposing a challenging nonlinear programming (NLP) problem into two easier subproblems. With timing fixed, the state variables can be optimized efficiently using convex optimization, and the timing variables can be optimized in a separate NLP, which forms a bilevel optimization problem. The challenge of obtaining the gradient of the timing variables is solved by sensitivity analysis of parametric NLPs. The exact analytic gradient is computed from the dual solution as a by-product, whereas existing finite-difference techniques require additional optimization. The bilevel optimization framework efficiently optimizes both timing and state variables which is demonstrated on generating trajectories for an UAV. Numerical experiments demonstrate that bilevel optimization converges significantly more reliably than a standard NLP solver, and analytical gradients outperform finite differences in terms of computation speed and accuracy. Physical experiments demonstrate its real-time applicability for reactive target tracking tasks. [ABSTRACT FROM AUTHOR]

Recent advances in trajectory replanning have enabled quadrotor to navigate autonomously in unknown environments. However, high-speed navigation still remains a significant challenge. Given very limited time, existing methods have no strong guarantee on the feasibility or quality of the solutions. Moreover, most methods do not consider environment perception, which is the key bottleneck to fast flight. In this article, we present RAPTOR, a robust and perception-aware replanning framework to support fast and safe flight, which addresses these issues systematically. A path-guided optimization approach that incorporates multiple topological paths is devised, to ensure finding feasible and high-quality trajectories in very limited time. We also introduce two perception-aware planning approaches to actively observe and avoid unknown obstacles. A risk-aware trajectory refinement ensures that unknown obstacles which may endanger the quadrotor can be observed earlier and avoid in time. The motion of yaw angle is planned to actively explore the surrounding space that is relevant for safe navigation. The proposed methods are tested extensively through benchmark comparisons and challenging indoor and outdoor aggressive flights. We release our implementation as an open-source package1 for the community. [ABSTRACT FROM AUTHOR]

Unmanned Aerial Vehicles (UAVs) have attacted much attention in the field of wireless communication due to its agility and altitude. UAVs can be used as low-altitude aerial base stations (UAV-BSs) to provide communication services for ground devices (GDs) in various scenarios, such as emergency communication and traffic offloading in hotspots. However, due to the limited communication ranges and high prices of commercial UAV-BSs, covering a target area all the time with sufficient UAVs is quite challenging, especially under dynamic environment. We need to design the trajectory of the UAV-BSs to optimize system performance. Most existing works focus on the energy-efficient coverage and throughput maximization but ignore the fairness of communication service, especially the fairness at user-level. Besides, reinforcement learning is suitable for solving decision problems in dynamic environments. However, most existing works use centralized deep reinforcement learning (DRL) approaches. Due to the scalability and low time complexity, a distributed DRL approach is more suitable for multiple UAV-BSs communication system in dynamic environment. Unlike previous works, we characterize the fairness at user-level based on proportional fairness scheduling and formulate a weighted-throughput maximization problem via designing UAV-BSs’ trajectory. Then we model the dynamic deploymentproblem of UAV-BSs as a Markov game and propose a multi-agent deep reinforcement learning-based distributed UAV-BSs control approach named MAUC. MAUC approach adopts the framework of centralized training with distributed execution. Simulation results show that the MAUC can improve fairness of communication service by sacrificing a small amount of throughput. [ABSTRACT FROM AUTHOR]

In maritime wireless communications, unmanned surface vehicles (USVs) can improve coverage and transmission performance due to their agile maneuverability and flexible deployment. This paper considers a USV-enabled maritime wireless network, where a USV is employed to assist the communication between the terrestrial base station and ships. Considering the maritime environment characteristics and earth curvature, we establish the systematic USV kinetics and information transmission models. To guarantee fairness, we aim to maximize the minimum expected throughput overall ships by jointly optimizing the trajectory and communication resource allocation, subject to the constraints of the USV kinetics, safe sailing, breakpoint distances, line-of-sight links, resource allocation, and information-causality. Due to the complexity of the maritime two-ray signal propagation model, we propose a channel approximation method to find an upper bound of the throughput for the original problem. By the problem decomposition, two sub-problems are derived and solved iteratively using successive convex approximation and interior-point methods. Simulation results confirm the effectiveness of the proposed method and show that USV can significantly improve transmission performance in maritime wireless networks. [ABSTRACT FROM AUTHOR]

This article presents a novel recursive smooth trajectory (RST) generation algorithm for application in robotics and in particular for unmanned aerial vehicles (UAVs). RST builds the trajectory recursively as a smooth polynomial path, thus a closed form trajectory satisfying any arbitrary dynamic limitation that translates into kinematic constraints (e.g., position, velocity, acceleration, etc.). Uncertainties and perturbations in the constraints are also discussed, modeled, and finally included in the calculation of the polynomial trajectory coefficients. Moreover, due to its recursive formulation, RST enables an immediate extension toward the solution of a trajectory optimization problem. In particular, it is shown that the minimum-snap piecewise polynomial trajectory can be interpreted as a special case of RST. The effectiveness of the proposed algorithm is demonstrated numerically via two illustrative scenarios. Its application to a UAV structure is also discussed to highlight the advantage of a smooth path over a piecewise one. Finally, the computational complexity and memory requirements are analyzed. [ABSTRACT FROM AUTHOR]

A model predictive control (MPC) strategy based on optimal switching sequence concepts is presented for direct power control of grid-connected three-level neutral-point clamped converters. The proposed control strategy explicitly considers the modulator in its formulation along with the model of the system. Through two well-formulated optimal control problems, the proposed strategy is shown to optimally achieve control of the average trajectory of the active and reactive powers as well as the dc-link capacitor voltages without using weighting factors to tradeoff both control targets. Experimental results demonstrate this strategy produces improved steady-state performance with a well-defined output voltage spectrum and fixed-switching frequency while maintaining the inherent fast dynamic responses of MPC strategies. [ABSTRACT FROM AUTHOR]

On a grand scale, motion trajectories are usually defined by an origin, a sequence of waypoints, and a destination. A typical example is in air traffic management (ATM), where a flight from an origin passes several waypoints and arrives at a destination. The origin, the waypoints, and the destination contain useful information for trajectory modeling. On the other hand, due to trajectory design criteria and ATM restrictions and requirements, there are long-range dependencies in a flight trajectory. Such dependencies can be modeled by taking the origin, waypoints, and destination into account in trajectory modeling. In this article, we propose a class of conditionally Markov (CM) sequences to model such trajectories with long-range dependencies. First, we define a general CM sequence as a foundation. Then, we discuss its special cases for different scenarios. We derive dynamic models of these CM sequences in the Gaussian case. We show how parameters of the models can be learned from data or designed. We also justify the use of the proposed CM models for trajectory modeling. In addition, we obtain optimal filters and predictors for different models. Simulation demonstrations are given. [ABSTRACT FROM AUTHOR]

In this article, we propose a nonlinear receding horizon game-theoretic planner for autonomous cars in competitive scenarios with other cars. The online planner is specifically formulated for a multiple-car autonomous racing game, in which each car tries to advance along a given track as far as possible with respect to the other cars. The algorithm extends previous work on game-theoretic planning for single-integrator agents to be suitable for autonomous cars in the following ways: 1) by representing the trajectory as a piecewise polynomial; 2) incorporating bicycle kinematics into the trajectory; and 3) enforcing constraints on path curvature and acceleration. The game-theoretic planner iteratively plans a trajectory for the ego vehicle and then the other vehicles in sequence until convergence. Crucially, the trajectory optimization includes a sensitivity term that allows the ego vehicle to reason about how much the other vehicles will yield to the ego vehicle to avoid collisions. The resulting trajectories for the ego vehicle exhibit rich game strategies such as blocking, faking, and opportunistic overtaking. The game-theoretic planner is shown to significantly outperform a baseline planner using model-predictive control, which does not take interaction into account. The performance is validated in high-fidelity numerical simulations with three cars, in experiments with two small-scale autonomous cars, and in experiments with a full-scale autonomous car racing against a simulated vehicle (video is available at https://youtube.com/playlist?list=PLmIcLEh8KMje4rYBqRANDuKvqFvj7LCRp). [ABSTRACT FROM AUTHOR]

In this letter, we investigate an unmanned aerial vehicle (UAV) enabled wireless powered communication network (WPCN), in which the UAV first employs the radio frequency (RF) signal to power ground users, and then the users communicate with the UAV by using the harvested energy. The sum rate maximization problem in WPCN suffers doubly near-far effect caused by the double signal propagation loss in both the energy harvesting and communication stage. It is generally believed that this effect can be alleviated by integrating UAV into WPCN, thanks to its flexible deployment. However, due to the lack of analytical solution in state-of-art research, it is still unclear how to quantify the advantage that the mobility of UAV brings to migrating the doubly near-far effect. To address this issue, by showing that the optimal UAV trajectory has a multi-location hovering structure, we first derive the closed-form optimal solution of resource allocation, as a function of the UAV hovering location for downlink wireless power transfer (WPT). We then prove that the UAV in our case only needs to hover at a single location for WPT. More importantly, it is explicitly shown that the doubly near far effect can be alleviated into near-far effect. Simulation results validate our analysis. [ABSTRACT FROM AUTHOR]

Virtual viewpoints synthesis is an essential process for many immersive applications including Free-viewpoint TV (FTV). A widely used technique for viewpoints synthesis is Depth-Image-Based-Rendering (DIBR) technique. However, such technique may introduce challenging non-uniform spatial-temporal structure-related distortions. Most of the existing state-of-the-art quality metrics fail to handle these distortions, especially the temporal structure inconsistencies observed during the switch of different viewpoints. To tackle this problem, an elastic metric and multi-scale trajectory based video quality metric (EM-VQM) is proposed in this paper. Dense motion trajectory is first used as a proxy for selecting temporal sensitive regions, where local geometric distortions might significantly diminish the perceived quality. Afterwards, the amount of temporal structure inconsistencies and unsmooth viewpoints transitions are quantified by calculating 1) the amount of motion trajectory deformations with elastic metric and, 2) the spatial-temporal structural dissimilarity. According to the comprehensive experimental results on two FTV video datasets, the proposed metric outperforms the state-of-the-art metrics designed for free-viewpoint videos significantly and achieves a gain of 12.86% and 16.75% in terms of median Pearson linear correlation coefficient values on the two datasets compared to the best one, respectively. [ABSTRACT FROM AUTHOR]

In single-port access surgeries, robot size is crucial due to the limited workspace. Thus, a robot may be designed under-actuated. Suturing, in contrast, is a complicated task and requires full actuation. This study aims to overcome this shortcoming by implementing an optimization-based algorithm for autonomous suturing for an under-actuated robot. The proposed algorithm approximates the ideal suturing trajectory by slightly reorienting the needle while deviating as little as possible from the ideal, full degree-of-freedom suturing case. The deviation of the path taken by a custom robot with respect to the ideal trajectory varies depending on the suturing starting location within the workspace as well as the needle size. A quantitative analysis reveals that in 13% of the investigated workspace, the accumulative deviation was less than 10 mm. In the remaining workspace, the accumulative deviation was less than 30 mm. Likewise, the accumulative deviation of a needle with a radius of 10 mm was 2.2 mm as opposed to 8 mm when the radius was 20 mm. The optimization-based algorithm maximized the accuracy of a four-DOF robot to perform a path-constrained trajectory and illustrates the accuracy-workspace correlation. [ABSTRACT FROM AUTHOR]

This letter considers a solar-powered unmanned aerial vehicle (UAV) system, where the UAV collects data from Internet of Things Devices (IoTDs) on the ground while also charging them using laser charging technology. Both the linear and nonlinear laser charging models are considered. We aim to maximize the residual energy of the UAV while satisfying the requirements of IoTDs by jointly optimizing the three-dimensional (3D) trajectory of UAV and scheduling for IoTDs. The optimization problem is formulated as a mixed integer non-convex problem which is difficult to solve in general. We apply the successive convex approximation and block coordinate descent algorithm to address this problem successfully. Simulation results verify the effectiveness of our algorithm compared with two benchmark methods. [ABSTRACT FROM AUTHOR]

The time-optimal trajectory planning problem involves minimizing the time required to follow a path defined in space, subject to kinematic and dynamic constraints. Here, we introduce a novel technique, called the bisection algorithm (BA), which is fully implemented in C++ and extends dynamic programming approaches to the problem. These approaches, which rely on dividing the global problem into a series of simpler subproblems, become increasingly advantageous compared to direct transcription methods as the number of problem constraints increases. In contrast to nearly all other dynamic programming approaches, BA does not rely on finding a maximum-velocity curve or explicitly finding acceleration switching points during the trajectory planning process. Additionally, only one forward and one backward integration are used, during which all constraints are imposed. This approach is made feasible through careful control of the numerical integration process and the use of a bisection algorithm to resolve constraint violations during integration. BA is shown to be significantly simpler, faster, and more robust than recently proposed algorithms: a direct comparison is made for a series of paths to be followed by a serial manipulator, subject to kinematic constraints. The wide applicability of BA is then established by solving the time-optimal problem for a parallel manipulator following a complex path, subject to both kinematic and dynamic constraints. [ABSTRACT FROM AUTHOR]

In principle, the Automatic Identification System (AIS) makes covert rendezvous at sea, such as smuggling and piracy, impossible; in practice, AIS can be spoofed or simply disabled. Previous work showed a means whereby such deviations can be spotted. Here we play the opponent's side, and describe the least-detectable trajectory that the elusive vessel can take. The opponent's route planning problem is formalized as a non-convex optimization problem capitalizing the Kullback-Leibler (KL) divergence between the statistical hypotheses of the nominal and the anomalous trajectories as key performance measure. The velocity of the vessel is modeled with an Ornstein-Uhlenbeck (OU) mean reverting stochastic process, and physical and practical requirements are accounted for by enforcing several constraints at the optimization design stage. To handle the resulting non-convex optimization problem, we propose a globally-optimal and computationally-efficient technique, called the Non-Convex Optimized Stealth Trajectory (N-COST) algorithm. The N-COST algorithm consists amounts to solving multiple convex problems, with the number proportional to the number of segments of the piecewise OU trajectory. The effectiveness of the proposed approach is demonstrated through case studies and a real-world example. [ABSTRACT FROM AUTHOR]

This article proposes a computational trajectory optimization framework for solving the problem of multiobjective automatic parking motion planning. Constrained automatic parking maneuver problem is usually difficult to solve because of some practical limitations and requirements. This problem becomes more challenging when multiple objectives are required to be optimized simultaneously. The designed approach employs a swarm intelligent algorithm to produce the tradeoff front along the objective space. In order to enhance the local search ability of the algorithm, a gradient operation is utilized to update the solution. In addition, since the evolutionary process tends to be sensitive with respect to the flight control parameters, a novel adaptive parameter controller is designed and incorporated in the algorithm framework such that the proposed method can dynamically balance the exploitation and exploration. The performance of using the designed multiobjective strategy is validated and analyzed by performing a number of simulation and experimental studies. The results indicate that the present approach can provide reliable solutions and it can outperform other existing approaches investigated in this article. [ABSTRACT FROM AUTHOR]

Due to the small size, low cost, and autonomous nature, unmanned aerial vehicles (UAVs) have attracted growing attention in improving traditional networks’ performance. This paper considers a multi-UAV enabled large-scale wireless recharge networks, where a group of UAVs is dispatched as mobile wireless power transfer, and information collection systems to serve a set of ground low-power sensor nodes. Specifically, the UAVs employ radio frequency (RF) wireless power transfer (WPT) to supply energy towards the sensor nodes, and the communication services are available via wireless information transfer (WIT) systems. To achieve balanced energy consumption among UAVs, we maximize the energy utilization efficiency of UAVs, and minimize the communication delay by optimizing the trajectory jointly with constraints of the energy capacity, and the area of the target region. The formulated problem is a mixed-integer programming problem that is a variation of multiple traveling salesman problem. Thus we present a heuristic algorithm that combines the evolutionary algorithm, and variable neighborhood search to achieve the optimal visited sequence of the sensor nodes. Finally, extensive numerical results are provided to evaluate the performance of the proposed algorithm. It draws new insights on the estimation of the feasibility of the given UAVs whose energy capacity is limited. [ABSTRACT FROM AUTHOR]

An exoatmospheric midcourse guidance law is proposed to intercept a ballistic missile during the free-flight phase. The proposed guidance law generates a thrust direction command for an antiballistic missile to hit the target at the predicted intercept point. For the predicted intercept point, the zero-effort-miss and zero-effort-velocity are determined based on the solutions of the two-body orbital boundary/initial value problems. The intercept point is predicted by using the trajectory shaping parameter that combines the zero effort trajectory and minimum time trajectory. A response surface model for the minimum interception time is constructed as a database, which is the polynomial function of the initial condition. The response surface model provides a predicted minimum time interception position for the midcourse guidance. Case studies are performed to demonstrate the performance of the proposed guidance law considering various uncertainties. [ABSTRACT FROM AUTHOR]

With the exponential growth of data traffic, caching is regarded as a promising solution to combine with unmanned aerial vehicle (UAV)-assisted networks, which can offload cellular traffic and improve the system performance. Moreover, the cache capacity at user side can be leveraged, e.g., through local data storage or device-to-device (D2D) sharing. In this paper, we focus on the performance analysis and trajectory optimization of cache-enabled UAV-assisted networks with underlaid D2D communications. We consider both static and dynamic UAV deployments. For static UAV deployment, we first formulate an optimization problem to design the cache placement in order to maximize the cache hit probability. Then, the successful transfer probability (STP) and sum-rate are analyzed by using stochastic geometry, and their closed-form expressions are derived. For dynamic UAV deployment, the UAV moves over the cell and stops at several path points to serve users. To shorten the time required for the UAV to cover all users, a spiral algorithm is proposed to optimize the UAV trajectory, aiming at minimizing the number of UAV path points. Moreover, since at different locations, the UAV communication will incur different interference on D2D users, we derive the outage probability for the D2D users. Simulation results show the significant performance gain of our proposed probabilistic cache placement over existing strategies. For a given user density, we show that the optimal values for the UAV height which lead to the maximum UAV-STP and sum-rate exist. [ABSTRACT FROM AUTHOR]

The need for accurate positioning and tracking of mobile sensor nodes arises in many applications. To compute position estimates from raw measurements in positioning systems, Bayesian filtering techniques such as Kalman, histogram, or particle filters are frequently employed. A major disadvantage of these techniques is the fact that they compute only a single position estimate in every timestep and, therefore, do not utilize the available information to the full extent. The work presented in this article improves over this current state of the art by instead estimating full node trajectories and, therefore, the most plausible sequence of positions in every timestep. We present two distinct algorithms—for a discrete and for a continuous state-space—and highlight the particular advantages of each variant. Achievable results are shown by simulation and measurement to be more accurate than the traditional Bayesian filtering approach. The most prominent advantage of much more accurate total track length estimation is particularly emphasized. [ABSTRACT FROM AUTHOR]

This paper considers a rotary-wing unmanned aerial vehicle (UAV)-enabled wireless power transfer system, where a UAV is dispatched as an energy transmitter (ET), transferring radio frequency (RF) signals to a set of energy receivers (ERs) periodically. We aim to maximize the energy harvested at all ERs by jointly optimizing the UAV's three-dimensional (3D) placement, beam pattern and charging time. However, the considered optimization problem taking into account the drone flight altitude and the wireless coverage performance is formulated as a non-convex problem. To tackle this problem, we propose a low-complexity iterative algorithm to decompose the original problem into four sub-problems in order to optimize the variables sequentially. In particular, we first use the sequential unconstrained convex minimization based algorithm to find the globally optimal UAV two-dimensional (2D) position. Subsequently, we can directly obtain the optimal UAV altitude as the objective function of problem is monotonic decreasing with respect to UAV altitude. Then, we propose the multiobjective evolutionary algorithm based on decomposition (MOEA/D) based algorithm to control the phase of antenna array elements, in order to achieve high steering performance of multi-beams. Finally, with the above solved variables, the original problem is reformulated as a single-variable optimization problem where charging time is the optimization variable, and can be solved using the standard convex optimization techniques. Furthermore, we use the branch and bound method to design the UAV trajectory which can be constructed as traveling salesman problem (TSP) to minimize flight distance. Numerical results validate the theoretical findings and demonstrate that significant performance gain in terms of sum received power of ERs can be achieved by the proposed algorithm in UAV-enabled wireless power transfer networks. [ABSTRACT FROM AUTHOR]

In this paper, we investigate the unmanned aerial vehicle (UAV)-aided simultaneous uplink and downlink transmission networks, where one UAV acting as a disseminator is connected to multiple access points (AP), and the other UAV acting as a base station (BS) collects data from numerous sensor nodes (SNs). The goal of this paper is to maximize the system throughput by jointly optimizing the 3D UAV trajectory, communication scheduling, and UAV-AP/SN transmit power. We first consider a special case where the UAV-BS and UAV-AP trajectories are pre-determined. Although the resulting problem is an integer and non-convex optimization problem, a globally optimal solution is obtained by applying the polyblock outer approximation (POA) method based on the problem’s hidden monotonic structure. Subsequently, for the general case considering the 3D UAV trajectory optimization, an efficient iterative algorithm is proposed to alternately optimize the divided sub-problems based on the successive convex approximation (SCA) technique. Numerical results demonstrate that the proposed design is able to achieve significant system throughput gain over the benchmarks. In addition, the SCA-based method can achieve nearly the same performance as the POA-based method with much lower computational complexity. [ABSTRACT FROM AUTHOR]

Collision imminent steering is an automotive active safety feature designed to perform an aggressive lane change to avoid a forward collision in the event that the system determines there is insufficient distance to avoid a collision by braking alone.In this paper, a collision imminent steering system is developed using nonlinear model predictive control to perform a lane change at high speed in a highway environment. Two formulations are presented: one formulation to show the theoretical minimum lane change distance within which a safe lane change can be performed, and a second formulation to find the minimum aggressive maneuver for a given lane change distance. The nonlinear model predictive control formulation is posed as a constrained optimization problem, where solutions obey hard safety constraints of the highway environment. Constraint aggregation techniques are analyzed and introduced to monitor the peak tire slip throughout the maneuver. Numerical simulations of a typical luxury sedan in a highway setting show that minimum distance required to change lanes is about half the limit braking distance. Hence, there is a window of feasibility where the vehicle cannot avoid collision by braking alone, but can change lanes safely and maintain a safe trajectory throughout the maneuver. Additional simulations show that an active four wheel steering architecture improves performance over front only steering. [ABSTRACT FROM AUTHOR]

In the past several years, unmanned aerial vehicle (UAV) have been employed to provide enhanced coverage or relay service to mobile users in a scenario with limited or even no infrastructure since they can be deployed to almost everywhere and can be manipulated at anytime. This paper studies UAV as aerial base station (BS) enabled wireless communication system, where a UAV is dispatched to provide wireless communication service to a set of ground users with difference quality-of-experience (QoE) requirements. In real world, user requirements are randomly and unevenly distributed. In addition, UAV communication coverage and on-board energy are limited and system resources are also limited (e.g., transmission power, spectrum). In order to meet the QoE of all users with limited system resources and limited UAV energy, we jointly optimize user communication scheduling, UAV trajectory, transmit power and bandwidth allocation to maximize energy-efficiency and satisfy user QoE requirement. The formulated problem is mixes integer non-convex and non-concave so it is difficult to solve. In this paper, we solvevv the problem with two steps as follows. Firstly, we transform the objective function into a tractable form. Secondly, we divide the optimal problem into four sub-optimal problems, and then use a powerful iterative algorithm with the Dinkelbach and block coordinate descent to solve the optimal problem. That is to say, the user scheduling, UAV trajectory, transmission power and bandwidth allocation are alternately optimized in each iteration. Extensive simulation results present that our proposed method can obtain higher energy efficiency than that of baselines. Specifically, the energy efficiency obtained by our proposed method is 12.5% higher than the approach that only maximizes throughput. [ABSTRACT FROM AUTHOR]

The wheeled inverted pendulum (WIP) is an underactuated, nonholonomic mechatronic system, and has been popularized commercially as the Segway. Designing a control law for motion planning, that incorporates the state and control constraints, while respecting the configuration manifold, is a challenging problem. In this article, we derive a discrete-time model of the WIP system using discrete mechanics and generate optimal trajectories for the WIP system by solving a discrete-time constrained optimal control problem. Furthermore, we describe a nonlinear continuous-time model with parameters for designing a closed-loop linear–quadratic regulator (LQR). A dual control architecture is implemented in which the designed optimal trajectory is, then, provided as a reference to the robot with the optimal control trajectory as a feedforward control action, and an LQR in the feedback mode is employed to mitigate noise and disturbances for ensuing stable motion of the WIP system. While performing experiments on the WIP system involving aggressive maneuvers with fairly sharp turns, we found a high degree of congruence in the designed optimal trajectories and the path traced by the robot while tracking these trajectories. This corroborates the validity of the nonlinear model and the control scheme. Finally, these experiments demonstrate the highly nonlinear nature of the WIP system and robustness of the control scheme. [ABSTRACT FROM AUTHOR]

This paper studies an unmanned aerial vehicle (UAV)-enabled two-user interference channel for wireless powered communication networks (WPCNs). In this system, two UAVs wirelessly charge two low-power Internet-of-things (IoT)-devices on the ground and collect information from them. We consider two scenarios when both UAVs cooperate in energy transmission and/or information reception via interference coordination and coordinated multi-point (CoMP), respectively. For both scenarios, the UAVs’ trajectories are designed to not only enhance the wireless power transfer (WPT) efficiency in the downlink, but also mitigate the co-channel interference for wireless information transfer (WIT) in the uplink. In particular, the objective is to maximize the uplink common (minimum) throughput of the two IoT-devices over a finite UAV mission period, by jointly optimizing the trajectories of both UAVs and the downlink/uplink wireless resource allocation, subject to the maximum flying speed and collision avoidance constraints for UAVs, as well as the individual energy neutrality constraints at IoT-devices. Under both scenarios with interference coordination and CoMP, we first obtain the optimal solutions to the two common-rate maximization problems for the special case with sufficiently long UAV mission duration. Next, we obtain high-quality solutions for the practical case with finite UAV mission duration by using the alternating optimization and successive convex approximation (SCA). Numerical results show that the proposed designs significantly outperform benchmark schemes, and the utilization of CoMP achieves much higher uplink throughput than interference coordination. [ABSTRACT FROM AUTHOR]