Search

Unmanned ground vehicles (UGVs) are increasingly being used for civilian and military applications. Passive sensing, such as visible cameras, are being used for navigation and object detection. An additional object of interest in many environments is text. Text information can supplement the autonomy of unmanned ground vehicles. Text most often appears in the environment in the form of road signs and storefront signs. Road hazard information, unmapped route detours and traffic information are available to human drivers through road signs. Premade road maps lack these traffic details, but with text localization the vehicle could fill the information gaps. Leading text localization algorithms achieve ~60% accuracy; however, practical applications are cited to require at least 80% accuracy [49]. The goal of this thesis is to test existing text localization algorithms against challenging scenes, identify the best candidate and optimize it for scenes a UGV would encounter. Promising text localization methods were tested against a custom dataset created to best represent scenes a UGV would encounter. The dataset includes road signs and storefront signs against complex background. The methods tested were adaptive thresholding, the stroke filter and the stroke width transform. A temporal tracking proof of concept was also tested. It tracked text through a series of frames in order to reduce false positives. Best results were obtained using the stroke width transform with temporal tracking which achieved an accuracy of 79%. That level of performance approaches requirements for use in practical applications. Without temporal tracking the stroke width transform yielded an accuracy of 46%. The runtime was 8.9 seconds per image, which is 44.5 times slower than necessary for real-time object tracking. Converting the MATLAB code to C++ and running the text localization on a GPU could provide the necessary speedup. Master of Science

The problem of roadway navigation and obstacle avoidance for unmanned ground vehicles has typically needed very expensive sensing to operate properly. To reduce the cost of sensing, it is proposed that an algorithm be developed that uses a single visual camera to image the roadway, determine where the lane of travel is in the image, and segment that lane. The algorithm would need to be as accurate as current lane finding algorithms as well as faster than a standard k- means segmentation across the entire image. This algorithm, named IRIS, was developed and tested on several sets of roadway images. The algorithm was tested for its accuracy and speed, and was found to be better than 86% accurate across all data sets for an optimal choice of algorithm parameters. IRIS was also found to be faster than a k-means segmentation across the entire image. IRIS was found to be adequate for fulfilling the design goals for the algorithm. IRIS is a feasible system for lane identification and segmentation, but it is not currently a viable system. More work to increase the speed of the algorithm and the accuracy of lane detection and to extend the inherent lane model to more complex road types is needed. IRIS represents a significant step forward in the single camera roadway perception field. Master of Science

Current trends in agricultural equipment have led to an increasing degree of autonomy. As the state of the art progresses towards fully autonomous vehicles, it is important to consider assumptions implicit in the design of these vehicles. Current automation in harvesters have led to increased sensing and automation on current combines, but no published research examines the effect of machine size on the viability of the autonomous system. The question this thesis examines is: if a human is no longer required to operate an individual harvester, is it possible to build smaller equipment that is still economically viable? This thesis examines the appropriateness of automating these machines by developing a conceptual model for smaller, fully autonomous harvesters. This model includes the basic mechanical subsystems, a conceptual software design, and an economic model of the total cost of ownership. The result of this conceptual design and analysis is a greater understanding of the role of autonomy in harvest. By comparing machine size, machine function, and the costs to own and operate this equipment, design guidelines for future autonomous systems are better understood. It is possible to build an autonomous harvesting system that can compete with current technologies in both harvest speed and overall cost of ownership. Master of Science

Unmanned ground vehicles are increasingly employing a combination of active sensors such as LIDAR with passive sensors like cameras to perform at all levels of perception, which includes detection, recognition and classification. Typical cameras measure the intensity of light at a variety of different wavelengths to classify objects in different areas of an image. A polarimetric camera not only measures intensity of light, but can also determine its state of polarization. The polarization of light is the angle the electric field of the wave of light takes as it travels. A polarimetric camera can identify the state of polarization of the light, which can be used to segment highly polarizing areas in a natural environment, such the surface of water. The polarimetric camera designed and built for this thesis was created with low cost in mind, as commercial polarimetric cameras are very expensive. It uses multiple beam splitters to split incoming light into four machine vision cameras. In front of each machine vision camera is a linear polarizing filter that is set to a specific orientation. Using the data from each camera, the Stokes vector can be calculated on a pixel by pixel basis to determine what areas of the image are more polarized. Test images of various scenes that included running water, standing water, mud, and vehicles showed promise in using polarization data to highlight and identify areas of interest. This data could be used by a UGV to make more informed decisions in an autonomous navigation mode. Master of Science

Perception is a key feature in how any creature or autonomous system relates to its environment. While there are many types of perception, this thesis focuses on the improvement of the visual robotics perception systems. By implementing a broadband passive sensing system in conjunction with current perception algorithms, this thesis explores scene reconstruction and world modeling. The process involves two main steps. The first is stereo correspondence using block matching algorithms with filtering to improve the quality of this matching process. The disparity maps are then transformed into 3D point clouds. These point clouds are filtered again before the registration process is done. The registration uses a SAC-IA matching technique to align the point clouds with minimum error. The registered final cloud is then filtered again to smooth and down sample the large amount of data. This process was implemented through software architecture that utilizes Qt, OpenCV, and Point Cloud Library. It was tested using a variety of experiments on each of the components of the process. It shows promise for being able to replace or augment existing UGV perception systems in the future. Master of Science