459 results
Search Results
2. State-of-the-Art in Perception Technologies for Collaborative Robots
- Author
-
Xiaoxuan Ding, Pan Deng, Janli Guo, and Zijie Ren
- Subjects
Robotic sensing ,business.industry ,Computer science ,media_common.quotation_subject ,Information processing ,Robotics ,Information fusion ,Human–computer interaction ,Perception ,Robot ,Artificial intelligence ,State (computer science) ,Electrical and Electronic Engineering ,business ,Instrumentation ,Relevant information ,media_common - Abstract
The developments in sensor technology, information processing, computer science, and artificial intelligence significantly improved robots’ autonomy. Robots’ external perception relies on sensing technology. Thus, capturing accurate sensor information is vital for ensuring robotic security and improving human-machine interaction performance. This paper classifies the main robotic sensors, describes multi-sensor information fusion and processing and contrasts the state-of-the-art sensor technologies for collaborative robots with other state-of-the-art technologies in related fields. In addition, this paper also introduces collaborative robots’ perception applications of the state-of-the-art representative products, the new designs for collaborative robots, the interactive applications of the intelligent Kinect sensor with collaborative robots, and the important applications of collaborative robots in the medical fields. Through a deep analysis of relevant information, this paper aims to introduce the integration of the state-of-the-art sensor technologies and collaborative robots, with hoping of guiding significance for the applications of robot sensors. This paper finally emphasizes the sensors’ impact on robot performance and discusses future research on sensor technologies in robotics.
- Published
- 2022
3. IoT-Based Humanoid Software for Identification and Diagnosis of Covid-19 Suspects
- Author
-
Sofia Pillai, Swapnili Karmore, Rushikesh Bodhe, Fadi Al-Turjman, and R. Lakshmana Kumar
- Subjects
Focus (computing) ,Computer science ,business.industry ,010401 analytical chemistry ,Control (management) ,Context (language use) ,01 natural sciences ,0104 chemical sciences ,Identification (information) ,Software ,Human–computer interaction ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
COVID-19 pandemic has a catastrophic consequence globally since its first case was detected in December 2019, with an aggressive spread. Currently an exponential growth is expected. If not diagnosed at the proper time, COVID-19 may lead to death of the infected individuals. Thus, continuous screening, early diagnosis and prompt actions are crucial to control the spread and reduce the mortality. In this paper we focus on developing a Medical Diagnosis Humanoid (MDH) which is a cost effective, safety critical mobile robotic system that provides a complete diagnostic test to check whether an individual is infected by Covid-19 or not. This paper highlights the development of a system based on Artificial Intelligence for Medical Science, where humanoids can navigate through desired destinations, diagnose an individual for Covid-19 through various parameters and make a survey of a locality for the same. The humanoid uses the concept of real time data sensing and processing through machine learning produced by various sensors used in the context.
- Published
- 2022
4. Multilayer Low-Cost Sensor Local-Global Filtering Fusion Integrated Navigation of Small UAV
- Author
-
Weiguo Zhang, Xiaoxiong Liu, Xuhang Liu, Yue Yang, and Yicong Guo
- Subjects
Computer science ,business.industry ,Attitude and heading reference system ,State vector ,Flight test ,Fusion frame ,Computer Science::Robotics ,Nonlinear system ,Control theory ,Robustness (computer science) ,Global Positioning System ,Electrical and Electronic Engineering ,business ,Instrumentation ,Inertial navigation system - Abstract
Aimed at improving the nonlinear integrated navigation solution performance of multiple low-cost sensors fusion, this paper presents a multilayer loosely-coupled, local-global, and step-optimized MF5DCKF (Multisensor Federated fifth-degree Cubature Kalman filter) state estimation algorithm for the small unmanned aerial vehicle (UAV). This method establishes a multilayer nonlinear integrated navigation model composed of the nonlinear attitude and heading reference system (AHRS) error model, strapdown inertial navigation system/global positioning system (SINS/GPS) error model, and strapdown inertial navigation system/barometer (SINS/BARO) error model to enhance the robustness and richness of the navigation module. Further, based on the above navigation models, a loosely-coupled error state fusion frame is designed to obtain the local convergent state vector. Simultaneously, a three-layer fifth-degree Cubature Kalman filter is proposed to improve the local state estimation accuracy. Subsequently, to optimize the estimated local state, this paper presents a novel distributed MF5DCKF scheme fusing the local state vector to calculate the global optimal state parameters in a step-optimized process. The experimental flight test results show that the proposed algorithm achieves a higher state solution accuracy and a better convergent performance compared with some conventional multisensor fusion algorithms. The new algorithm framework can provide applicability and reliability for the small UAV during the flight.
- Published
- 2022
5. An Intelligence Image Processing Method of Visual Servo System in Complex Environment
- Author
-
Di Li, Shipeng Li, Juan Wang, and Chunhua Zhang
- Subjects
business.industry ,Computer science ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Image processing ,Filter (signal processing) ,Visual servoing ,Convolutional neural network ,Region of interest ,Robot ,Segmentation ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
In robot visual servoing system, effective detected the region of interest area (ROI) in target images is the first problem should be solved, but the detection is susceptible to an unstructured environment. In this paper, an instance segmentation network algorithm based on Mask Region Convolutional Neural Networks (Mask R-CNN) framework is proposed for ROI image preprocessing. As instance segmentation technology can distinguish complex environmental information, so first with this advantage filter out message such as shape or similar area to target image, then with semantic segmentation technology add special category labels to the filtered images and distinguish different individual instances in similar categories. Finally through the series steps aforementioned, robot vision system can overcome the impact of environmental factors and identify the target image. The proposed method is used to detect target image under five constraints such as occlusion and reflection, result shows the algorithm can effectively deal with challenges that brought by complex constraints, and even can predict the location data of missing information based on some image information. In addition, based on the algorithm proposed in this paper, we used one seven axis robot visual servo platform, executed visual servoing experiment under different unstructured environments, further verifies the effectiveness of our proposed method.
- Published
- 2022
6. Cost-Effective, Disposable, Flexible, and Printable MWCNT-Based Wearable Sensor for Human Body Temperature Monitoring
- Author
-
G.K. Rajini, Thiyagarajan. K, and Debashis Maji
- Subjects
Computer science ,business.industry ,Wearable computer ,Response time ,Robotics ,Thermocouple ,Electronic engineering ,Artificial intelligence ,Sensitivity (control systems) ,Electrical and Electronic Engineering ,business ,Instrumentation ,Human body temperature ,Tactile sensor ,Wearable technology - Abstract
Personalized mobile healthcare integrated with various wearable devices has become a significant area of interest in the present era. In the current research work, a flexible, wearable and disposable paper-based continuous skin temperature monitoring sensor for early medical prognosis and accurate diagnosis of body temperature-related ailments, such as COVID-19, is proposed. Conventional screen-printing and drop-casting techniques were used to fabricate the proposed sensor using MWCNTs as the sensing material and paper as the substrate. The linearity, stability, repeatability and durability of the sensors were tested from 29°C (room temperature) to 60°C. A thin sheet of PET was laminated over the sensor surface to ascertain its stability toward environmental effects and physical movements, and a response time of ~13 s and a recovery time of ~38 s with a sensitivity of -0.0685% °C-1 were recorded. The efficacy of the proposed sensor was ascertained by placing it at different body locations on a human subject and comparing it with a standard thermocouple and IR sensor. The sensor even helped to effectively distinguish minimal temperature variations between various regions of the body. Furthermore, the feasibility of the fabricated temperature sensor as a temperature-based tactile sensor for robotics/artificial skin applications and as a noncontact breath monitoring device for use in personalized healthcare monitoring applications was investigated.
- Published
- 2022
7. A Heading Estimation Algorithm for Wrist Device Assisted by Sequential Geomagnetic Observations
- Author
-
Ao Peng, Weicheng Zhang, Ye Tian, and Xueting Xu
- Subjects
Heading (navigation) ,Computer science ,business.industry ,Work (physics) ,Kalman filter ,Swing ,Accelerometer ,Tracking (particle physics) ,Noise ,Earth's magnetic field ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Pedestrian positioning with wearable devices is a significant application of attitude tracking. It tracks the attitude (with heading angle being the most important part) of the device in real time and provides positioning services for users based on the information of step length provided by Pedestrian Dead-Reckon (PDR), which is a cheap and efficient positioning method at present. However, amid a train of positioning methods, the joint estimate of tracking is given by a train of methods based on the direction of gravity and the earths magnetic field direction. Considering the measurement of gravity that the gravity accelerometer is exposed to heavy noise due to the complex movement of human body during walking with uniform swing arm posture and forward speed, this paper proposed a novel estimate method based on the Kalman filter with multi-state constraints and the usage of low-cost sensors, which fulfills the estimation with the sequential observation of magnetic field. Compared with other related work, this method proposed in this paper eliminates the dependence on gravity direction, avoiding the influence of heavy noise caused by additional linear acceleration in motion state, and reduces the influence of insufficient observation when using magnetic field observation alone. The performance of the proposed method is evaluated by real-world experimentation results.
- Published
- 2022
8. Robust Mono Visual-Inertial Odometry Using Sparse Optical Flow With Edge Detection
- Author
-
Yuchao Kan, Yu Jin, Chen Zewang, Chang Gao, and Qingxi Zeng
- Subjects
Computer science ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Optical flow ,Edge detection ,Odometry ,Feature (computer vision) ,Inertial measurement unit ,Robustness (computer science) ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,Visual odometry ,business ,Instrumentation ,Pose - Abstract
In this paper, we present a fast and robust visual-inertial odometry (VIO) algorithm, which realizes the tight coupling of monocular visual odometry (VO) and low-cost inertial measurement unit (IMU). Aiming at the problem of tracking loss caused by the interference of moving objects or blurred images in the traditional VIO algorithm, a sparse optical flow method combining edge detection algorithms is proposed. In the image preprocessing, Laplace edge detection is performed on the original image first, and an area with the most texture is searched according to the sharpened image. When tracking feature points with the sparse optical flow method, the feature points within the searched area are used as the main tracking targets to reduce the impact because of some unclear part in the image on the visual front-end. The trust region dogleg method is used for non-linear optimization in the back-end of the VIO system. The effectiveness of the proposed VIO system is validated on the public data set named EuRoC MAV and compared with the advanced VIO algorithm in recent years. Experimental results show that the new VIO system proposed in this paper has good robustness and can be applied to complex scenes such as fast motion, lighting changes, lack of features, and image blur. Compared with the traditional VIO algorithm, the pose estimation speed of the proposed VIO algorithm can be improved by 10% or more.
- Published
- 2022
9. Real-Time Hand Gesture Tracking for Human–Computer Interface Based on Multi-Sensor Data Fusion
- Author
-
Tingting Zhang, Zhelong Wang, Sen Qiu, Hongyu Zhao, Xiaofeng Liu, Angelo Cangelosi, Xu Zhou, Jie Li, Rong Rong Ni, and Huili Cai
- Subjects
Kinematic chain ,Computer science ,business.industry ,Wired glove ,Kinematics ,Sensor fusion ,Extended Kalman filter ,Joint constraints ,Inertial measurement unit ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,Gesture - Abstract
Cerebral palsy is one of the main factors leading to children’s disability. A large number of such children have hand motor dysfunction, such as limited range of motion, abnormal gestures, etc. Our goal is to design a prototype of wearable gesture training equipment for such children. For this purpose, this paper presents the development of a wireless smart glove to facilitate the accurate measurement of finger movement through the integration of multiple IMU sensors. Commercially available gaming gloves are not fitted with sufficient sensors for this particular application and most of them can only provide one degree of freedom for finger flexion and extension. In this paper, a data glove integrated with nine degree of freedom inertial sensors in conjunction with complex multi-sensor data fusion is developed. In our method, a single/dual state measurement update switching extended Kalman filter is proposed to estimate the spatial attitude of each finger segment. Through traversing the kinematic chain, a tree type hand dynamic model based on joint constraints is established to realize the real-time gesture tracking. Furthermore, a visual interface is developed to display the tracking effect of gestures, and the reliability of our algorithm is verified by optical contrast experiments, the repeatability of joint angle is also evaluated by kinematic analysis. In general, all the experimental results demonstrated that our proposed framework can accurately track the 3-D hand motion. This glove will help quantify joint stiffness and monitor patient progression during the rehabilitation training process.
- Published
- 2021
10. Smart Agriculture Wireless Sensor Routing Protocol and Node Location Algorithm Based on Internet of Things Technology
- Author
-
Dingzhu Xue and Wei Huang
- Subjects
Routing protocol ,education.field_of_study ,business.industry ,Computer science ,ComputerSystemsOrganization_COMPUTER-COMMUNICATIONNETWORKS ,Population ,Hop (networking) ,Statistical classification ,Agriculture ,Wireless ,Electrical and Electronic Engineering ,Internet of Things ,business ,education ,Instrumentation ,Wireless sensor network ,Algorithm - Abstract
With the increase of the world’s population, people’s demand for food is also increasing. However, due to various reasons, traditional agriculture cannot make full use of the land. Therefore, to ensure the food supply of the global population and promote the development of agriculture, the implementation of smart agriculture has become essential. The purpose of this research work is to study the smart agricultural wireless sensor routing protocols and node positioning algorithms based on the Internet of Things (IoT) technology. The present study first analyzes the classification of wireless sensor routing protocols. Based on the analysis and research of the Low Energy Adaptive Clustering Hierarchy protocol, the influence of factors such as node energy and distance are considered, and the network’s Low Energy Adaptive Clustering Hierarchy routing protocol is improved and extended its life. It introduced the classification of positioning algorithm, and then analyzed the DV-HOP positioning algorithm. Aiming at the problem of low positioning accuracy and large error of DV-HOP algorithm, an improved method of DV-HOP algorithm based on average HOP distance was proposed to make positioning more precise. Experimental results prove that the improved algorithm proposed in this paper has better performance. By testing the algorithm proposed in this paper, the improved DV-HOP algorithm reduces the positioning error by 30% compared with the original DV-HOP algorithm.
- Published
- 2021
11. Optimization of Sports Training Systems Based on Wireless Sensor Networks Algorithms
- Author
-
Wu Lv and Jun Yang
- Subjects
business.industry ,Computer science ,Node (networking) ,Real-time computing ,Training system ,Wearable computer ,Cloud computing ,law.invention ,Bluetooth ,Software deployment ,law ,Software system ,Electrical and Electronic Engineering ,business ,Instrumentation ,Wireless sensor network - Abstract
This paper aims to design and optimize a sports training system through wireless sensor network technology, which mainly includes a hardware system and software system. In the hardware system, the design of sensor nodes and the base station is realized, which can realize the real-time collection of movement parameters by the movement collectors. In the software system, the design of base station control, node control, and motion database software is realized, which can effectively collect, store, and analyze the motion parameters. Finally, the wireless sensor network-based sports training system is tested, and the test results show that the system designed in this paper can meet the needs of sports training use. The inertial measurement unit in the wearable device is used to collect the data generated by the human body during exercise, and low-power Bluetooth is used as the data transmission protocol between the wearable device and the smartphone. The server side provides computing resources in the form of cloud computing to achieve client-server interaction. In combination with the idea of service containerization, a deployment scheme for cloud services was proposed using container choreography, and compared to the pre-training period, the subjects’ trunk sway in the front and back directions decreased by 60.5% and 54.0%, and the trunk sway in the left and right directions decreased by 67.1% and 50.3% during and after training, respectively, and the ratio of time occupied by the equilibrium state increased by 63.5% and 47.4%, subjects’ balance was effectively improved.
- Published
- 2021
12. Energy and Collision Aware WSN Routing Protocol for Sustainable and Intelligent IoT Applications
- Author
-
Nileshkumar R. Patel, Sanjay Singh, and Shishir Kumar
- Subjects
Routing protocol ,Computer science ,business.industry ,Node (networking) ,ComputerSystemsOrganization_COMPUTER-COMMUNICATIONNETWORKS ,Physical layer ,Network layer ,Metrics ,Network simulation ,Ad hoc On-Demand Distance Vector Routing ,Electrical and Electronic Engineering ,business ,Instrumentation ,Wireless sensor network ,Computer network - Abstract
Wireless Sensor Network (WSN) has wide range of applications including next generation intelligent IoT applications. Sensor nodes in WSNs don’t allow replacing batteries as phenomenon under consideration is not frequently accessible or inaccessible. Resource constrained WSN nodes run on batteries with limited capacity. For long running of the WSNs, energy consumption on each node and lifetime of overall network is a concern for IoT applications. To prolong lifetime of WSNs, use of energy efficient method is necessary and a challenging task. Most of the on-demand routing protocols use metrics like number of hops for the selection of path from the source node to the destination node. Purely hop count-based metrics leads to frequent broken paths as well as more energy consumption and results into reduced lifetime of IoT applications. Method proposed in this paper is a cross layer variant of AODV by replacing hop count metric with link quality and collision count. To establish a path, proposed method fetches link quality information from Physical layer and collision information from MAC layer to aid Network layer for making intelligent routing decisions using ZScore method. Using this information, proposed routing metric caters to select stable and sustainable routing path. Method proposed in this paper is implemented in well-known network simulator, NS-2 by incorporating necessary changes into existing physical and MAC layers as well as AODV protocol. A comparative analysis with existing methods is an indicator of improved performance in terms of energy efficiency, network lifetime, path stability and delay.
- Published
- 2021
13. Routing Optimization of Sensor Nodes in the Internet of Things Based on Genetic Algorithm
- Author
-
Zeli Xue
- Subjects
Optimization problem ,Computer science ,business.industry ,Crossover ,Energy consumption ,Genetic algorithm ,Node (computer science) ,Redundancy (engineering) ,Electrical and Electronic Engineering ,Routing (electronic design automation) ,business ,Instrumentation ,Wireless sensor network ,Computer network - Abstract
As an important part of the perception layer of the Internet of things, wireless sensor networks will provide sensing data for the application of the Internet of things, so it is necessary to optimize the routing path of wireless sensor nodes for the application of the Internet of things. Aiming at the problem of optimal selection of wireless sensor nodes for the Internet of things, this paper describes the mathematical model and abstracts it as a multi-objective optimization problem. Secondly, through the analysis of the deployment optimization process, this paper abstracts the optimization selection method of wireless sensor nodes facing the Internet of things and the guarantee method to avoid coverage holes. Then a node selection method based on a genetic algorithm is proposed to solve the problems of high redundancy and high energy consumption in the internet of things. In the application process of genetic algorithm, aiming at the possible problems of standard genetic algorithm, the similarity judgment is introduced into the crossover operation, and the operation of introducing new individuals is added into the genetic process. Finally, simulation experiments are carried out to verify the feasibility, efficiency, and parameter setting of the algorithm. The simulation results show that the proposed method can guarantee the coverage of the area to be monitored, reduce the network energy consumption and keep the energy consumption balanced.
- Published
- 2021
14. Applications, Deployments, and Integration of Internet of Drones (IoD): A Review
- Author
-
Ali Diabat, Amir H. Gandomi, Laith Abualigah, and Putra Sumari
- Subjects
0205 Optical Physics, 0906 Electrical and Electronic Engineering, 0913 Mechanical Engineering ,Authentication ,business.industry ,Computer science ,Privacy protection ,Mobile computing ,Cloud computing ,Drone ,Analytical Chemistry ,The Internet ,Electrical and Electronic Engineering ,business ,Telecommunications ,Instrumentation ,Wireless sensor network ,Security authentication - Abstract
The Internet of Drones (IoD) has become a hot research topic in academia, industry, and management in current years due to its wide potential applications, such as aerial photography, civilian, and military. This paper presents a comprehensive survey of IoD and its applications, deployments, and integration. We focused in this review on two main sides; IoD Applications include smart cities surveillance, cloud and fog frameworks, unmanned aerial vehicles, wireless sensor networks, networks, mobile computing, and business paradigms; integration of IoD includes privacy protection, security authentication, neural network, blockchain, and optimization based-method. A discussion highlights the hot research topics and problems to help researchers interested in this area in their future works. The keywords that have been used in this paper are Internet of Drones.
- Published
- 2021
15. RDNet: Regression Dense and Attention for Object Detection in Traffic Symbols
- Author
-
Weiwei Jiang, Tao Wang, Wei Ju, Feng Hong, and Changhua Lu
- Subjects
Computer science ,business.industry ,Feature extraction ,Geometric transformation ,Pattern recognition ,Object detection ,Field (computer science) ,Identifier ,Identification (information) ,Feature (computer vision) ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,Spatial analysis - Abstract
Identification and detection of traffic identifiers are some of the most challenging tasks in the field of autonomous driving. For object detection, how to obtain deep semantic information and shallow spatial information has always been a permanent subject. This paper proposes a dense network structure for the detection of traffic identifiers; the deep structure of the residual network is used to obtain the high-level semantic information of the detection target; the regression operation is used to obtain the underlying spatial information; the detection structure is higher than the previous The accuracy of the network structure and the generalization ability of the network has been improved; ASPP using the attention mechanism; the main function of ASPP is to obtain a continuous feature map; using the ASPP of the attention mechanism, the prior balance between the receptive field and the feature resolution map is solved; In the paper, a collection of residual networks is used to obtain a variety of acceptance domains; through a regression operation, an effective interactive connection between the receptive field and the acceptance domain is obtained; a deep network using regression residuals allows geometric transformation of the model during data training The ability to improve has been improved; at the same time, the use of a dense network structure has realized the diversity of different receptive fields in the process of multi-scale feature extraction.
- Published
- 2021
16. Design and Detection Calculation Model of Laser Photoelectric Detection Target With Array Lens and High-Power Line Laser
- Author
-
Xiaoqian Zhang, Hanshan Li, Xuewei Zhang, and Junchai Gao
- Subjects
Physics ,business.industry ,Projectile ,Physics::Optics ,Photodetector ,Field of view ,Laser ,law.invention ,Lens (optics) ,Optics ,Optical path ,law ,Reflection (physics) ,Physics::Atomic Physics ,Electrical and Electronic Engineering ,business ,Instrumentation ,Sensitivity (electronics) - Abstract
Under the condition of low illumination, the traditional sky screen has low detection ability, which cannot meet the detection and test needs of dynamic projectile’s parameter in weapon field. In order to solve this problem, this paper proposes a design method of laser photoelectric detection target with array lens and high-power line laser, this method mainly uses the high-power line laser to form a fan-shaped laser light source with a certain thickness, and combines the fan-shaped laser light source plane and the receiving detection screen plane to form a laser detection screen. The array meso-lens is introduced to design the laser detection screen of receiving optical path with wide-angle. A high sensitivity array photodetector is used to capture the laser reflection information of projectile when it passes through the laser detection screen. According to the characteristics of the designed laser detection screen, this paper studies the calculation method of laser reflected energy of projectile, establishes the calculation model of laser reflection power of projectile and derives the signal-to-noise ratio calculation function of laser photoelectric detection target. Through the experimental test, the results show that compared with the traditional sky screen, the field of view of the designed laser photoelectric detection target is significantly increased, and the signal-to-noise ratio of the photoelectric detection is significantly higher than the traditional sky screen in low illumination environment.
- Published
- 2021
17. A Feature Based Laser SLAM Using Rasterized Images of 3D Point Cloud
- Author
-
Zheng Gong, Waqas Ali, Peilin Liu, and Rendong Ying
- Subjects
Matching (graph theory) ,Computer science ,business.industry ,Feature extraction ,Detector ,Point cloud ,Simultaneous localization and mapping ,Lidar ,Feature (computer vision) ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,Orb (optics) - Abstract
An accurate and computationally efficient SLAM algorithm is vital for autonomous vehicles. Most modern SLAM systems use feature detection approaches to limit computational requirements. Feature detection through a 3D point cloud can be a computationally challenging task. In this paper, we propose a feature-based SLAM algorithm using 2D image projections of the 3D laser point cloud. We use a camera parameters matrix to rasterize the 3D point cloud to an image. Then ORB feature detector is applied to these images. The proposed method gives repeatable and stable features in a variety of environments. Based on such features, we can estimate the 6dof pose of the robot. For loop detection, we employ a 2-step approach, i.e., nearest key-frame detection and loop candidate verification by matching features extracted from rasterized LIDAR images. We evaluate the proposed system with implementation on the KITTI dataset. Through experimental results, we show that the algorithm presented in this paper can substantially reduce the computational cost of feature detection from the point cloud and the whole SLAM system while giving accurate results.
- Published
- 2021
18. Rolling Bearing Performance Degradation Prediction Based on FBG Signal
- Author
-
Yuhuan Li, Tao Jiang, Yong Chen, Wangyue An, and Huanlin Liu
- Subjects
Bearing (mechanical) ,Computer science ,business.industry ,Noise (signal processing) ,Feature vector ,Pattern recognition ,Signal ,Hilbert–Huang transform ,law.invention ,Wavelet ,Interference (communication) ,law ,Robustness (computer science) ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Aiming at the problems of low accuracy and low robustness in current prediction methods of rolling bearing performance degradation, this paper propose a performance degradation prediction method based on empirical mode decomposition (EMD) and support vector data description (SVDD). Unlike the features extracted by wavelet analysis, the EMD algorithm has better adaptive capability and can better avoid the interference of high frequency noise. fiber Bragg grating (FBG) are used to extract the bearing vibration signal. The use of FBG sensors can better avoid the interference of electromagnetic noise, so that the vibration signal can be accurately extracted in the industrial strong magnetic environment. The Empirical Mode Decomposition is used to decompose data and extract effective intrinsic mode function (IMF) components. Six features of Intrinsic Mode Function components are extracted to form feature vectors and used as training data. Because the IMF component obtained by EMD decomposition has removed most of the noise signals, the signal features are more significant and thus effectively improve the accuracy of subsequent recognition. This paper use Support Vector Data Description for performance degradation prediction and evaluates the degradation performance of the rolling bearing by calculating the degradation value. Experiments show the proposed method can detect the performance degradation process of the rolling bearing and effectively predict the remaining service life. Due to the high recognition accuracy, the proposed method is able to identify the current state of ball bearings and predict their remaining service life.
- Published
- 2021
19. Multisensor Image Fusion for Automated Detection of Defects in Printed Circuit Boards
- Author
-
Sha Liu, Yongqiang Zhao, Seong G. Kong, Mengke Li, Naifu Yao, and Shouqing Li
- Subjects
Automated optical inspection ,Brightness ,Image fusion ,business.industry ,Infrared ,Computer science ,Feature extraction ,Image segmentation ,Polarization (waves) ,Printed circuit board ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
This paper presents multisensor image fusion of polarization and infrared imaging to detect defects in printed circuit boards (PCBs). Many existing automated optical inspection techniques rely on visible imaging sensors. However, collected images suffer from uneven brightness levels due to the influence of lighting environment, which may significantly affect detection accuracies. Polarization information characterizes material types, surface roughness, and geometric shape of an object. Thermal infrared imaging reveals heat radiation difference between the defect region and the background. Polarization and infrared imaging are not sensitive to background illumination and contrast. In this paper, we utilize polarization information as well as infrared imaging to detect the defects in PCBs that conventional optical inspection techniques cannot easily detect. We design a multi-source image acquisition system to simultaneously acquire brightness intensity, polarization, and infrared intensity. Then a Multisensor Lightweight Detection Network (MLDN), trained on the PCB dataset collected, fuses polarization information and the brightness intensities in the visible and thermal infrared spectra to detect defects in challenging lighting conditions. Experiment results show that the proposed network outperforms the state-of-the-art automated optical inspection techniques in terms of mean average precision.
- Published
- 2021
20. Self-Powered Load Sensing Circuitry for Total Knee Replacement
- Author
-
Ryan Willing, Milutin Stanacevic, Emre Salman, Nabid Aunjum Hossain, Manav Jain, and Shahrzad Towfighian
- Subjects
business.industry ,Computer science ,Electrical engineering ,Biasing ,Signal ,Article ,Power (physics) ,Rectifier ,Knee pain ,medicine ,Electrical and Electronic Engineering ,medicine.symptom ,business ,Instrumentation ,Energy harvesting ,Triboelectric effect ,Voltage - Abstract
There has been a significant increase in the number of total knee replacement (TKR) surgeries over the past few years, particularly among active young and elderly people suffering from knee pain. Continuous and optimal monitoring of the load on the knee is highly desirable for designing more reliable knee implants. This paper focuses on designing a smart knee implant consisting of a triboelectric energy harvester and a frontend electronic system to process the harvested signal for monitoring the knee load. The harvester produces an AC signal with peak voltages ranging from 10 V to 150 V at different values of knee cyclic loads. This paper demonstrates the measurement results of a PCB prototype of the frontend electronic system fabricated to verify the functionality and feasibility of the proposed approach for a small range of cycling load. The frontend electronic system consists of a voltage processing unit to attenuate high peak voltages, a rectifier and a regulator to convert the input AC signal into a stabilized DC signal. The DC voltage signal provides biasing for the delta-sigma analog-to-digital converter (ADC). Thus, the output of the triboelectric harvester acts as both the power signal that is rectified/regulated and data signal that is digitized. The power consumption of the proposed PCB design is approximately $5.35~\mu \text{W}$ . Next, the frontend sensor circuitry is improved to accommodate a wider range of cyclic load. These results demonstrate that triboelectric energy harvesting is a promising technique for self-monitoring the load inside knee implants.
- Published
- 2021
21. A Novel Cap-LSTM Model for Remaining Useful Life Prediction
- Author
-
Yuxiong Li, Chengying Zhao, Shangjie Li, and Xianzhen Huang
- Subjects
Artificial neural network ,Computer science ,business.industry ,Reliability (computer networking) ,Feature extraction ,Pooling ,Pattern recognition ,Convolutional neural network ,Data modeling ,Feature (computer vision) ,Prognostics ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
In recent years, the Remaining Useful Life (RUL) prediction has become a hot spot in Prognostics and Health Management (PHM) research. High-accuracy RUL prediction can reduce the probability of accident occurrence and improve the reliability of the mechanical system. This paper proposes a novel two-channel hybrid model for RUL prediction based on a Capsule Neural Network and a Long Short-Term Memory Network (Cap-LSTM). Conventional Convolutional Neural Networks (CNN) are widely used in RUL prediction. However, the pooling layer of the conventional CNN only extracts the most active part of the multivariate time-series sensor data. Moreover, conventional CNN is not sensitive to the direction and spatial position of features and thus the feature information may not be fully used. To overcome these shortcomings, this paper uses the capsule neural network to directly extract the highly correlated spatial feature information, from the multivariate time-series sensor data, thus avoiding the loss of the spatial position relationship between local features and reducing the complexity of the model. In order to obtain the training and test samples, this paper uses the sliding time window method to preprocess the data. Meanwhile, the piece-wise linear function is used to represent the actual performance degradation of the engine. The NASA C-MAPSS dataset is used to verify the prediction effectiveness of the Cap-LSTM model. The state-of-the-art RUL prediction models are also introduced and compared to the proposed approach, providing results that show the superiority of the presented method.
- Published
- 2021
22. Spin-Wave Linewidth Measurement of Microwave Gyromagnetic Materials in a Low RF Power
- Author
-
Gao Chong, Yong Gao, Jiawei Long, Lin Qin, Jinglei Xi, En Li, Tu Yihang, and Yunpeng Zhang
- Subjects
Materials science ,Field (physics) ,business.industry ,RF power amplifier ,Physics::Optics ,Dielectric ,Magnetic field ,Laser linewidth ,Optics ,Interference (communication) ,Radio frequency ,Electrical and Electronic Engineering ,business ,Instrumentation ,Microwave - Abstract
In this paper, a novel test system for spin-wave linewidth has been proposed. As the traditional test system requires a high-power RF source, a high Q cylindrical resonator with efficiency compression of microwave magnetic field is designed by a partially filled dielectric in this paper. Experimental results show that this method can achieve spin-wave linewidth measurement with lower RF power compare to the original rectangular cavity. Simultaneous, replacing the traditional tuned resonant cavity with the frequency adjustable signal source can reduce the system interference to cavity field distribution and lays the foundation for fully automated testing. Finally, the wide linewidth spin-wave linewidth test is realized in a low RF power environment, and the test uncertainty for the system is estimated within ±10 %.
- Published
- 2021
23. Temporal Feature-Based Classification Into Myocardial Infarction and Other CVDs Merging CNN and Bi-LSTM From ECG Signal
- Author
-
Monisha Dey, Muhammad Ahsan Ullah, and Nuzaer Omar
- Subjects
medicine.diagnostic_test ,business.industry ,Computer science ,Deep learning ,Feature extraction ,Infarction ,Pattern recognition ,medicine.disease ,Convolutional neural network ,Signal ,Redundancy (information theory) ,medicine ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,F1 score ,Instrumentation ,Electrocardiography - Abstract
Heart attack else wise termed as myocardial infarction (MI) causes irreparable death of cardiac muscles yielding the focal reason for most casualties among all cardiovascular diseases (CVDs’). A 12-lead electrocardiogram (ECG) generally depicts cardiac abnormalities and so customary deep learning (DL) approaches use the whole signal for binary detection purposes, that is separating healthy control (HC), and MI classes. This paper proposes an alternative approach where 21 temporal features in lieu of the temporal signal are collected from the 12 lead data to reduce redundancy and class imbalance keeping the vital information intact. Then these extracted features are fed into a detection model consisting of a one dimensional (1-D) convolutional neural network (CNN) and a bidirectional long short-term memory (bi-LSTM) layer which classifies into three classes, namely: HC, MI, and non-myocardial infarction (non-MI) subjects for a realistic and reliable assessment. The model’s performance is evaluated using 517 records acquired from the Physikalisch-Technische Bundesanstalt (PTB) database and a state-of-art overall accuracy of 99.246%, kappa of 0.983, and macro averaged F1 score of 98.86% were achieved using stratified 5-fold cross-validation. DL methods suffer to make unbiased decisions in the case of class imbalance due to an insufficient amount of data for a particular class and thus temporal features are employed to inherently reduce this problem. The successful performance of the extracted features depends on the precise detection of fiducial points, and so multiple novel algorithms have been introduced in this paper.
- Published
- 2021
24. An Innovative LC-C Resonant Pressure Sensor Based on Capacitive Feedthroughs
- Author
-
Zhenxiang Bu, Dandan Gu, Lingyun Wang, Shiqi Wang, Changzhi Zhong, and Lujiang Liu
- Subjects
Microelectromechanical systems ,Interconnection ,Materials science ,business.industry ,Capacitive sensing ,Inductor ,Pressure sensor ,law.invention ,Inductance ,Capacitor ,Hardware_GENERAL ,law ,Optoelectronics ,Electrical and Electronic Engineering ,business ,Instrumentation ,Sensitivity (electronics) - Abstract
LC resonant wireless passive pressure sensor has been receiving increased attention nowadays. In this paper, an innovative LC-C resonant wireless passive pressure sensor based on dual capacitors was designed and manufactured to replace the traditional LC device. In addition to the inductor and capacitor structure required by the traditional LC device, this paper innovatively designs the fixed capacitor as the inter-layer interconnection structure. The key structural dimensions of the sensor were determined through the numerical analysis of the planar inductor theory and the electromechanical coupling simulation of the dual capacitors model in the previous stage, and the processing of the sensor was carried out through MEMS technology. The final test results showed that within the pressure range of 5kPa to 100kPa, the sensor’s average sensitivity was greater than 69.0 kHz/kPa, while the maximum linear fitting error was smaller than 4.18%. The temperature drift in atmospheric environment was 2.7kHz/°C, and the sensitivity temperature drift was 0.0062kHz/(kPa·°C).
- Published
- 2021
25. RFID-Based Pose Estimation for Moving Objects Using Classification and Phase-Position Transformation
- Author
-
Jing Tang, Bo Tao, Wu Haibing, and Zeyu Gong
- Subjects
Computer science ,business.industry ,Feature extraction ,Object (computer science) ,Automation ,law.invention ,Industrial robot ,Statistical classification ,law ,Robot ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,Classifier (UML) ,Pose - Abstract
RFID-based pose perception can enable industrial automation applications such as industrial robot grasping. In this paper, a RFID pose estimation method based on classification algorithm and phase-position transformation model for moving objects is proposed, which converts the traditional pose estimation problem into a machine learning classification problem by dividing the direction angle value domain of the object into several classes. The phase information of multiple RFID tags attached to the object is transformed into position information using an unwrapped phase-position model, on which the input features of the classifier is constructed. A classifier based on the LightGBM framework is constructed and trained to realize the mapping between RFID phase information and the object’s pose. Extensive experiments demonstrate that the proposed method in this paper can accurately estimate the pose of moving objects in real time and successfully complete the robot grasping task for objects on the conveyor belt.
- Published
- 2021
26. Data-Driven Radar Processing Using a Parametric Convolutional Neural Network for Human Activity Classification
- Author
-
Thomas Stadelmayer, Robert Weigel, Fabian Lurz, and Avik Santra
- Subjects
Computer science ,business.industry ,Deep learning ,Feature extraction ,Doppler radar ,Pattern recognition ,Sinc filter ,Convolutional neural network ,law.invention ,law ,Feature (machine learning) ,Spectrogram ,Artificial intelligence ,Electrical and Electronic Engineering ,Radar ,business ,Instrumentation - Abstract
The paper proposes a data-driven pre-processing optimization for radar data using a parametric convolutional neural network. The proposed method is applied on human activity classification as a use case. Present radar-based activity recognition system exploit micro-Doppler signature by generating Doppler spectrograms or a temporal series of range-Doppler maps, followed by deep neural networks or machine learning approaches for classification. Those radar data representations are typically generated on the basis of short-time Fourier transformations. A Fourier transformation equally resolves the frequency space, which may be sub-optimal in some applications. Although deep convolutional neural networks (DCNN) have been shown to implicitly learn features from raw sensor data in other fields, such as speech recognition, yet, for the case of radar-based DCNNs, pre-processing is required to develop a scalable and robust classification or regression application. In this paper, we propose a parametric convolutional neural network that mimics the radar pre-processing across fast-time and slow-time radar data through 2D sinc filter or 2D wavelet filter kernels to extract features for classification of various human activities. During training only the filter parameters of the 2D sinc filters or 2D wavelets are learned, leading to optimized feature representation for the classification task. It is demonstrated that our proposed solution shows improved results compared to equivalent DCNN architectures that rely on Doppler spectrograms or radar data cubes as input data.
- Published
- 2021
27. A Bio-IA With Fast Recovery and Constant Bandwidth for Wearable Bio-Sensors
- Author
-
Tian Yuyuan, Lianxi Liu, and Wenbin Huang
- Subjects
Physics ,Offset (computer science) ,business.industry ,Noise (electronics) ,Cutoff frequency ,Programmable-gain amplifier ,Optics ,Bandwidth (computing) ,Instrumentation amplifier ,Electrical and Electronic Engineering ,business ,Instrumentation ,Passband ,DC bias - Abstract
This paper proposes a bio-signal instrumentation amplifier (Bio-IA) with fast recovery and constant bandwidth for wearable bio-sensors. To shorten the offset calibration time of the Bio-IA and reduce the loss of bio-signal in the calibration process, a digital-controlled DC servo loop (DCDSL) with fast recovery is designed, which achieves a larger offset calibration range and a faster calibration speed. The proposed programmable gain amplifier (PGA) with constant bandwidth uses dual-biased pseudo-resistor (PR) to stabilize the passband width under different gains, effectively preventing the loss of low-frequency signals. Besides, this paper analyzes the noise of the DCDSL and the noise of dual-biased PR for the first time. The presented Bio-IA was implemented in a 0.18- $\mu \text{m}$ CMOS process, occupying a core area of $849 ~\mu {\sf m}\times 451 ~\mu {\sf m}$ . The measured results show that the Bio-IA can calibrate a DC offset of ±511 mV, and the response time is less than 70 ms when the offset polarity changes suddenly. When the gain of the Bio-IA varies from 26 to 40 dB, its passband width remains constant, and the high-pass and low-pass cut-off frequencies are 0.4 Hz and 200 Hz, respectively. The input-referred noise over the range of 0.1-200 Hz is $0.72~\mu $ Vrms. The proposed Bio-IA consumes $5.5~\mu \text{W}$ from 1.2 V supply voltage.
- Published
- 2021
28. Automatic Control System of Balancing Agricultural Stereo Cultivation Based on Wireless Sensors
- Author
-
Shan Hua, Lei Liu, and Qixian Lai
- Subjects
Automatic control ,business.industry ,Wireless network ,Computer science ,Real-time computing ,Network simulation ,Packet loss ,Bit error rate ,Wireless ,Electrical and Electronic Engineering ,business ,Instrumentation ,Wireless sensor network ,Data transmission - Abstract
As a new development direction in the field of information science, wireless sensor network (WSN) has attracted wide attention of academia and industry with its huge application prospect. This research mainly discusses the automatic control system of balcony agriculture stereoscopic cultivation based on wireless sensor network. With the application background of environmental monitoring of protected cultivation, this paper analyzes the specific requirements of plant protected cultivation, and designs the overall scheme of wireless sensor network system with temperature, humidity and light as detection parameters. In this paper, a distance based routing algorithm is designed to realize the networking of wireless sensor networks, and the network simulation is carried out with TOSSIM. Aiming at the problem of packet loss in wireless network data transmission, this paper analyzes the operation mechanism and message structure of TinyOS operating system, and designs MAC protocol based on network synchronization to ensure reliable data transmission. The experimental results show that when the communication distance is 230 m, the two nodes can carry out normal data transmission; when the communication distance is less than 310 m, the bit error rate is very small; when the distance is more than 360 m, the bit error rate is significantly improved; when the distance is more than 400 m, the bit error rate is 100%. It can be seen that wireless sensor network can bring greater convenience to the acquisition of agricultural information, and it is of great significance to extend the application of wireless sensor network to the field of agricultural automation.
- Published
- 2021
29. Enlarging the Usable Hand Tracking Area by Using Multiple Leap Motion Controllers in VR
- Author
-
Sungchul Jung, Yuanjie Wu, Shouwen Yao, Simon Hoermann, Yu Wang, and Robert W. Lindeman
- Subjects
Noise measurement ,Computer science ,business.industry ,Virtual reality ,Sensor fusion ,Tracking (particle physics) ,computer.software_genre ,Control theory ,Virtual machine ,Robustness (computer science) ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Cluster analysis ,Instrumentation ,computer - Abstract
Leap Motion Controller (LMC) is a widely-used 3D user-interface device for virtual reality (VR) in hand tracking applications. However, the tracking area of a single LMC is not sufficient to cover the complete range of hand motion typically used in virtual reality applications, which can cause inconvenience and unnatural behavior of bare-hand interaction in a cooperated virtual environment. In this paper, we propose fusing the data from multiple LMCs to enlarge the tracking area. We present our shared-view calibration method based on a Least-squares Fitting algorithm. To track two hands in the enlarged tracking area, we propose a multi-targets tracking algorithm based on a Clustering-based Labeled Probability Hypothesis Density filter implemented by Gaussian mixture approach. A hand-recognition confidence is proposed to improve the tracking performance when hands are incorrectly recognized. The performance of the proposed algorithm was evaluated by three tests based on a five-LMCs system used on an Oculus Rift S. Results show that our system can track two hands stably in the range of 202.16 degrees horizontally and 164.43 degrees vertically, and the proposed algorithm shows superiority in tracking robustness under hand-recognition errors. The contribution of this paper is to provide a detailed guide for designing an enlarged hand-tracking system using sensor fusion.
- Published
- 2021
30. Copper Complex-Coated Nanopatterned Fiber-Tip Guided Mode Resonance Device for Selective Detection of Ethylene
- Author
-
Ratnesh Kumar, Divyesh P. Kumar, and Shawana Tabassum
- Subjects
chemistry.chemical_classification ,Ethylene ,Optical fiber ,Materials science ,Guided-mode resonance ,business.industry ,chemistry.chemical_element ,Polymer ,engineering.material ,Copper ,law.invention ,chemistry.chemical_compound ,chemistry ,Coating ,Fiber optic sensor ,law ,engineering ,Optoelectronics ,Fiber ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Ethylene (C2H4) has many commercial usage and in agriculture it plays a key role in climacteric fruit ripening. This paper reports on a copper complex-coated nanostructures patterned on the cleaved facet of an optical fiber to realize a high-performance ethylene gas sensor. The novelty of this paper lies in fiber-optic based sensitive and selective monitoring of gaseous ethylene with excellent performance. A periodic array of polymer nanoposts are formed at the fiber tip and coated with titanium dioxide to serve as a guided mode resonant (GMR) device. A direct method of selectivity is developed for recognizing ethylene, by applying a copper (I) complex coating atop the GMR fiber-tip. The nanopatterned fiber-tip GMR sensor exhibits resonance sensitivity to variations in refractive index at the surface. For repeated use, a simple and cost-effective controllable heater is also integrated at the fiber tip to achieve a complete desorption of the analyte molecules from the sensor surface. This is a first-of-its-kind heater-integrated fiber optic sensor utilizing guided mode resonance and coated with a copper (I) complex coating, that is demonstrated for tracking the ethylene-promoted ripening and senescence of banana. The proposed sensor provides a maximum sensitivity of 60 pm/ppm to ethylene gas with a limit of detection of ~4.7 ppm. Compared to our earlier non-specific fiber-tip gas sensor, we improved the limit of detection for ethylene by 170-fold and sensitivity by 60-fold.
- Published
- 2021
31. Laser-Assisted Gaussian Microstructure Patterned PDMS Encapsulated Ti3 C2 Tx (MXene)-Based Pressure Sensor for Object and Touch Detection
- Author
-
Vivek Adepu, Krutarth Kamath, Venkat Mattela, and Parikshit Sahatiya
- Subjects
Materials science ,business.industry ,Microstructure ,Pressure sensor ,Fall time ,Optoelectronics ,Sensitivity (control systems) ,Electrical and Electronic Engineering ,Thin film ,business ,Contact area ,Instrumentation ,Layer (electronics) ,Deposition (law) - Abstract
This work demonstrates the deposition of a ${\text {Ti}}_{3}~\text{C}_{2}~\text{T}_{x}$ thin film on the flexible and bio-degradable cellulose paper via vacuum filtration technique followed by encapsulation in between flexible PDMS with gaussian microstructures at the top and plain layer of PDMS at the bottom. The fabricated sensor displayed improved sensitivity of 2.65 kPa−1 in comparison to the sensitivity (1.53 kPa−1) calculated with unpatterned PDMS encapsulation. The enhancement of sensitivity with microstructured PDMS as force transfer layer was achieved due to quick escalation in contact area even under the application of small external pressure because of the uniform distribution of the pressure by Gaussian patterned morphology. The rise time and fall time of the fabricated sensor were found to be 400 msec and 100 msec respectively. The fabricated sensor was also utilized to detect the unknown location and position of the object using a $4 \times 4$ matrix array. Further, the fabricated sensor was used to demonstrate the human-machine interaction utilizing the smart glove and also an alteration in the brightness of a LED by exerting external pressure on the sensor. The successful demonstration of cost-effective, flexible ${\text {Ti}}_{3}~\text{C}_{2}~\text{T}_{X}$ /cellulose paper pressure sensor has shown innovative applications in the field of security, the educational sector, artificial limbs, etc.
- Published
- 2021
32. The Complexity and Variability Mapping for Prediction and Explainability of the Sleep Apnea Syndrome
- Author
-
Rosario Morello, Janusz Mroczka, and Ireneusz Jablonski
- Subjects
Protocol (science) ,Central sleep apnea ,medicine.diagnostic_test ,business.industry ,Computer science ,Novelty ,Sleep apnea ,Polysomnography ,Machine learning ,computer.software_genre ,medicine.disease ,medicine ,Task analysis ,Artificial intelligence ,Sleep (system call) ,Electrical and Electronic Engineering ,business ,Set (psychology) ,Instrumentation ,computer - Abstract
The paper introduces a research program formulated to uncover and describe a complex nature of the sleep apnea disorders. This study include the physiological sensing and the signal processing oriented towards the mapping of a dynamical profile of physiological system represented by its complexity and variability. To reconstruct a heatmap of the dynamical features significant for triggering sleep disorders we collected a set of procedures dedicated to qualitative and quantitative depiction of the intra- and inter-events, and then adapted them to the use with a polysomnography data. Research protocol was organized with reference to the patients and modified PNEUMA model, and the COMPASS Toolbox devoted to time series exploration. The outcome novelty consists in the complementary characterization of the sleep apnea dynamics, measured at various levels of the system, but also the original statements on the sensitivity of fractal and network oriented algorithms applied to physiological data has been formulated in the report in reference to the temporal patterns encoded in polysomnography data, e.g. a detection of the central sleep apnea with the use of nasal airflow has been documented. The complementary approach proposed in the paper is a prerequisite to understand the SAS phenotyping, predict that modes and the SAS states, and formulate an efficient procedures for personalized patient care.
- Published
- 2021
33. Contactless Hand Gesture Sensor Based on Array of CW Radar for Human to Machine Interface
- Author
-
Lukas, Aloysius Adya Pramudita, and Edwar
- Subjects
Data processing ,Computer science ,business.industry ,Doppler radar ,Feature extraction ,Antenna diversity ,law.invention ,symbols.namesake ,law ,Feature (computer vision) ,symbols ,ComputerSystemsOrganization_SPECIAL-PURPOSEANDAPPLICATION-BASEDSYSTEMS ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,Radar ,business ,Instrumentation ,Doppler effect ,Gesture - Abstract
Contactless Human to Machine Interface (HMI) is an indispensable technology for handling the machine or equipment in a pandemic situation where the virus can spread through direct contact. The contactless hand gesture sensor is an essential part needed for the HMI system as previously mentioned. Several hand gestures with a similar Doppler response will become problems in applying Doppler radar as a hand gesture sensor that requires a more complex recognition method. This paper proposes spatial diversity implementation for obtaining more accurate hand gesture features to cope with this problem. Array radar was selected as a sensor configuration to create the spatial diversity feature. In this paper, an array configuration of four Continuous Wave (CW) radars is proposed as a contactless sensor for hand gestures. Peak detection based on cross-correlation was employed to determine the time position of the hand gesture Doppler response detected by each CW radar. The time position pattern then becomes a feature of each hand gesture used. The CW radar array is realized with an operating frequency of 10 GHz by using the HB 100 as a CW radar component. The experimental results show that the proposed method can distinguish the hand gesture feature with an accuracy of 96.6 % at a sensing distance of 50 cm. It can differentiate the hand gesture pairs that have the opposite direction movement with a similar Doppler effect, and also requires simple data processing for recognizing different hand gestures.
- Published
- 2021
34. Optimum Placement of Relay Nodes in WBANs for Improving the QoS of Indoor RPM System
- Author
-
Avani Vyas and Sujata Pal
- Subjects
Computer science ,business.industry ,Node (networking) ,Quality of service ,Real-time computing ,Physical layer ,law.invention ,Transmission (telecommunications) ,Relay ,law ,Path loss ,Wireless ,Electrical and Electronic Engineering ,business ,Instrumentation ,Communication channel - Abstract
Pandemic situation such as COVID-19 boosted the demand for remote patient monitoring (RPM) system. The medical sensors attached to the human body in RPM system experience varying channel quality due to body movements. This paper analyzes the signal received from RPM sensors when a patient rotates by different angles while sitting on a chair as well as heed the use of a relay node placed on his/her body. Literature suggests many relay-based communication protocols to deliver physio-signals efficiently in an RPM application. However, limited studies have focused on the position of a relay node on the human body. In this paper, we empirically analyze the off-body communication path of sensor nodes by collecting data from different body orientations in a residential room. We estimate the path loss parameters for underweight, normal and overweight body mass index (BMI) categories. The estimated parameters are then used to simulate the physical layer of a home-based indoor RPM application. We inspect different relay node positions on the human body and allude an optimal position of the relay node that cover the transmission range of all sensors and provides an improved channel quality. We improve the Quality of Service (QoS) during non-line-of-sight (NLOS) situation and design an adaptive cross-layer communication protocol for WBANs.
- Published
- 2021
35. A Gait Phase Detection Method in Complex Environment Based on DTW-Mean Templates
- Author
-
Huacheng Hu, Liping Huang, and Jianbin Zheng
- Subjects
Dynamic time warping ,Computer science ,business.industry ,Template matching ,Pattern recognition ,Phase detector ,Field (computer science) ,Exoskeleton ,ComputingMethodologies_PATTERNRECOGNITION ,Gait (human) ,Template ,Fuse (electrical) ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Gait phase detection is essential for the wearable powered exoskeletons. This paper proposes an online gait phase detection method based on dynamic time warping mean (DTW-MEAN) templates using ground contact forces (GCFs). There are two important methods of gait phase detection, which are the template matching and statistical method. Template matching methods such as DTW are robust and have been widely used in the field of gait phase detection. However, the template matching is a kind of method based on distance measure, and the gait phase detection will ignore the coupling connections between the gait sequences; on the contrary, the statistical method can fuse these connections well. In this paper, a statistical mean method based on DTW is proposed to solve the problem of recognizing phases between gait sequences that are not correctly detected by single template methods. We tested our approach in complex environment (such as different terrains, different payloads, and different speeds) and gained over 95% accuracy and time difference below 25ms. Our proposed approach obtained better detection results with the advantage of no need to retrain templates.
- Published
- 2021
36. Thermal Grading Scale for Classification of Breast Thermograms
- Author
-
M. Jayashree, Aruna Prakasarao, M. Menaka, Shobhana Periyasamy, and B. Venkatraman
- Subjects
Protocol (science) ,medicine.medical_specialty ,medicine.diagnostic_test ,business.industry ,Cancer ,medicine.disease ,Fibroadenoma ,Breast cancer ,Thermography ,medicine ,Mammography ,Medical physics ,Electrical and Electronic Engineering ,Stage (cooking) ,business ,Instrumentation ,Grading (tumors) - Abstract
Thermography is a physiological look and pictorial recording of the skin temperature which has significant contribution in detecting breast cancer, since 1957. Thermography is a potential tool to reduce breast cancer mortality by detecting at an early stage. The biggest advantage of this technique is non-invasive and innocuous. Food and Drug Administration (FDA) approved (in the year 1982) thermography as an adjuvant screening tool for breast cancer. Accuracy of the screening to detect cancer early highly depends on interpretation of the thermograms. Progression of this technique as diagnostic tool is very less due to lack of standardization in imaging protocol worldwide and interpretation system. Interpreting the image is the key to know the quality of subject’s health. Interpretation of thermograms for differentiating benign and malignant neoplasm is crucial in identifying features in the image towards the diagnosis. To address the lack of standardization in interpretation of breast images taken from thermography and to ensure uniformity of the report, classification or grading or scoring system is necessary. In this paper authors have proposed a new innovative Indian thermal grading/scoring scale based on quantitative and qualitative parameters including feature analysis, temperature difference and risk factors. The grading/scoring scale has been successfully applied to 75 cases and validated using concurrent sonography and mammography reports. This paper also provide statistically analyzes of the thermal grading/scoring scale for breast thermograms to classify normal, fibroadenoma and cancer subjects for the above mentioned cases.
- Published
- 2021
37. Pseudo-Zero Velocity Re-Detection Double Threshold Zero-Velocity Update (ZUPT) for Inertial Sensor-Based Pedestrian Navigation
- Author
-
Mohammed Jalal Ahamed and Tianyi Zhao
- Subjects
business.industry ,Computer science ,010401 analytical chemistry ,Navigation system ,Gyroscope ,Filter (signal processing) ,Kalman filter ,01 natural sciences ,0104 chemical sciences ,law.invention ,Gait (human) ,Inertial measurement unit ,law ,Dead reckoning ,Step detection ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Zero-velocity update method (ZUPT) is widely used in inertial measurement unit (IMU)-based pedestrian navigation systems for mitigating sensor drifting error. In the basic pedestrian dead reckoning (PDR) system, especially in the foot-tie PDR system, zero-velocity update method with Kalman filter are two core algorithms. In the basic PDR system, ZUPT usually uses a single threshold to judge the gait of pedestrians. A single threshold, however, makes ZUPT unable to accurately judge the gait of pedestrians in different road conditions. In this paper, we propose a new, redesigned ZUPT method without using additional equipment and filter algorithms to further improve the accuracy of correction results. The method uses a sliding detection algorithm to help re-detect the zero-velocity intervals, aiming to remove the pseudo-zero velocity interval and the pseudo-motion interval, as well as improving the performance of the ZUPT method. The method was implemented in a shoe-mounted IMU-based navigation system. For walking step detection tests, the accuracy of the proposed modified ZUPT method reached 87.24%, 25% higher than the conventional methods. In a long-distance walking path tracking test, the mean error of the estimated path of our method is 0.61 m, an 81.69% reduction compared to the conventional ZUPT methods. The details of the improved ZUPT method presented in this paper not only enable the tracking technology to better track a pedestrian’s step changes during walking, but also provide better calculation conditions for subsequent filter operations.
- Published
- 2021
38. Human Activity Recognition With Smartphone and Wearable Sensors Using Deep Learning Techniques: A Review
- Author
-
Thinagaran Perumal, S. Padmavathi, and E. Ramanujam
- Subjects
Computer science ,business.industry ,Deep learning ,010401 analytical chemistry ,Feature extraction ,Wearable computer ,Feature selection ,Human behavior ,Machine learning ,computer.software_genre ,01 natural sciences ,0104 chemical sciences ,Activity recognition ,Home automation ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,computer ,Wearable technology - Abstract
Human Activity Recognition (HAR) is a field that infers human activities from raw time-series signals acquired through embedded sensors of smartphones and wearable devices. It has gained much attraction in various smart home environments, especially to continuously monitor human behaviors in ambient assisted living to provide elderly care and rehabilitation. The system follows various operation modules such as data acquisition, pre-processing to eliminate noise and distortions, feature extraction, feature selection, and classification. Recently, various state-of-the-art techniques have proposed feature extraction and selection techniques classified using traditional Machine learning classifiers. However, most of the techniques use rustic feature extraction processes that are incapable of recognizing complex activities. With the emergence and advancement of high computational resources, Deep Learning techniques are widely used in various HAR systems to retrieve features and classification efficiently. Thus, this review paper focuses on providing profound concise of deep learning techniques used in smartphone and wearable sensor-based recognition systems. The proposed techniques are categorized into conventional and hybrid deep learning models described with its uniqueness, merits, and limitations. The paper also discusses various benchmark datasets used in existing techniques. Finally, the paper lists certain challenges and issues that require future research and improvements.
- Published
- 2021
39. Tactile Sensing Systems for Tumor Characterization: A Review
- Author
-
Chang-Hee Won, Jong-Ha Lee, and Firdous Saleheen
- Subjects
Data processing ,medicine.diagnostic_test ,InformationSystems_INFORMATIONINTERFACESANDPRESENTATION(e.g.,HCI) ,Computer science ,Piezoelectric sensor ,business.industry ,Capacitive sensing ,010401 analytical chemistry ,Transduction (psychology) ,01 natural sciences ,Piezoresistive effect ,0104 chemical sciences ,Characterization (materials science) ,medicine ,Computer vision ,Artificial intelligence ,Elastography ,Electrical and Electronic Engineering ,business ,Instrumentation ,Tactile sensor - Abstract
This paper presents a review of Tactile Sensing Systems, with an emphasis on their application to the non-invasive characterization of tumors. Emulating the perceptual mechanism of the human skin, the Tactile Sensing Systems characterize tumors using touch sensors by quantifying the mechanical properties such as size and elasticity. The authors survey several tactile transduction methods: capacitive, piezoresistive, piezoelectric, magnetic, and optical. The advantages and disadvantages of different tactile sensors are discussed. The complex human sense of touch is emulated using tactile sensor data, novel data processing algorithms, and near real-time interpretation in a human-readable format. Tactile Sensing Systems utilize tactile sensors and other subsystems to come up with accurate mechanical properties of the touched objects. We review Elasticity Determination Systems, which are a special case of Tactile Sensing Systems. These systems are based on capacitive sensors, piezoelectric sensors, elastography, and optical tactile sensors. Then the optical Tactile Sensing System is discussed in detail; architecture, sensing principle, and algorithms to compute a risk score. Moreover, a survey of multimodal Tactile Sensing Systems, which broaden the capabilities of existing tactile sensing systems, is presented. The paper concludes with discussions and future research directions.
- Published
- 2021
40. Magnetic Targeting Systems for Endo-Bronchoscope Diagnosis and Intramedullary-Nail Surgery: A Review
- Author
-
Chin Chung Chen, Wensyang Hsu, Tien-Kan Chung, Chih-Cheng Cheng, Po-Chen Yeh, Tze-Hong Wong, Yun-Chien Cheng, and Ching Kai Lin
- Subjects
medicine.medical_specialty ,medicine.diagnostic_test ,business.industry ,Magnetic resonance imaging ,equipment and supplies ,Carotid artery aneurysm ,Surgery ,law.invention ,Intramedullary rod ,Medical services ,law ,Medical imaging ,medicine ,Electrical and Electronic Engineering ,business ,Instrumentation - Abstract
Nowadays, magnetic targeting systems are developed for clinical/surgical applications, such as treatment of carotid artery aneurysm, endo-bronchoscopic diagnosis for lung-cancer tumors, colonoscopic diagnosis for colon-cancer tumors, and intramedullary interlocking-nail surgery. Based on clinical requirements, the targeting systems specific for above endo-bronchoscopic diagnosis and nail surgery are urgently needed and thus rapidly developed. Moreover, because the systems have similar magnetic configurations and use similar magnetic targeting principles, the systems can be reviewed together. Endo-bronchoscopic diagnosis is a new clinical-proved method for doctors to diagnose lung-cancer tumors/lesions. However, in the diagnosis, targeting the endo-bronchoscope to tumors/lesions must be repeated many times and thereby is inconsistent. Thus, diagnosis-yield decreases and diagnosis-duration increases. To address this issue, researchers developed novel magnetic targeting systems to more accurately and rapidly target the endo-bronchoscope, i.e., increase yield and save time. The systems are categorized to magnetic-sensors based and magnetic-materials based targeting systems. Representative systems are reviewed (design, targeting principles, test methods, results, and features are highlighted) in this paper. Intramedullary interlocking-nail surgery is a standard clinical-method for fractured-bones. In the surgery, 2D X-ray imaging system is a conventional most-used method to target distal screw-hole of the nail for fractured-bones fixing. However, patients are over-exposed under X-ray radiation. To solve this problem, researchers presented innovative magnetic targeting systems to target the screw-hole without any X-ray radiation. Same as above-section, the systems are divided to magnetic-sensors based and magnetic-materials based targeting systems. Representative systems and corresponding design, targeting principles, test methods, results, and features are reviewed in this paper.
- Published
- 2021
41. A Review of Extrusion-Based 3D Printing for the Fabrication of Electro- and Biomechanical Sensors
- Author
-
Martijn Schouten, Alexander Dijkshoorn, Dimitrios Kosmas, Gijs Krijnen, Gerjan Wolterink, Stefano Stramigioli, Robotics and Mechatronics, and Digital Society Institute
- Subjects
3d printed ,Fabrication ,Materials science ,Writing ,3D printing ,Mechanical engineering ,Additive manufacturing (AM) ,01 natural sciences ,law.invention ,Flexible strain sensors ,law ,Frequency division multiplexing ,Electrical and Electronic Engineering ,Instrumentation ,Three-dimensional printing ,3d print ,Fused deposition modeling ,Inkwell ,Sensors ,business.industry ,010401 analytical chemistry ,0104 chemical sciences ,Fiber encapsulation ,Embedded sensing ,Three dimensional printing ,Three-dimensional displays ,Direct ink writing ,Ink ,Extrusion ,Fused deposition modelling (FDM) ,business ,3D printed sensors - Abstract
In this review paper, we focus on the 3D printing technologies that consist of the extruding of fluid material in lines to form structures for electro- and biomechanical applications. Our paper reviews various 3D print technologies, materials, sensing technologies and applications of extrusion-based 3D printing. We also discuss how to overcome some of the challenges with 3D printed sensors, such as the anisotropy of the conductors as well as the drift and nonlinearity of the materials.
- Published
- 2021
42. Pose Estimation Based on Wheel Speed Anomaly Detection in Monocular Visual-Inertial SLAM
- Author
-
Li Xinde, Dingxin He, Zezao Lu, Shanliang Chen, and Gang Peng
- Subjects
Robot kinematics ,Electronic speed control ,Inertial frame of reference ,Chassis ,Computer science ,business.industry ,010401 analytical chemistry ,Mobile robot ,Simultaneous localization and mapping ,01 natural sciences ,Odometer ,0104 chemical sciences ,law.invention ,law ,Mecanum wheel ,Robot ,Torque ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,Pose - Abstract
Considering the adverse impact of speed measurement on the accuracy of pose estimation after a mobile robot slips, collides, or abducts, this paper proposes a monocular inertial simultaneous localization and mapping algorithm that includes wheel speed anomaly detection. The algorithm adds wheel speed measurement to the least squares problem in a tightly coupled manner and uses a nonlinear optimization method to maximize the posterior probability to solve the optimal state estimation. For the speed control of the Mecanum wheel, because the existing closed-loop speed control method cannot calculate the motion constraint error, this paper reports a design of a control method of the Mecanum wheel moving chassis based on torque control, which can use the motion constraint error to estimate the credibility of the wheel speed measurement to detect whether the chassis movement status is abnormal; meanwhile, to prevent the chassis speed measurement error from adversely affecting the robot pose estimation, this paper uses three methods to actively detect whether the chassis movement is abnormal, and analyze the chassis movement status in real time. When it is determined that the chassis has abnormal motion, the wheel odometer pre-integration measurement of the current frame is actively removed from the state estimation equation, thereby ensuring the accuracy of the pose estimation. Experimental results show the feasibility and effectiveness of the method proposed in this paper, and the algorithm is robust.
- Published
- 2021
43. Sensored Semantic Annotation for Traffic Control Based on Knowledge Inference in Video
- Author
-
Chang Choi, Tian Wang, Kyungroul Lee, Brij B. Gupta, and Christian Esposito
- Subjects
business.industry ,Computer science ,010401 analytical chemistry ,Representation (systemics) ,Inference ,Ontology (information science) ,Object (computer science) ,computer.software_genre ,Semantics ,01 natural sciences ,Automatic summarization ,0104 chemical sciences ,Semantic integration ,Artificial intelligence ,Electrical and Electronic Engineering ,business ,Instrumentation ,computer ,Natural language processing ,Semantic gap - Abstract
Images and videos in multimedia data are typical representation methods that include various types of information, such as color, shape, texture, pattern, and other characteristics. Besides, in video data, information such as object movement is included. Objects may move with time, and spatial features can change, which is incorporated in spatio-temporal relations. Many research studies have been carried out over time on information recognition by computers using low-level data in this connection. There is a semantic gap between low-level and high-level information in vocabulary representing human thinking. A substantial amount of research has been conducted on reducing the semantic gap, and it is focused on representation methods of logic. The goal of this study is to understand object movement and define spatio-temporal relations through mapping between vocabulary and the object movements. Ontology mapping is a method used to bridge the gap between low-level and high-level information. In this case, the spatio-temporal relation consists of temporal relations obedient to the passage of time, directional relations obedient to changes in object movement direction, changes in object size relations, topological relations obedient to changes in object movement position, and velocity relations using concept relations between topology models. In this paper, an ontology is used to define the inference rules using the proposed spatio-temporal relations and the use of Markov Logic Networks (MLNs) for probabilistic reasoning. Finally, the performed experiment and evaluation prove the verification recognition and understanding of object movements based on video data. This paper can be extended to retrieval and comparison between object movements, automatic annotation, and video summarization. The contributions of this paper include definition of the spatio-temporal relations of a region-based object, recognition of the semantic movements of moving objects, designing and constructing a spatio-temporal ontology, and Understanding the semantic movement of moving objects.
- Published
- 2021
44. Sensor Initiated Healthcare Packet Priority in Congested IoT Networks
- Author
-
Juan I. Nieto-Hipolito, Kedir Mamo Besher, Sara Beitelspacher, and Mohammed Zamshed Ali
- Subjects
Router ,Computer science ,Network packet ,business.industry ,Quality of service ,ComputerSystemsOrganization_COMPUTER-COMMUNICATIONNETWORKS ,010401 analytical chemistry ,Cloud computing ,01 natural sciences ,0104 chemical sciences ,law.invention ,Identifier ,law ,Header ,Internet Protocol ,Electrical and Electronic Engineering ,Routing (electronic design automation) ,business ,Instrumentation ,Computer network - Abstract
Currently healthcare data packets do not get any special priority while routing through the Internet of Things (IoT) networks. These data packets flow through routers using conventional QoS process which does not guarantee that a patient’s critical health data traveling in congested IoT network will actually be routed to doctors office on time. This leaves the remote medical treatment at risk with possible threat to patients’ lives. In this paper, we studied the current healthcare packet routing process in IoT and its performance issues in congested IoT networks, then proposed a sensor driven solution to prioritize healthcare data routing in congested IoT networks. In our proposed system, we add a healthcare data identifier in IP packet header at the sensor level, modify QoS software at the network router level, and provide the highest priority to healthcare data packet routing based on the healthcare data identifier seen at router QoS. A prototype has been built and tested by using TI Launchpads. Test data shows that healthcare packets with an identifier can route to doctors at 80% less latency than healthcare packets routed without an identifier. Additionally, the proposed system saves medical diagnostic cost, and more importantly, reduces the risk of losing human lives. A shorter version of this analysis has also been presented to IEEE conference. The detail analysis in this paper opens up multiple avenues for further research.
- Published
- 2021
45. IoT Sensor Initiated Healthcare Data Security
- Author
-
Kedir Mamo Besher, Zareen Subah, and Mohammed Zamshed Ali
- Subjects
Computer science ,business.industry ,Network packet ,010401 analytical chemistry ,Cryptography ,Cloud computing ,Encryption ,01 natural sciences ,0104 chemical sciences ,Data flow diagram ,Transmission (telecommunications) ,Proof of concept ,Electrical and Electronic Engineering ,business ,Instrumentation ,Computer network ,Data transmission - Abstract
While the Internet of Things (IoT) has been instrumental in healthcare data transmission, it also presents vulnerabilities and security risks to patients’ personalized health information for remote medical treatment. Currently most published security solutions available for healthcare data are not focused on data flow all the way from IoT sensor devices placed on a patient’s body through network routers to doctor’s offices. In this paper, we studied how the IoT network facilitates healthcare data transmission for remote medical treatment, explored security risks associated with unsecured data transmission, especially between IoT sensor devices and network routers, and then proposed an encrypted security solution initiated at IoT sensor devices. Our proposed solution provides a cryptography algorithm embedded into the sensor device such that the packets generated with patient’s health data are encrypted right at the sensor device before being transmitted. The proof of concept has been verified using a lab setup with two level encryption at the IoT sensor level and two level decryption at the receiving end at the doctor’s office. Test results are promising for an end-to-end security solution of healthcare data transmission in IoT. This paper also opens up further research avenues on IoT sensor driven security.
- Published
- 2021
46. Compressing the Index on Distributed Data of Sensors
- Author
-
Vandana Bhasin, Sushil Kumar, and Prem Chandra Saxena
- Subjects
Distributed database ,Computer science ,business.industry ,010401 analytical chemistry ,Energy consumption ,01 natural sciences ,0104 chemical sciences ,Data aggregator ,Encoding (memory) ,Scalability ,Electrical and Electronic Engineering ,Transceiver ,business ,Instrumentation ,Wireless sensor network ,Energy (signal processing) ,Computer network - Abstract
The most daunting and conflicting challenges accompanying the wireless sensor networks are energy and security. And data aggregation and compression techniques are two of the effective ways to reduce energy consumption. As it is known that the radio transceiver consumes energy which is proportional to the number of bits transmitted on the network; hence sending fewer bits on the communication channel implies lesser energy consumption. This paper works on compressing the index of secure index on distributed data (SIDD) technique; to reduce the number of bits of an index that is transmitted on the communication channel. The objective being to reduce energy consumption of SIDD. In this paper, we have worked to reduce the number of bits of the index sent on the communication channel, deploying difference encoding. The compression mechanism has established an upper bound on the energy consumption whilst all data items were unique. The scheme is scalable and can be deployed for saving energy consumption.
- Published
- 2021
47. High-Speed Optical 3D Measurement Sensor for Industrial Application
- Author
-
Lai Yinping, Congyi Lyu, Shanshan Yang, Daochuan Wang, Peng Li, and Congying Sui
- Subjects
business.industry ,Computer science ,Computation ,010401 analytical chemistry ,01 natural sciences ,Automation ,0104 chemical sciences ,Set (abstract data type) ,Signal-to-noise ratio ,Robot ,Digital Light Processing ,Electrical and Electronic Engineering ,business ,Field-programmable gate array ,Instrumentation ,Computer hardware ,Structured light - Abstract
3D optical sensors are becoming more and more popular in vision guidance of industrial robots and other industrial automation applications. Although research on high-speed 3D shape measurement (or imaging) has experienced tremendous growth over the past decades, simultaneously achieving high-speed and high-accuracy performance remains a major challenge in industrial practice. This paper presents a new FPGA architecture for the PMP algorithm and designs an high-speed embedded binocular structured light 3D measurement sensor. The sensor mainly contains a DLP projector, two cameras and a Xilinx Zynq-7000 UltraScale which make real-time computation possible. Experiments showed the time consuming of processing a set of ${9} \times {2}$ images with a resolution of ${2048} \times {1536}$ using the sensor proposed in this paper is 31.47 ms that has a better performance than 255ms on GPU. To the best of our knowledge, this is the first high-speed FPGA-based embedded binocular structured light 3D measurement sensor. This proposed 3D sensor can obtain ultra high quality 3D information in real time, it can be widely applied to robot random pin-picking and other industrial applications.
- Published
- 2021
48. A Calibration Method for Mobile Omnidirectional Vision Based on Structured Light
- Author
-
Qing Lin Wang, Ling Meng, and Yuan Li
- Subjects
Computer science ,business.industry ,Machine vision ,010401 analytical chemistry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Laser ,01 natural sciences ,0104 chemical sciences ,law.invention ,Planar ,Omnidirectional camera ,law ,Computer Science::Computer Vision and Pattern Recognition ,Calibration ,Computer vision ,Artificial intelligence ,Electrical and Electronic Engineering ,Vanishing point ,Omnidirectional antenna ,business ,Instrumentation ,Structured light - Abstract
Mobile omnidirectional structured light vision is increasingly used in scene perception and robot navigation. A wide range of information is obtained by means of the vision system by only one image and laser image features are detected and extracted easily and quickly. In this paper a novel calibration method for mobile omnidirectional camera based on structured light is presented. Firstly, a set of parallel laser planes is emitted on the walls of corridor as auxiliary targets by structured light and intersects with wall orthogonally. Secondly, the constraint relationship is analyzed between the vanishing points in fisheye images and intrinsic parameters of imaging model. Finally, effects of the laser stripes’ interval and the angle between the wall which contains laser stripes and ground on calibration results are evaluated. Compared to Scaramuzza method, the calibration method shows its superiority in terms of both feasibility and efficiency. The method with the characteristic of self-calibration since the planar target is replaced by actively projected laser stripes. The result illustrates that our method has the advantages of simple and feasible operation, but result is effective and accurate. The calibration parameters are independent of the laser stripes’ interval and the angle between the wall and ground. Therefore, the method of the mobile omnidirectional structured light vision presented in this paper can be applied to many areas.
- Published
- 2021
49. Through-Wall Mapping Using Radar: Approaches to Handle Multipath Reflections
- Author
-
Lino Marques and Sedat Dogru
- Subjects
Synthetic aperture radar ,Computer science ,business.industry ,010401 analytical chemistry ,Real-time computing ,Process (computing) ,Usability ,USable ,01 natural sciences ,0104 chemical sciences ,law.invention ,law ,Radar imaging ,Electrical and Electronic Engineering ,Radar ,business ,Instrumentation ,Search and rescue ,Multipath propagation - Abstract
Through-wall mapping is an emerging field of research with promising applications varying from search and rescue, to health care and to security. Radar is a valuable tool in this process, mainly due to its long wavelength, which can pass through construction materials. However, this capability comes at a price, namely multipath reflections caused by the environment, which can reduce the usability of the produced map considerably. This paper proposes methods to detect and isolate these multipath reflections, eventually leaving out a usable map of the enclosed environment. For this purpose, two different radars, one operating at 24GHz and the other at 76GHz, were evaluated in various wall configurations constructed inside an enclosed space using portable wall segments. The testing arena was probed from the outside with the radars mounted on the top of a differential drive mobile robot. The paper shows that the proposed methods are effective in eliminating multipath reflections and in building an accurate representation of the environment using the radars.
- Published
- 2021
50. Phase-Variation Microwave Sensor for Permittivity Measurements Based on a High-Impedance Half-Wavelength Transmission Line
- Author
-
Pau Casacuberta, Lijuan Su, Ferran Martin, Paris Velez, Marta Gil, and Jonathan Munoz-Enano
- Subjects
Permittivity ,Materials science ,business.industry ,010401 analytical chemistry ,Dielectric ,01 natural sciences ,Line (electrical engineering) ,Characteristic impedance ,0104 chemical sciences ,Optics ,Transmission (telecommunications) ,Electrical length ,Transmission line ,Electrical and Electronic Engineering ,business ,Instrumentation ,Electrical impedance - Abstract
A phase-variation microwave sensor operating in transmission and implemented by means of a high-impedance half-wavelength sensing line is reported in this paper. The sensor is useful for dielectric constant measurements and dielectric characterization of materials. By forcing the electrical length of the sensing line to be a half-wavelength when it is loaded with the so-called reference (REF) material, perfect matching is obtained regardless of the characteristic impedance of the line. This fact can be used to enhance the sensitivity for small perturbations, by merely increasing the characteristic impedance of the sensing line. An exhaustive analysis that supports such conclusion is reported in the paper. Then, two prototype sensors are designed and fabricated for validation purposes. As compared to the ordinary phase-variation permittivity sensor implemented by means of a matched ( $50-\Omega $ ) line with identical length, the sensitivity for small perturbations in the proposed sensor is 2.1 times larger. Further advantages of these sensors are low-cost, small size, implementation in planar technology, and very simple design and fabrication, derived from the fact that the sensing region is a half-wavelength transmission line.
- Published
- 2021
Discovery Service for Jio Institute Digital Library
For full access to our library's resources, please sign in.