Search

As the number of electronic gadgets in our daily lives is increasing and most of them require some kind of human interaction, this demands innovative, convenient input methods. There are limitations to state-of-the-art (SotA) ultrasound-based hand gesture recognition (HGR) systems in terms of robustness and accuracy. This research presents a novel machine learning (ML)-based end-to-end solution for hand gesture recognition with low-cost micro-electromechanical (MEMS) system ultrasonic transducers. In contrast to prior methods, our ML model processes the raw echo samples directly instead of using pre-processed data. Consequently, the processing flow presented in this work leaves it to the ML model to extract the important information from the echo data. The success of this approach is demonstrated as follows. Four MEMS ultrasonic transducers are placed in three different geometrical arrangements. For each arrangement, different types of ML models are optimized and benchmarked on datasets acquired with the presented custom hardware (HW): convolutional neural networks (CNNs), gated recurrent units (GRUs), long short-term memory (LSTM), vision transformer (ViT), and cross-attention multi-scale vision transformer (CrossViT). The three last-mentioned ML models reached more than 88% accuracy. The most important innovation described in this research paper is that we were able to demonstrate that little pre-processing is necessary to obtain high accuracy in ultrasonic HGR for several arrangements of cost-effective and low-power MEMS ultrasonic transducer arrays. Even the computationally intensive Fourier transform can be omitted. The presented approach is further compared to HGR systems using other sensor types such as vision, WiFi, radar, and state-of-the-art ultrasound-based HGR systems. Direct processing of the sensor signals by a compact model makes ultrasonic hand gesture recognition a true low-cost and power-efficient input method. [ABSTRACT FROM AUTHOR]

The effects of climate change and the rapid growth of societies often lead to water scarcity and inadequate water quality, resulting in a significant number of diseases. The digitalization of infrastructure and the use of Digital Twins are presented as alternatives for optimizing resources and the necessary infrastructure in the water cycle. This paper presents a framework for the development of a Digital Twin platform for a wastewater treatment plant, based on a microservices architecture which optimized its design for edge computing implementation. The platform aims to optimize the operation and maintenance processes of the plant's systems, by employing machine learning techniques, process modeling and simulation, as well as leveraging the information contained in BIM models to support decision-making. [ABSTRACT FROM AUTHOR]

In this paper, we present our investigation of the 2D Hand Gesture Recognition (HGR) which may be suitable for the control of the Automated Guided Vehicle (AGV). In real conditions, we deal with, among others, a complex background, changing lighting conditions, and different distances of the operator from the AGV. For this reason, in the article, we describe the database of 2D images created during the research. We tested classic algorithms and modified them by us ResNet50 and MobileNetV2 which were retrained partially using the transfer learning approach, as well as proposed a simple and effective Convolutional Neural Network (CNN). As part of our work, we used a closed engineering environment for rapid prototyping of vision algorithms, i.e., Adaptive Vision Studio (AVS), currently Zebra Aurora Vision, as well as an open Python programming environment. In addition, we shortly discuss the results of preliminary work on 3D HGR, which seems to be very promising for future work. The results show that, in our case, from the point of view of implementing the gesture recognition methods in AGVs, better results may be expected for RGB images than grayscale ones. Also using 3D imaging and a depth map may give better results. [ABSTRACT FROM AUTHOR]

Human–Machine Interface (HMI) plays a key role in the interaction between people and machines, which allows people to easily and intuitively control the machine and immersively experience the virtual world of the meta-universe by virtual reality/augmented reality (VR/AR) technology. Currently, wearable skin-integrated tactile and force sensors are widely used in immersive human–machine interactions due to their ultra-thin, ultra-soft, conformal characteristics. In this paper, the recent progress of tactile and force sensors used in HMI are reviewed, including piezoresistive, capacitive, piezoelectric, triboelectric, and other sensors. Then, this paper discusses how to improve the performance of tactile and force sensors for HMI. Next, this paper summarizes the HMI for dexterous robotic manipulation and VR/AR applications. Finally, this paper summarizes and proposes the future development trend of HMI. [ABSTRACT FROM AUTHOR]

Mechanical energy harvesters including piezoelectric nanogenerators, electromagnetic generators and triboelectric nanogenerators (TENG) used to convert the mechanical motion into electricity are more and more important in the recent decades. Specifically, the fiber-based TENG (FTENG) has gained considerable favors due to its flexibility, light weight, and high environmental tolerance for the wearable devices. The traditional FTENGs made of Teflon result in better performance but are not suitable for long-term wear in person. Here, we propose a novel FTENG using a flexible micro-needle-structured polydimethylsiloxane (MN-PDMS) together with the comfortable commercially available 2D-polyester fibers, and electroless nickel-plated cotton cloth of which two are widely used in human daily life. The MN-PDMS is formed by a laser engraved mold for improving its output performance of FTENG compared to the flat-PDMS. The open-circuit voltage (Voc) and the short-circuit current (Isc) of MN-FTENG increased to 73.6 V and 36 μA, respectively, which are 34% and 37% higher than the flat-FTENG. In terms of power, the performance of MN-FTENG reaches 1.296 mW which is 89% higher than that of flat-TENG and it can also light up 90 LEDs. For application, human motion at the joints can be detected and collected with various signals that are used for the human–machine interface (HMI) through the cooperation of components for the Internet of Things (IoT). It can light up the LED bulb through MN-FTENG to potentially develop IoT HMI systems for human motion control of robot in the future. [ABSTRACT FROM AUTHOR]

There are several specific solutions for accessing sensors and actuators present in any process or system through a TCP/IP network, either local or a wide area type like the Internet. The usage of sensors and actuators of different nature and diverse interfaces (SPI, I2C, analogue, etc.) makes access to them from a network in a homogeneous and secure way more complex. A framework, including both software and hardware resources, is necessary to simplify and unify networked access to these devices. In this paper, a set of open-source software tools, specifically designed to cover the different issues concerning the access to sensors and actuators, and two proposed low-cost hardware architectures to operate with the abovementioned software tools are presented. They allow integrated and easy access to local or remote sensors and actuators. The software tools, integrated in the free authoring tool Easy Java and Javascript Simulations (EJS) solve the interaction issues between the subsystem that integrates sensors and actuators into the network, called convergence subsystem in this paper, and the Human Machine Interface (HMI)--this one designed using the intuitive graphical system of EJS--located on the user's computer. The proposed hardware architectures and software tools are described and experimental implementations with the proposed tools are presented. [ABSTRACT FROM AUTHOR]

In recent years, the Industry 4.0 paradigm has accelerated the digitalization process of the industry, and it slowly diminishes the line between information technologies (IT) and operational technologies (OT). Among the advantages, this brings up the convergence issue between IT and OT, especially in the cybersecurity-related topics, including new attack vectors, threats, security imperfections, and much more. This cause raised new topics for methods focused on protecting the industrial infrastructure, including monitoring and detection systems, which should help overcome these new challenges. However, those methods require high quality and a large number of datasets with different conditions to adapt to the specific systems effectively. Unfortunately, revealing field factory setups and infrastructure would be costly and challenging due to the privacy and sensitivity causes. From the lack of data emerges the new topic of industrial testbeds, including sub-real physical laboratory environments, virtual factories, honeynets, honeypots, and other areas, which helps to deliver sufficient datasets for mentioned research and development. This paper summarizes related works in the area of industrial testbeds. Moreover, it describes best practices and lessons learned for assembling physical, simulated, virtual, and hybrid testbeds. Additionally, a comparison of the essential parameters of those testbeds is presented. Finally, the findings and provided information reveal research and development challenges, which must be surpassed. [ABSTRACT FROM AUTHOR]

Depression is a common mental illness characterized by sadness, lack of interest, or pleasure. According to the DSM-5, there are nine symptoms, from which an individual must present 4 or 5 in the last two weeks to fulfill the diagnosis criteria of depression. Nevertheless, the common methods that health care professionals use to assess and monitor depression symptoms are face-to-face questionnaires leading to time-consuming or expensive methods. On the other hand, smart homes can monitor householders' health through smart devices such as smartphones, wearables, cameras, or voice assistants connected to the home. Although the depression disorders at smart homes are commonly oriented to the senior sector, depression affects all of us. Therefore, even though an expert needs to diagnose the depression disorder, questionnaires as the PHQ-9 help spot any depressive symptomatology as a pre-diagnosis. Thus, this paper proposes a three-step framework; the first step assesses the nine questions to the end-user through ALEXA or a gamified HMI. Then, a fuzzy logic decision system considers three actions based on the nine responses. Finally, the last step considers these three actions: continue monitoring through Alexa and the HMI, suggest specialist referral, and mandatory specialist referral. [ABSTRACT FROM AUTHOR]

The human-machine interfaces in modern CNC machine tools are not very intuitive and still based on archaic input systems, i.e., switches, handwheels, and buttons. This type of solution has two major drawbacks. The pushed button activates the movement only in one direction and is insensitive to the amount of the force exerted by the operator, which makes it difficult to move the machine axes at variable speeds. The paper proposes a novel and intuitive system of manual programming of a CNC machine tool based on a control lever with strain-gauge sensors. The presented idea of manual programming is aimed at eliminating the need to create a machining program and at making it possible to move the machine intuitively, eliminating mistakes in selecting directions and speeds. The article describes the concept of the system and the principle of operation of the control levers with force sensors. The final part of the work presents the experimental validation of the proposed system and a functionality comparison with the traditional CNC control. [ABSTRACT FROM AUTHOR]