Search

Network security situation awareness (NSSA) is an integral part of cybersecurity defense, and it is essential for cybersecurity managers to respond to increasingly sophisticated cyber threats. Different from traditional security measures, NSSA can identify the behavior of various activities in the network and conduct intent understanding and impact assessment from a macro perspective so as to provide reasonable decision support, predicting the development trend of network security. It is a means to analyze the network security quantitatively. Although NSSA has received extensive attention and exploration, there is a lack of comprehensive reviews of the related technologies. This paper presents a state-of-the-art study on NSSA that can help bridge the current research status and future large-scale application. First, the paper provides a concise introduction to NSSA, highlighting its development process. Then, the paper focuses on the research progress of key technologies in recent years. We further discuss the classic use cases of NSSA. Finally, the survey details various challenges and potential research directions related to NSSA. [ABSTRACT FROM AUTHOR]

Existing techniques for distilling situation awareness currently focus on information harvested from either IoT sensors or social media. While the benefits of fusing information from these two distinct information spaces for achieving enhanced situation awareness are well understood, existing techniques and related systems for fusing the IoT sensors and social media information spaces are currently embryonic. Key challenges in intersecting, combining, and fusing these information spaces to distil high-value situation awareness include devising situation models and related techniques for filtering, integrating, and fusing sparse and heterogeneous IoT sensor data and social media postings to provide a richer and more accurate situation awareness. This paper proposes novel, semantically based techniques fusing social media and IoT sensor information spaces and a comprehensive, fully implemented system that utilizes these to provide enhanced situation awareness. More specifically, this paper proposes the design of semantic-based situation models for fusing sensor and social media information spaces and presents techniques for finding similarities across these information spaces and fusing social media posting and IoT sensor data to generate an enhanced situation awareness. Furthermore, the paper presents the design and implementation of a complete system that uses the proposed models and techniques and uses that in an experimental evaluation that illustrates improvements in situation awareness from fusing the IoT sensor and social media information spaces. [ABSTRACT FROM AUTHOR]

A significant challenge faced by visually impaired people is 'wayfinding', which is the ability to find one's way to a destination in an unfamiliar environment. This study develops a novel wayfinding system for smartphones that can automatically recognize the situation and scene objects in real time. Through analyzing streaming images, the proposed system first classifies the current situation of a user in terms of their location. Next, based on the current situation, only the necessary context objects are found and interpreted using computer vision techniques. It estimates the motions of the user with two inertial sensors and records the trajectories of the user toward the destination, which are also used as a guide for the return route after reaching the destination. To efficiently convey the recognized results using an auditory interface, activity-based instructions are generated that guide the user in a series of movements along a route. To assess the effectiveness of the proposed system, experiments were conducted in several indoor environments: the sit in which the situation awareness accuracy was 90% and the object detection false alarm rate was 0.016. In addition, our field test results demonstrate that users can locate their paths with an accuracy of 97%. [ABSTRACT FROM AUTHOR]

Current mobile devices allow the execution of sophisticated applications with the capacity for identifying the user situation, which can be helpful in treatments of mental disorders. In this paper, we present SituMan, a solution that provides situation awareness to MoodBuster, an ecological momentary assessment and intervention mobile application used to request self-assessments from patients in depression treatments. SituMan has a fuzzy inference engine to identify patient situations using context data gathered from the sensors embedded in mobile devices. Situations are specified jointly by the patient and mental health professional, and they can represent the patient's daily routine (e.g., "studying", "at work", "working out"). MoodBuster requests mental status self-assessments from patients at adequate moments using situation awareness. In addition, SituMan saves and displays patient situations in a summary, delivering them for consultation by mental health professionals. A first experimental evaluation was performed to assess the user satisfaction with the approaches to define and identify situations. This experiment showed that SituMan was well evaluated in both criteria. A second experiment was performed to assess the accuracy of the fuzzy engine to infer situations. Results from the second experiment showed that the fuzzy inference engine has a good accuracy to identify situations. [ABSTRACT FROM AUTHOR]

Recent disasters have shown that having clearly defined preventive procedures and decisions is a critical component that minimizes evacuation hazards and ensures a rapid and successful evolution of evacuation plans. In this context, we present our Situation-Aware System for enhancing Evacuation Plans (SASEP) system, which allows creating end-user business rules that technically support the specific events, conditions and actions related to evacuation plans. An experimental validation was carried out where 32 people faced a simulated emergency situation, 16 of them using SASEP and the other 16 using a legacy system based on static signs. From the results obtained, we compare both techniques and discuss in which situations SASEP offers a better evacuation route option, confirming that it is highly valuable when there is a threat in the evacuation route. In addition, a study about user satisfaction using both systems is presented showing in which cases the systems are assessed as satisfactory, relevant and not frustrating. [ABSTRACT FROM AUTHOR]

During the last decades, consumer-grade RGB-D (red green blue-depth) cameras have gained popularity for several applications in agricultural environments. Interestingly, these cameras are used for spatial mapping that can serve for robot localization and navigation. Mapping the environment for targeted robotic applications in agricultural fields is a particularly challenging task, owing to the high spatial and temporal variability, the possible unfavorable light conditions, and the unpredictable nature of these environments. The aim of the present study was to investigate the use of RGB-D cameras and unmanned ground vehicle (UGV) for autonomously mapping the environment of commercial orchards as well as providing information about the tree height and canopy volume. The results from the ground-based mapping system were compared with the three-dimensional (3D) orthomosaics acquired by an unmanned aerial vehicle (UAV). Overall, both sensing methods led to similar height measurements, while the tree volume was more accurately calculated by RGB-D cameras, as the 3D point cloud captured by the ground system was far more detailed. Finally, fusion of the two datasets provided the most precise representation of the trees. [ABSTRACT FROM AUTHOR]

This paper discusses the challenge of modeling in-flight startle causality as a precursor to enabling the development of suitable mitigating flight training paradigms. The article presents an overview of aviation human factors and their depiction in fuzzy cognitive maps (FCMs), based on the Human Factors Analysis and Classification System (HFACS) framework. The approach exemplifies system modeling with agents (causal factors), which showcase the problem space's characteristics as fuzzy cognitive map elements (concepts). The FCM prototype enables four essential functions: explanatory, predictive, reflective, and strategic. This utility of fuzzy cognitive maps is due to their flexibility, objective representation, and effectiveness at capturing a broad understanding of a highly dynamic construct. Such dynamism is true of in-flight startle causality. On the other hand, FCMs can help to highlight potential distortions and limitations of use case representation to enhance future flight training paradigms. [ABSTRACT FROM AUTHOR]

Recently, more and more mobile devices have been connected to the Internet. The Internet environment is complicated, and network security incidents emerge endlessly. Traditional blocking and killing passive defense measures cannot fundamentally meet the network security requirements. Inspired by the heuristic establishment of multiple lines of defense in immunology, we designed and prototyped a Double Defense strategy with Endogenous Safety and Security (DDESS) based on multi-identifier network (MIN) architecture. DDESS adopts the idea of a zero-trust network, with identity authentication as the core for access control, which solves security problems of traditional IP networks. In addition, DDESS achieves individual static security defense through encryption and decryption, consortium blockchain, trusted computing whitelist, and remote attestation strategies. At the same time, with the dynamic collection of data traffic and access logs, as well as the understanding and prediction of the situation, DDESS can realize the situation awareness of network security and the cultivation of immune vaccines against unknown network attacks, thus achieving the active herd defense of network security. [ABSTRACT FROM AUTHOR]

In conditionally automated driving, the engagement of non-driving activities (NDAs) can be regarded as the main factor that affects the driver's take-over performance, the investigation of which is of great importance to the design of an intelligent human–machine interface for a safe and smooth control transition. This paper introduces a 3D convolutional neural network-based system to recognize six types of driver behaviour (four types of NDAs and two types of driving activities) through two video feeds based on head and hand movement. Based on the interaction of driver and object, the selected NDAs are divided into active mode and passive mode. The proposed recognition system achieves 85.87% accuracy for the classification of six activities. The impact of NDAs on the perspective of the driver's situation awareness and take-over quality in terms of both activity type and interaction mode is further investigated. The results show that at a similar level of achieved maximum lateral error, the engagement of NDAs demands more time for drivers to accomplish the control transition, especially for the active mode NDAs engagement, which is more mentally demanding and reduces drivers' sensitiveness to the driving situation change. Moreover, the haptic feedback torque from the steering wheel could help to reduce the time of the transition process, which can be regarded as a productive assistance system for the take-over process. [ABSTRACT FROM AUTHOR]

Achieving situation recognition in ubiquitous sensor networks (USNs) is an important issue that has been poorly addressed by both the research and practitioner communities. This paper describes some steps taken to address this issue by effecting USN middleware intelligence using an emerging situation awareness (ESA) technology. We propose a situation recognition framework where temporal probabilistic reasoning is used to derive and emerge situation awareness in ubiquitous sensor networks. Using data collected from an outdoor environment monitoring in the city of Cape Town, we illustrate the use of the ESA technology in terms of sensor system operating conditions and environmental situation recognition. [ABSTRACT FROM AUTHOR]

Driver situation awareness is critical for safety. In this paper, we propose a fast, accurate method for obtaining real-time situation awareness using a single type of sensor: monocular cameras. The system tracks the host vehicle's trajectory using sparse optical flow and tracks vehicles in the surrounding environment using convolutional neural networks. Optical flow is used to measure the linear and angular velocity of the host vehicle. The convolutional neural networks are used to measure target vehicles' positions relative to the host vehicle using image-based detections. Finally, the system fuses host and target vehicle trajectories in the world coordinate system using the velocity of the host vehicle and the target vehicles' relative positions with the aid of an Extended Kalman Filter (EKF). We implement and test our model quantitatively in simulation and qualitatively on real-world test video. The results show that the algorithm is superior to state-of-the-art sequential state estimation methods such as visual SLAM in performing accurate global localization and trajectory estimation for host and target vehicles. [ABSTRACT FROM AUTHOR]

Robotic salespeople are often ignored by people due to their weak social presence, and thus have difficulty facilitating sales autonomously. However, for robots that are remotely controlled by humans, there is a need for experienced and trained operators. In this paper, we suggest crowdsourcing to allow general users on the internet to operate a robot remotely and facilitate customers' purchasing activities while flexibly responding to various situations through a user interface. To implement this system, we examined how our developed remote interface can improve a robot's social presence while being controlled by a human operator, including first-time users. Therefore, we investigated the typical flow of a customer–robot interaction that was effective for sales promotion, and modeled it as a state transition with automatic functions by accessing the robot's sensor information. Furthermore, we created a user interface based on the model and examined whether it was effective in a real environment. Finally, we conducted experiments to examine whether the user interface could be operated by an amateur user and enhance the robot's social presence. The results revealed that our model was able to improve the robot's social presence and facilitate customers' purchasing activity even when the operator was a first-time user. [ABSTRACT FROM AUTHOR]

Situation awareness (SA) is crucial for safe driving. It is all about perception, comprehension of current situations and projection of the future status. It is demanding for drivers to constantly maintain SA by checking for potential hazards while performing the primary driving tasks. As vehicles in the future will be equipped with more sensors, it is likely that an SA aiding system will present complex situational information to drivers. Although drivers have difficulty to process a variety of complex situational information due to limited cognitive capabilities and perceive the information differently depending upon their cognitive states, the well-known SA design principles by Endsley only provide general guidelines. The principles lack detailed guidelines for dealing with limited human cognitive capabilities. Cognitive capability is a mental capability including planning, complex idea comprehension, and learning from experience. A cognitive state can be regarded as a condition of being (e.g., the state of being aware of the situation). In this paper, we investigate the key cognitive attributes related to SA in driving contexts (i.e., attention focus, mental model, workload, and memory). Endsley proposed that those key cognitive attributes are the main factors that influence SA. In those with higher levels of attributes, we found eight cognitive states which mainly influence a human driver in achieving SA. These are the focused attention state, inattentional blindness state, unfamiliar situation state, familiar situation state, insufficient mental resource state, sufficient mental resource state, high time pressure state, and low time pressure state. We then propose cognitive state aware SA design guidelines that can help designers to effectively convey situation information to drivers. As a case study, we demonstrated the usefulness of our cognitive state aware SA design guidelines by conducting controlled experiments where an existing SA interface is compared with a new SA interface designed following the key guidelines. We used the Situation Awareness Global Assessment Technique (SAGAT) and Decision-Making Questionnaire (DMQ) to measure the SA and decision-making style scores, respectively. Our results show that the new guidelines allowed participants to achieve significantly higher SA and exhibit better decision making performance. [ABSTRACT FROM AUTHOR]

Visual Patient technology is a situation awareness-oriented visualization technology that translates numerical and waveform patient monitoring data into a new user-centered visual language. Vital sign values are converted into colors, shapes, and rhythmic movements—a language humans can easily perceive and interpret—on a patient avatar model in real time. In this review, we summarize the current state of the research on the Visual Patient, including the technology, its history, and its scientific context. We also provide a summary of our primary research and a brief overview of research work on similar user-centered visualizations in medicine. In several computer-based studies under various experimental conditions, Visual Patient transferred more information per unit time, increased perceived diagnostic certainty, and lowered perceived workload. Eye tracking showed the technology worked because of the way it synthesizes and transforms vital sign information into new and logical forms corresponding to the real phenomena. The technology could be particularly useful for improving situation awareness in settings with high cognitive demand or when users must make quick decisions. This comprehensive review of Visual Patient research is the foundation for an evaluation of the technology in clinical applications, starting with a high-fidelity simulation study in early 2020. [ABSTRACT FROM AUTHOR]

Over the last decades, the development of navigation devices capable of guiding the blind through indoor and/or outdoor scenarios has remained a challenge. In this context, this paper's objective is to provide an updated, holistic view of this research, in order to enable developers to exploit the different aspects of its multidisciplinary nature. To that end, previous solutions will be briefly described and analyzed from a historical perspective, from the first "Electronic Travel Aids" and early research on sensory substitution or indoor/outdoor positioning, to recent systems based on artificial vision. Thereafter, user-centered design fundamentals are addressed, including the main points of criticism of previous approaches. Finally, several technological achievements are highlighted as they could underpin future feasible designs. In line with this, smartphones and wearables with built-in cameras will then be indicated as potentially feasible options with which to support state-of-art computer vision solutions, thus allowing for both the positioning and monitoring of the user's surrounding area. These functionalities could then be further boosted by means of remote resources, leading to cloud computing schemas or even remote sensing via urban infrastructure. [ABSTRACT FROM AUTHOR]