Search

Multimodal learning is a promising area in artificial intelligence (AI) that can make the model understand different kinds of data. Existing works are trying to re-train a new model based on pre-trained models that requires much data, computation power, and time. However, it is difficult to achieve in low-resource or small-sample situations. Therefore, we propose VL-Meta, Vision Language Models for Multimodal Meta Learning. It (1) presents the vision-language mapper and multimodal fusion mapper, which are light model structures, to use the existing pre-trained models to make models understand images to language feature space and save training data, computation power, and time; (2) constructs the meta-task pool that can only use a small amount of data to construct enough training data and improve the generalization of the model to learn the data knowledge and task knowledge; (3) proposes the token-level training that can align inputs with the outputs during training to improve the model performance; and (4) adopts the multi-task fusion loss to learn the different abilities for the models. It achieves a good performance on the Visual Question Answering (VQA) task, which shows the feasibility and effectiveness of the model. This solution can help blind or visually impaired individuals obtain visual information. [ABSTRACT FROM AUTHOR]

Cognitive Radio (CR) is a practical technique for overcoming spectrum inefficiencies by sensing and utilizing spectrum holes over a wide spectrum. In particular, cooperative spectrum sensing (CSS) determines the state of primary users (PUs) by cooperating with multiple secondary users (SUs) distributed around a Cognitive Radio Network (CRN), further overcoming various noise and fading issues in the radio environment. But it's still challenging to balance energy efficiency and good sensing performances in the existing CSS system, especially when the CRN consists of battery-limited sensors. This article investigates the application of machine learning technologies for cooperative spectrum sensing, especially through solving a multi-dimensional optimization that cannot be readily addressed by traditional approaches. Specifically, we develop a neural network, which involves parameters that are integral to the CSS performance, including a device sleeping rate for each sensor and thresholds used in the energy detection method, and a customized loss function based on the energy consumption of the CSS system and multiple penalty terms reflecting the system requirements. Using this formulation, energy consumption is to be minimized with the guarantee of reaching a certain probability of false alarm and detection in the CSS system. With the proposed method, comparison studies under different hard fusion rules ('OR' and 'AND') demonstrate its effectiveness in improving the CSS system performances, as well as its robustness in the face of changing global requirements. This paper also suggests the combination of the traditional and the proposed scheme to circumvent the respective inherent pitfalls of neural networks and the traditional semi-analytic methods. [ABSTRACT FROM AUTHOR]