Search

The realm of music composition, augmented by technological advancements such as computers and related equipment, has undergone significant evolution since the 1970s. In the field algorithmic composition, however, the incorporation of artificial intelligence (AI) in sound generation and combination has been limited. Existing approaches predominantly emphasize sound synthesis techniques, with no music composition systems currently employing Nicolas Slonimsky's theoretical framework. This article introduce NeuralPMG, a computer-assisted polyphonic music generation framework based on a Leap Motion (LM) device, machine learning (ML) algorithms, and brain-computer interface (BCI). ML algorithms are employed to classify user's mental states into two categories: focused and relaxed. Interaction with the LM device allows users to define a melodic pattern, which is elaborated in conjunction with the user's mental state as detected by the BCI to generate polyphonic music. NeuralPMG was evaluated through a user study that involved 19 students of Electronic Music Laboratory at a music conservatory, all of whom are active in the music composition field. The study encompassed a comprehensive analysis of participant interaction with NeuralPMG. The compositions they created during the study were also evaluated by two domain experts who addressed their aesthetics, innovativeness, elaboration level, practical applicability, and emotional impact. The findings indicate that NeuralPMG represents a promising tool, offering a simplified and expedited approach to music composition, and thus represents a valuable contribution to the field of algorithmic music composition. [ABSTRACT FROM AUTHOR]

Automation in computing systems has always been considered a valuable solution to unburden the user. Internet of Things (IoT) technology best suits automation in different domains, such as home automation, retail, industry, and transportation, to name but a few. While these domains are strongly characterized by implicit user interaction, more recently, automation has been adopted also for the provision of interactive and immersive experiences that actively involve the users. IoT technology thus becomes the key for Smart Interactive Experiences (SIEs), i.e., immersive automated experiences created by orchestrating different devices to enable smart environments to fluidly react to the final users' behavior. There are domains, e.g., cultural heritage, where these systems and the SIEs can support and provide several benefits. However, experts of such domains, while intrigued by the opportunity to induce SIEs, are facing tough challenges in their everyday work activities when they are required to automate and orchestrate IoT devices without the necessary coding skills. This paper presents a design approach that tries to overcome these difficulties thanks to the adoption of ontologies for defining Event-Condition-Action rules. More specifically, the approach enables domain experts to identify and specify properties of IoT devices through a user-defined semantics that, being closer to the domain experts' background, facilitates them in automating the IoT devices behavior. We also present a study comparing three different interaction paradigms conceived to support the specification of user-defined semantics through a "transparent" use of ontologies. Based on the results of this study, we work out some lessons learned on how the proposed paradigms help domain experts express their semantics, which in turn facilitates the creation of interactive applications enabling SIEs. [ABSTRACT FROM AUTHOR]

An introduction is presented in which the editor discusses articles in the issue on topics including ubiquitous and pervasive devices, embedded sensors, and hand gesture recognition.

The availability of different methods (and models) that support the design and evaluation of interactive systems raises a question about the transferability of such methods between application sectors and domains. The transferability refers to the selection and application of a method in a development context, qualifying it for the interactive system in hand. The transferability process should help to identify the main features of the new contexts of use, also taking into account that the system to be developed has to ensure universal access. Moreover, it should allow designers to capitalize on previous development experiences in a systematic way. In order to analyze some of the many challenges determined by the transfer process, this paper reports experiences of transferring a meta-design model, whose aim is to support the design of systems that enable people to perform end-user development activities. The model is further developed when applied in another application domain. A meta-design model can be used in a novel context supporting the design of systems for users performing development activities. Based on the reported experiences on active people involvement, hints for the transferability of any model are provided. People can actively contribute to system design, development and evolution overtime using the novel approach. [ABSTRACT FROM AUTHOR]

Interaction design of mobile systems is a complex activity because it requires considering new usability and user experience aspects in order to exploit the peculiar characteristics of mobile devices, such as their pervasive and ubiquitous nature. This paper discusses issues about designing, developing and evaluating mobile systems. Italy has a rich cultural heritage, and the focus in this study is on the design of systems that enable interactive exploration of historical sites, not only for enhancing the user experience but also for learning purposes. The experience of the researchers at the Interaction, Visualisation and Usability lab, University of Bari, Italy, in designing a mobile learning system, called Explore!, which supports young students learning ancient history during a visit to archaeological parks, is reported. The evaluation of Explore! through systematic field studies shows that the adopted approach is able to transform the visit to archaeological parks into a more complete and culturally rich experience. [ABSTRACT FROM AUTHOR]