Search

Playing music is a complex task that relies on the combination of musicians' technical and expressive skills. While the literature has investigated the effects of musical expressivity on the listeners, the way how technical difficulty and emotional expressivity affect musicians during playing has surprisingly received no attention. In an attempt to fill this gap in the literature, we collected behavioral and physiological data from twelve violinists playing 29 pieces that included both technical exercises and excerpts from classical repertoire for violin. After playing each stimulus, participants rated it for emotional expressivity and technical difficulty. During the entire session, cardiac parameters and electrodermal activity were collected, together with the kinematic parameters of the bowing gesture. A set of Linear Mixed-Effect (LME) models suggested that emotional expressivity attributed to music affected the fluidity of bowing (i.e., smoothness), with the excerpts rated as more expressive being performed in a less smooth way. In contrast, LME models revealed no effects of expressivity and technical difficulty on any of the physiological parameters of violinists. Our results offer novel insights into the psychophysiological dynamics that link motor parameters with musical expressivity. These findings could influence educational practices in music and deepen our understanding of aesthetic emotions. [ABSTRACT FROM AUTHOR]

Developmental coordination disorder (DCD) presents challenges in motor control. DCD affects tasks such as walking and running and is characterized by poor interlimb coordination and increased spatiotemporal variability compared to typically developing children (TDC). While auditory rhythm synchronization has shown to have benefits for gait performance in adults, its impact on children with DCD during walking and running remains unclear. This study investigated auditory–motor synchronization and interlimb coordination during walking and running in children with and without DCD. Twenty‐one DCD and 23 TDC participants aged 8−12 years walked and ran to two different auditory metronomes (discrete and continuous). Synchronization consistency was the primary outcome, with interlimb coordination and spatiotemporal variability as secondary outcomes. Results showed that children with DCD exhibited significantly lower synchronization consistency than TDC, particularly during running. The metronome structure did not influence synchronization ability. Additionally, interlimb coordination differed significantly between DCD and TDC during running and was not impacted by auditory–motor synchronization. Spatiotemporal variability was higher in DCD during both walking and running than in TDC, and accentuated during running. Variability of cadence was influenced by the use of continuous metronomes, which may offer potential benefits in reducing cadence variability. [ABSTRACT FROM AUTHOR]

Playing music is a complex task that relies on the combination of musicians’ technical and expressive skills. While the literature has investigated the effects of musical expressivity on the listeners, the way how technical difficulty and emotional expressivity affect musicians during playing has surprisingly received no attention. In an attempt to fill this gap in the literature, we collected behavioral and physiological data from twelve violinists playing 29 pieces that included both technical exercises and excerpts from classical repertoire for violin. After playing each stimulus, participants rated it for emotional expressivity and technical difficulty. During the entire session, cardiac parameters and electrodermal activity were collected, together with the kinematic parameters of the bowing gesture. A set of Linear Mixed-Effect (LME) models suggested that emotional expressivity attributed to music affected the fluidity of bowing (i.e., smoothness), with the excerpts rated as more expressive being performed in a less smooth way. In contrast, LME models revealed no effects of expressivity and technical difficulty on any of the physiological parameters of violinists. Our results offer novel insights into the psychophysiological dynamics that link motor parameters with musical expressivity. These findings could influence educational practices in music and deepen our understanding of aesthetic emotions. [ABSTRACT FROM AUTHOR]

Pupil size covaries with the diffusion rate of the cholinergic and noradrenergic neurons throughout the brain, which are essential to arousal. Recent findings suggest that slow pupil fluctuations during locomotion are an index of sustained activity in cholinergic axons, whereas phasic dilations are related to the activity of noradrenergic axons. Here, we investigated movement induced arousal (i.e., by singing and swaying to music), hypothesising that actively engaging in musical behaviour will provoke stronger emotional engagement in participants and lead to different qualitative patterns of tonic and phasic pupil activity. A challenge in the analysis of pupil data is the turbulent behaviour of pupil diameter due to exogenous ocular activity commonly encountered during motor tasks and the high variability typically found between individuals. To address this, we developed an algorithm that adaptively estimates and removes pupil responses to ocular events, as well as a functional data methodology, derived from Pfaffs' generalised arousal, that provides a new statistical dimension on how pupil data can be interpreted according to putative neuromodulatory signalling. We found that actively engaging in singing enhanced slow cholinergic‐related pupil dilations and having the opportunity to move your body while performing amplified the effect of singing on pupil activity. Phasic pupil oscillations during motor execution attenuated in time, which is often interpreted as a measure of sense of agency over movement. [ABSTRACT FROM AUTHOR]

In this perspective paper, we explore the use of haptic feedback to enhance human-human interaction during musical tasks. We start by providing an overview of the theoretical foundation that underpins our approach, which is rooted in the embodied music cognition framework, and by briefly presenting the concepts of action-perception loop, sensorimotor coupling and entrainment. Thereafter, we focus on the role of haptic information in music playing and we discuss the use of wearable technologies, namely lightweight exoskeletons, for the exchange of haptic information between humans. We present two experimental scenarios in which the effectiveness of this technology for enhancing musical interaction and learning might be validated. Finally, we briefly discuss some of the theoretical and pedagogical implications of the use of technologies for haptic communication in musical contexts, while also addressing the potential barriers to the widespread adoption of exoskeletons in such contexts. [ABSTRACT FROM AUTHOR]

Within the broader context of improving interactions between artificial intelligence and humans, the question has arisen regarding whether auditory and rhythmic support could increase attention for visual stimuli that do not stand out clearly from an information stream. To this end, we designed an experiment inspired by pip-and-pop but more appropriate for eliciting attention and P3a-event-related potentials (ERPs). In this study, the aim was to distinguish between targets and distractors based on the subject's electroencephalography (EEG) data. We achieved this objective by employing different machine learning (ML) methods for both individual-subject (IS) and cross-subject (CS) models. Finally, we investigated which EEG channels and time points were used by the model to make its predictions using saliency maps. We were able to successfully perform the aforementioned classification task for both the IS and CS scenarios, reaching classification accuracies up to 76%. In accordance with the literature, the model primarily used the parietal–occipital electrodes between 200 ms and 300 ms after the stimulus to make its prediction. The findings from this research contribute to the development of more effective P300-based brain–computer interfaces. Furthermore, they validate the EEG data collected in our experiment. [ABSTRACT FROM AUTHOR]

Emerging technologies in the domain of mixed reality offer rich, new possibilities for the study and practice of joint music performance. Apart from the technological challenges, bringing music players together in mixed reality raises important questions on their performance and embodied coordination. In this study, we designed a mixed reality platform to assess a remote, bidirectional polyrhythmic interaction between two players, mediated in real time by their three-dimensional embodied avatars and a shared, virtual 'drum circle'. We leveraged a multi-layered analysis framework to assess their performance quality, embodied coregulation and first-person interaction experience, using statistical techniques for timeseries analysis and mixed-effect regression and focusing on contrasts of visual coupling (not seeing / seeing as avatars / seeing as real) and auditory context (metronome / music). Results reveal that an auditory context with music improved the performance output as measured by a prediction error, increased movement energy and levels of experienced agency. Visual coupling impacted experiential qualities and induced prosocial effects with increased levels of partner realism resulting in increased levels of shared agency and self-other merging. Embodied coregulation between players was impacted by auditory context and visual coupling, suggesting prediction-based compensatory mechanisms to deal with the novelty, difficulty, and expressivity in the musical interaction. This study contributes to the understanding of music performance in mixed reality by using a methodological approach to demonstrate how coregulation between players is impacted by visual coupling and auditory context and provides a basis and future directions for further action-oriented research. [ABSTRACT FROM AUTHOR]

Music performance requires high levels of motor control. Professional musicians use body movements not only to accomplish and help technical efficiency, but to shape expressive interpretation. Here, we recorded motion and audio data of twenty participants performing four musical fragments varying in the degree of technical difficulty to analyze how knee flexion is employed by expert saxophone players. Using a computational model of the auditory periphery, we extracted emergent acoustical properties of sound to inference critical cognitive patterns of music processing and relate them to motion data. Results showed that knee flexion is causally linked to tone expectations and correlated to rhythmical density, suggesting that this gesture is associated with expressive and facilitative purposes. Furthermore, when instructed to play immobile, participants tended to microflex (>1 Hz) more frequently compared to when playing expressively, possibly indicating a natural urge to move to the music. These results underline the robustness of body movement in musical performance, providing valuable insights for the understanding of communicative processes, and development of motor learning cues. [ABSTRACT FROM AUTHOR]

Several studies have addressed motor coordination in dance, but few have addressed the influence of musical context on micro-timing during sensorimotor synchronization (SMS) in classical ballet. In this study, we analyze the Promenade in Arabesque of the Odile variations, first as a dance-music fragment non-embedded in a musical context, then as a dance-music fragment embedded in a musical context at two different instances. Given the musical structure of the fragments, there are repeats of patterns between and within the fragments. Four dancers were invited to perform the three fragments in twelve successive performances. The beats of the music were extracted and compared with the timing of the dancers' heel movements, using circular-linear smooth regression modelling, and circular statistics. The results reveal an effect of repeat within fragments, and an effect of musical context between fragments, on micro-timing anticipation in SMS. The methodology offers a framework for future work on dynamical aspects of SMS. [ABSTRACT FROM AUTHOR]

This correction notice for the article "Expressivity attributed to music affects the smoothness of bowing movements in violinists" acknowledges the incomplete Acknowledgements section in the original version. The authors express gratitude to the violinists who participated in the study and acknowledge support from various funding sources, including the H2020/ICT European project and the National Recovery and Resilience Plan. The corrected article is authored by Nicola Di Stefano, Daniela Lo Presti, Luigi Raiano, Carlo Massaroni, Chiara Romano, Emiliano Schena, Marc Leman, and Domenico Formica. [Extracted from the article]

Given the prevalence of motor and cognitive functions in persons with multiple sclerosis (PwMS), we proposed that the theoretical framework of embodiment could provide a rehabilitation avenue to train these functions as one functional unit. PwMS (n = 31) and age‐ and gender‐matched healthy controls (n = 30) underwent an embodied learning protocol. This involved learning a cognitive sequence while performing it through bodily stepping movement under three feedback conditions (melody, sound, and visual). Cognitive and movement performance was assessed by a delayed recall 15 min after undergoing the embodied learning protocol. Half of participants correctly recalled the sequence in all three conditions, while 70% of healthy controls achieved correct recall within the melody condition. Balance impairment predicted the speed of executing the sequence irrespective of learning, most apparent in the melody condition. Information processing speed predicted the speed of executing the sequence in the melody and sound conditions between participants as well as over time. Those who learned performed the sequence faster in the melody condition only and overall were faster over time. We propose how embodied learning could expand the current context of rehabilitation of cognitive and motor control in PwMS. [ABSTRACT FROM AUTHOR]

In a century where humans and machines—powered by artificial intelligence or not—increasingly work together, it is of interest to understand human processing of multi-sensory stimuli in relation to attention and working memory. This paper explores whether and when supporting visual information with rhythmic auditory stimuli can optimize multi-sensory information processing. In turn, this can make the interaction between humans or between machines and humans more engaging, rewarding and activating. For this purpose a novel working memory paradigm was developed where participants are presented with a series of five target digits randomly interchanged with five distractor digits. Their goal is to remember the target digits and recall them orally. Depending on the condition support is provided by audio and/or rhythm. It is expected that the sound will lead to a better performance. It is also expected that this effect of sound is different in case of rhythmic and non-rhythmic sound. Last but not least, some variability is expected across participants. To make correct conclusions, the data of the experiment was statistically analyzed in a classic way, but also predictive models were developed in order to predict outcomes based on a range of input variables related to the experiment and the participant. The effect of auditory support could be confirmed, but no difference was observed between rhythmic and non-rhythmic sounds. Overall performance was indeed affected by individual differences, such as visual dominance or perceived task difficulty. Surprisingly a music education did not significantly affect the performance and even tended toward a negative effect. To better understand the underlying processes of attention, also brain activation data, e.g., by means of electroencephalography (EEG), should be recorded. This approach can be subject to a future work. [ABSTRACT FROM AUTHOR]

Background: Running retraining with the use of biofeedback on an impact measure has been executed or evaluated in the biomechanics laboratory. Here, the execution and evaluation of feedback-driven retraining are taken out of the laboratory. Purpose: To determine whether biofeedback can reduce the peak tibial acceleration with or without affecting the running cadence in a 3-week retraining protocol. Study Design: Quasi-randomized controlled trial. Methods: Twenty runners with high peak tibial acceleration were allocated to either the retraining (n = 10, 32.1 ± 7.8 years, 10.9 ± 2.8 g) or control (n = 10, 39.1 ± 10.4 years, 13.0 ± 3.9 g) groups. They performed six running sessions in an athletic training environment. A body-worn system collected axial tibial acceleration and provided real-time feedback. The retraining group received music-based biofeedback in a faded feedback scheme. Pink noise was superimposed on tempo-synchronized music when the peak tibial acceleration was ≥70% of the runner's baseline. The control group received tempo-synchronized music, which acted as a placebo for blinding purposes. Speed feedback was provided to obtain a stable running speed of ~2.9 m·s−1. Peak tibial acceleration and running cadence were evaluated. Results: A significant group-by- feedback interaction effect was detected for peak tibial acceleration. The experimental group had a decrease in peak tibial acceleration by 25.5% (mean: 10.9 ± 2.8 g versus 8.1 ± 3.9 g, p = 0.008, d = 1.08, mean difference = 2.77 [0.94, 4.61]) without changing the running cadence. The control group had no statistically significant change in peak tibial acceleration nor in running cadence. Conclusion: The retraining protocol was effective at reducing the peak tibial acceleration in high-impact runners by reacting to music-based biofeedback that was provided in real time per wearable technology in a training environment. This reduction magnitude may have meaningful influences on injury risk. [ABSTRACT FROM AUTHOR]

This study assessed the centre of pressure (COP) behaviour and the relationship with impact severity during heel-toe running in conventional athletic footwear. We hypothesized that the COP behaviour depends on its location at foot strike, which would be associated with the vertical loading rate and peak tibial accelerations in heel-toe running. Ground reaction force and tibial acceleration were measured in 104 distance runners running level at ~3.2 m/s. High-speed plantar pressure captured at high temporal resolution (500 Hz) and spatial resolution (7.62 · 5.08 mm/sensor) allowed for localization of the COP directly in the footprint during running in self-selected athletic footwear. More lateral X-coordinates of the COP at first foot contact had, in general, more anterior Y-coordinates (adj.R2:0.609). In heel-toe running, a more anterior foot strike had a greater refined strike index, which was associated with a quicker roll-over in the rearfoot zone. This strike index contributed to greater maximum vertical loading rates (R2:0.121), and greater axial (R2:0.047) and resultant (R2:0.247) peak tibial accelerations. These findings indicate that (1) the COP progression is dependend on the COP location at foot strike; (2) more anterior rearfoot strikes are more likely to have greater impact severity than posterior rearfoot strikes. [ABSTRACT FROM AUTHOR]

Background: In a case report of a progressive multiple sclerosis with cerebellar impairments, we reported that synchronisation of steps to beats was possible only at −12% of usual walking cadence during 1 minute of walking. Objectives and methods: Here, we investigate the effect of synchronisation using two different alignment approaches on the patient's gait pattern over 2 minutes of walking, compared to walking in silence. Results and conclusion: This proof of concept showed that the adaptive approach was successful resulting in an improved gait pattern compared to the other conditions, providing preliminary evidence to support a full-scale intervention study. [ABSTRACT FROM AUTHOR]

Life and social sciences often focus on the social nature of music (and language alike). In biology, for example, the three main evolutionary hypotheses about music (i.e., sexual selection, parent-infant bond, and group cohesion) stress its intrinsically social character (Honing et al., 2015). Neurobiology thereby has investigated the neuronal and hormonal underpinnings of musicality for more than two decades (Chanda and Levitin, 2013; Salimpoor et al., 2015; Mehr et al., 2019). In line with these approaches, the present paper aims to suggest that the proper way to capture the social interactive nature of music (and, before it, musicality), is to conceive of it as an embodied language, rooted in culturally adapted brain structures (Clarke et al., 2015; D'Ausilio et al., 2015). This proposal heeds Ian Cross' call for an investigation of music as an "interactive communicative process" rather than "a manifestation of patterns in sound" (Cross, 2014), with an emphasis on its embodied and predictive (coding) aspects (Clark, 2016; Leman, 2016; Koelsch et al., 2019). In the present paper our goal is: (i) to propose a framework of music as embodied language based on a review of the major concepts that define joint musical action, with a particular emphasis on embodied music cognition and predictive processing, along with some relevant neural underpinnings; (ii) to summarize three experiments conducted in our laboratories (and recently published), which provide evidence for, and can be interpreted according to, the new conceptual framework. In doing so, we draw on both cognitive musicology and neuroscience to outline a comprehensive framework of musical interaction, exploring several aspects of making music in dyads, from a very basic proto-musical action, like tapping, to more sophisticated contexts, like playing a jazz standard and singing a hocket melody. Our framework combines embodied and predictive features, revolving around the concept of joint agency (Pacherie, 2012; Keller et al., 2016; Bolt and Loehr, 2017). If social interaction is the "default mode" by which human brains communicate with their environment (Hari et al., 2015), music and musicality conceived of as an embodied language may arguably provide a route toward its navigation. [ABSTRACT FROM AUTHOR]

Understanding rhythmic behavior in the context of coupled auditory and motor systems has been of interest to neurological rehabilitation, in particular, to facilitate walking. Recent work based on behavioral measures revealed an entrainment effect of auditory rhythms on motor rhythms. In this study, we propose a method to compute the neural component of such a process from an electroencephalographic (EEG) signal. A simple auditory-motor synchronization paradigm was used, where 28 healthy participants were instructed to synchronize their finger-tapping with a metronome. The computation of the neural outcome measure was carried out in two blocks. In the first block, we used Generalized Eigendecomposition (GED) to reduce the data dimensionality to the component which maximally entrained to the metronome frequency. The scalp topography pointed at brain activity over contralateral sensorimotor regions. In the second block, we computed instantaneous frequency from the analytic signal of the extracted component. This returned a time-varying measure of frequency fluctuations, whose standard deviation provided our " stability index " as a neural outcome measure of auditory-motor coupling. Finally, the proposed neural measure was validated by conducting a correlation analysis with a set of behavioral outcomes from the synchronization task: resultant vector length, relative phase angle, mean asynchrony, and tempo matching. Significant moderate negative correlations were found with the first three measures, suggesting that the stability index provided a quantifiable neural outcome measure of entrainment, with selectivity towards phase-correction mechanisms. We address further adoption of the proposed approach, especially with populations where sensorimotor abilities are compromised by an underlying pathological condition. The impact of using stability index can potentially be used as an outcome measure to assess rehabilitation protocols, and possibly provide further insight into neuropathological models of auditory-motor coupling. [ABSTRACT FROM AUTHOR]

Musical life became disrupted in 2020 due to the COVID-19 pandemic. Many musicians and venues turned to online alternatives, such as livestreaming. In this study, three livestreamed concerts were organized to examine separate, yet interconnected concepts—agency, presence, and social context—to ascertain which components of livestreamed concerts facilitate social connectedness. Hierarchical Bayesian modeling was conducted on 83 complete responses to examine the effects of the manipulations on feelings of social connectedness with the artist and the audience. Results showed that in concert 1, where half of the participants were allowed to vote for the final song to be played, this option did not result in the experience of more agency. Instead, if their preferred song was played (regardless of voting ability) participants experienced greater connectedness to the artist. In concert 2, participants who attended the concert with virtual reality headsets experienced greater feelings of physical presence, as well as greater feelings of connectedness with the artist, than those that viewed a normal YouTube livestream. In concert 3, attendance through Zoom led to greater experience of social presence, but predicted less connectedness with the artist, compared to a normal YouTube livestream. Crucially, a greater negative impact of COVID-19 (e.g., loneliness) predicted feelings of connectedness with the artist, possibly because participants fulfilled their social needs with this parasocial interaction. Examining data from all concerts suggested that physical presence was a predictor of connectedness with both the artist and the audience, while social presence only predicted connectedness with the audience. Correlational analyses revealed that reductions in loneliness and isolation were associated with feelings of shared agency, physical and social presence, and connectedness to the audience. Overall, the findings suggest that in order to reduce feelings of loneliness and increase connectedness, concert organizers and musicians could tune elements of their livestreams to facilitate feelings of physical and social presence. [ABSTRACT FROM AUTHOR]

Taking regular walks when living with Parkinson's disease (PD) has beneficial effects on movement and quality of life. Yet, patients usually show reduced physical activity compared to healthy older adults. Using auditory stimulation such as music can facilitate walking but patients vary significantly in their response. An individualized approach adapting musical tempo to patients' gait cadence, and capitalizing on these individual differences, is likely to provide a rewarding experience, increasing motivation for walk-in PD. We aim to evaluate the observance, safety, tolerance, usability, and enjoyment of a new smartphone application. It was coupled with wearable sensors (BeatWalk) and delivered individualized musical stimulation for gait auto-rehabilitation at home. Forty-five patients with PD underwent a 1-month, outdoor, uncontrolled gait rehabilitation program, using the BeatWalk application (30 min/day, 5 days/week). The music tempo was being aligned in real-time to patients' gait cadence in a way that could foster an increase up to +10% of their spontaneous cadence. Open-label evaluation was based on BeatWalk use measures, questionnaires, and a six-minute walk test. Patients used the application 78.8% (±28.2) of the prescribed duration and enjoyed it throughout the program. The application was considered "easy to use" by 75% of the patients. Pain, fatigue, and falls did not increase. Fear of falling decreased and quality of life improved. After the program, patients improved their gait parameters in the six-minute walk test without musical stimulation. BeatWalk is an easy to use, safe, and enjoyable musical application for individualized gait rehabilitation in PD. It increases "walk for exercise" duration thanks to high observance. Clinical Trial Registration : ClinicalTrials.gov Identifier: NCT02647242. [ABSTRACT FROM AUTHOR]

Co-regulated timing in a music ensemble rests on the human capacity to coordinate actions in time. Here we explore the hypothesis that humans predict timing constancy in coordinated actions, in view of timing their own actions in line with the others. An algorithm (BListener) is presented that predicts timing constancy, using Bayesian inference about incoming timing data from the music ensemble. The algorithm is then applied to a timing analysis of real data, first, to a choir consisting of four singers, then, to a dataset containing performances of duet singers. Global features of timing constancy, such as fluctuation and stability, correlate with human subjective estimates of the music ensembles' quality and associated experienced agency. In future work, BListener could serve as component in an artificial musician that plays along with human musicians in a music ensemble. [ABSTRACT FROM AUTHOR]

Balance and gait impairments are highly prevalent in the neurological population. Although current rehabilitation strategies focus on motor learning principles, it is of interest to expand into embodied sensori-motor learning; that is learning through a continuous interaction between cognitive and motor systems, within an enriched sensory environment. Current developments in engineering allow for the development of enriched sensory environments through interactive feedback. The Augmented Movement Platform for Embodied Learning (AMPEL) was developed, both in terms of hardware and software by an inter-disciplinary circular participatory design strategy. The developed device was then tested for in-between session reliability for the outcome measures inter-step interval and total onset time. Ten healthy participants walked in four experimental paths on the device in two different sessions, and between session correlations were calculated. AMPEL was developed both in terms of software and hardware, with three Plug-In systems (auditory, visual, auditory + visual). The auditory Plug-In allows for flexible application of augmented feedback. The in-between session reliability of the outcomes measured by the system were between high and very high on all 4 walked paths, tested on ten healthy participants [mean age 41.8 ± 18.5; BMI 24.8 ± 6.1]. AMPEL shows full functionality, and has shown between session reliability for the measures of inter-step-intervals and total-onset-time in healthy controls during walking on different paths. [ABSTRACT FROM AUTHOR]

Methods to reduce impact in distance runners have been proposed based on real-time auditory feedback of tibial acceleration. These methods were developed using treadmill running. In this study, we extend these methods to a more natural environment with a proof-of-concept. We selected ten runners with high tibial shock. They used a music-based biofeedback system with headphones in a running session on an athletic track. The feedback consisted of music superimposed with noise coupled to tibial shock. The music was automatically synchronized to the running cadence. The level of noise could be reduced by reducing the momentary level of tibial shock, thereby providing a more pleasant listening experience. The running speed was controlled between the condition without biofeedback and the condition of biofeedback. The results show that tibial shock decreased by 27% or 2.96 g without guided instructions on gait modification in the biofeedback condition. The reduction in tibial shock did not result in a clear increase in the running cadence. The results indicate that a wearable biofeedback system aids in shock reduction during over-ground running. This paves the way to evaluate and retrain runners in over-ground running programs that target running with less impact through instantaneous auditory feedback on tibial shock. [ABSTRACT FROM AUTHOR]

We argue that current cultural developments, driven by innovative technology, call for a reconsideration of the role of humanities as a field of study in which art and science is tightly integrated. This integration would allow the humanities to develop a proactive power such that it can (co-)steer the innovative developments of the techno-culture. Integrated art-science research may be realized in contexts where human expressive interaction with multimedia is investigated. Research outcomes from this domain may offer opportunities for humanities to contribute to cultural developments. Given the context of interactive multimedia, we offer a theoretical framework based on art-science research concerning: (1) human interaction, (2) interaction systems, and (3) cultural and societal interaction outcomes. The goal of the framework is to contribute to a new ambition for the humanities, one in which knowledge about culture, on top of being reflective, critical, and descriptive, has an intrinsic power to contribute to innovative techno-cultural developments. [ABSTRACT FROM AUTHOR]

In persons with multiple sclerosis (PwMS), synchronizing walking to auditory stimuli such as to music and metronomes have been shown to be feasible, and positive clinical effects have been reported on step frequency and perception of fatigue. Yet, the dynamic interaction during the process of synchronization, such as the coupling of the steps to the beat intervals in music and metronomes, and at different tempi remain unknown. Understanding these interactions are clinically relevant, as it reflects the pattern of step intervals over time, known as gait dynamics. 28 PwMS and 29 healthy controls were instructed to walk to music and metronomes at 6 tempi (0–10% in increments of 2%). Detrended fluctuation analysis was applied to calculate the fractal statistical properties of the gait time-series to quantify gait dynamics by the outcome measure alpha. The results showed no group differences, but significantly higher alpha when walking to music compared to metronomes, and when walking to both stimuli at tempi + 8, + 10% compared to lower tempi. These observations suggest that the precision and adaptation gain differ during the coupling of the steps to beats in music compared to metronomes (continuous compared to discrete auditory structures) and at different tempi (different inter-beat-intervals). [ABSTRACT FROM AUTHOR]

Music is believed to work as a bio-social tool enabling groups of people to establish joint action and group bonding experiences. However, little is known about the quality of the group members' interaction needed to bring about these effects. To investigate the role of interaction quality, and its effect on joint action and bonding experience, we asked dyads (two singers) to perform music in medieval "hocket" style, in order to engage their co-regulatory activity. The music contained three relative inter-onset-interval (IOI) classes: quarter note, dotted quarter note and eight note, marking time intervals between successive onsets (generated by both singers). We hypothesized that singers co-regulated their activity by minimizing prediction errors in view of stable IOI-classes. Prediction errors were measured using a dynamic Bayesian inference approach that allows us to identify three different types of error called fluctuation (micro-timing errors measured in milliseconds), narration (omission errors or misattribution of an IOI to a wrong IOI class), and collapse errors (macro-timing errors that cause the breakdown of a performance). These three types of errors were correlated with the singers' estimated quality of the performance and the experienced sense of joint agency. We let the singers perform either while moving or standing still, under the hypothesis that the moving condition would have reduced timing errors and increased We-agency as opposed to Shared-agency (the former portraying a condition in which the performers blend into one another, the latter portraying a joint, but distinct, control of the performance). The results show that estimated quality correlates with fluctuation and narration errors, while agency correlates (to a lesser degree) with narration errors. Somewhat unexpectedly, there was a minor effect of movement, and it was beneficial only for good performers. Joint agency resulted in a "shared," rather than a "we," sense of joint agency. The methodology and findings open up promising avenues for future research on social embodied music interaction. [ABSTRACT FROM AUTHOR]

For centuries, wood, and more specifically spruce, has been the material of choice for violin top plates. Lately, carbon fiber instruments have entered the market. Some studies show that composite materials have potential advantages for making instruments [Damodaran, Lessard, and Babu, Acoust. Aust. 43, 117–122 (2015)]. However, no studies exist that evaluate violins made of different composite materials as judged by listeners. For this study, six prototype violins, differing only by the material of the top plate, were manufactured in a controlled laboratory setting. The six prototype violins were judged by experienced listeners in two double-blind experiments. In contrast to popular opinion that violins made from carbon have or lack a specific sound quality, the study provides insights in the diverse sounds and timbres violins from fiber-reinforced polymers can create. It allows an investigation of the links between the perception and the variations in material properties of the soundboards. Additionally, as neither players nor listeners are acquainted with these instruments, these results provide an interesting view on what type of qualities of violin-like sounds are preferred by listeners. [ABSTRACT FROM AUTHOR]

The design of urban public spaces is typically performed by architects and urban planners, which often only focus on the visual aesthetics of the urban space. Yet, a visually pleasing public open space designed for relaxing will be underused if it sounds unpleasant. Ideally, sonic design should be integrated with visual design, a need the soundscape approach answers. The current trend of co-creating the urban space together with all stakeholders, including local residents, opens up new opportunities to account for all senses in the urban design process. Unfortunately, architects and urban planners struggle to incorporate the soundscape approach in the urban design process and to use it in the context of co-creation. In this work, a hackathon is proposed to generate creative concepts, methods and tools to co-create the urban public space. A soundscape hackathon was organized in the spring of 2019. Participants were challenged to apply their own immersive approaches or virtual and/or augmented reality solutions on selected urban soundscapes. They presented their results to colleagues in the field and to a professional jury. This paper describes the process and results of the event and shows that a hackathon is a viable approach to accelerate the co-creation of the urban public space. [ABSTRACT FROM AUTHOR]

Real-time auditory feedback during sports activities is becoming increasingly popular in view of opportunities for monitoring and movement (re)training in ecological environments. However, the design of an effective feedback strategy is difficult. In this paper, we present a methodical approach to the design of an auditory feedback strategy for running gait modification of recreational runners, using distortion of a musical baseline. First tests were conducted to select the best performing auditory distortion signal in terms of clarity and level perception, and to derive the relative perception curve. This was found to be pink noise with an exponential response curve. Further tests were carried out to determine the just noticeable difference of this signal in actual running conditions. Finally, validation tests were performed to examine if the real-time auditory biofeedback, combined with music, could alter the runner's steps per minute (SPM) during treadmill-based running. The results show that our sonification strategy can alter the mean running SPM in a clear and non-disturbing way, and that our noise-based continuous feedback approach performs better than standard verbal instructions. Even though some of the participants did not respond effectively to the feedback, a large majority of the participants rated the feedback system as pleasant and indicated that they would use such system to improve their running style. [ABSTRACT FROM AUTHOR]

Running with musical accompaniment is becoming increasingly popular and several pieces of software have been developed that match the music tempo to the exerciser's running cadence, that is, foot strikes per minute. Synchronizing music with running cadence has been shown to affect several aspects of performance output and perception. The purpose of this study was to investigate the effect of synchronous music on runners' foot impact loading. This represents the ground reaction force on the runner's lower leg when the foot impacts the ground and is an important parameter for the prevention of tibial fracture injuries. Twenty-eight participants ran five times for three minutes and 30 seconds with a short break between each run. During the first 30 seconds of each running sequence, participants ran at a self-paced tempo without musical accompaniment, and running speed and cadence were measured. Subsequently, they were requested to keep their reference speed constant for the following three minutes, with the help of three monitoring screens placed along the track. During this part of the experiment, the music was either absent (No Music), matched to the runner's cadence (Tempo-entrained Sync), phase-locked with foot strikes (Phase-locked Sync), or played at a tempo 30% slower (Minus 30%) or faster (Plus 30%) than the initially measured running cadence. No significant differences between synchronous and asynchronous music were retrieved for impact loading. However, a non-negligible average increase of impact level could be observed for running sessions with music compared to running in silence. These findings might be especially relevant for treatment purposes, such as exercise prescription and gait retraining, and should be taken into account when designing musical (re-)training programmes. [ABSTRACT FROM AUTHOR]

In this article Conversation Analysis is used to explore the way that conductors give feedback in choir rehearsals through the use of assessments and directives. Assessments and directives have previously been investigated in some forms of music teaching and rehearsing, although not in choir rehearsals. There is also a paucity of research on the methods by which a conductor may give feedback following an episode of singing by the choir. This analysis is based on 19 hours of choir rehearsal data, involving eight choirs and nine conductors. We show that conductors' feedback turns typically consist of two particular communicative behaviours: assessments and directives, either occurring singly or in various combinations. Assessments explicitly evaluate (positively or negatively) the just-produced singing of the choir, and directives explicitly tell the choir something about how members should sing in the future. However, the data reveal that assessments can also function implicitly to direct how the choir should sing, and directives can implicitly evaluate singing. Assessments and directives can be done in depicted forms (e.g., using sung vocalisations and gestures), as well as verbal descriptive forms. These findings highlight the distinctive ways that conductors produce feedback within rehearsals and some of the particular inferences that choir members must draw on to understand this feedback, as well as how change and improvement in the choir's singing may be affected on a turn-by-turn basis. [ABSTRACT FROM AUTHOR]

This article describes how aesthetic enjoyment accompanying musical activities can empower individuals in health and disease. First, we explain the biological determinants of music enjoyment and how they can be studied. In doing so, we distinguish between core sensory pleasure and conscious liking, and we illustrate their respective contributions to aesthetic appreciation and expressive interaction with music. Second, we review findings illustrating the long-term impact of listening to favourite music on the brains of healthy musicians as well as on the brains and behaviour of individuals with pathological symptoms. Based on these findings, we propose a set of putative neural mechanisms underlying aesthetic empowerment through music. We also emphasize the importance of considering individual differences in sensitivity to aesthetic experiences of music, as evidenced, for instance, by neuroimaging and imaging genetics studies, drawing the connections between dopamine neurotransmission and dopaminergic genes with the reactivity of music–brain functions. [ABSTRACT FROM AUTHOR]

Two complementary aspects of interpersonal entrainment – synchronization and movement coordination – are explored in North Indian classical instrumental music, in the auditory and visual domains respectively. Sensorimotor synchronization (SMS) is explored by analysing pairwise asynchronies between the event onsets of instrumental soloists and their tabla accompanists, and the variability of asynchrony by factors including tempo, dynamic level and metrical position is explored. Movement coordination is quantified using cross wavelet transform (CWT) analysis of upper body movement data, and differences in CWT Energy are investigated in relation to the metrical and cadential structures of the music. The analysis demonstrates that SMS within this corpus varies significantly with tempo, event density, peak levels and leadership. Effects of metrical position on pairwise asynchrony are small and offer little support for the hypothesis of lower variability in synchronization on strong metrical positions; a larger difference was found at cadential downbeats, which show increased melody lead. Movement coordination is greater at metrical boundaries than elsewhere, and most strikingly is greater at cadential than at other metrical downbeats. The implications of these findings for understanding performer coordination are discussed in relation to ethnographic research on the genre. [ABSTRACT FROM AUTHOR]

Sensorimotor integration tasks, such as body movements in time with music, can foster the experience of flow – a pleasurable state of full engagement and concentration occurring during a seemingly effortless and automatic activity. As it can be argued that both music and flow are embodied phenomena, perception-action coupling might be the core of the intimate relationship between flow and music. The current study examines the relationship between the subjective experience of flow and sensorimotor synchronization accuracy/stability in a finger-tapping task with music. In a between-subjects design, participants tapped in time with the beat of music clips with either low, medium, or high rhythmic complexity. After the tapping task, they rated their flow state on the Flow Short Scale with the two subscales fluency of performance and absorption by activity. Tapping accuracy and stability were assessed by the circular variance and the SD of inter-tap-intervals (ITIs), respectively. Both tapping accuracy and stability were significantly correlated with fluency of performance for music clips with medium and high rhythmic complexity, but not for music clips with low rhythmic complexity. No significant correlations were found between tapping accuracy/stability and absorption by activity. The findings add to evidence that perception-action coupling plays a key role in explaining the relationship between flow experience and musical activities. They also suggest that absorption by activity is not as relevant to the experience of flow during musical activities as one might initially assume. [ABSTRACT FROM AUTHOR]

In this study, we assumed that correct functional movements for weightlifting can be learned with the help of a music-based biofeedback system. We compared musical feedback with verbal feedback from experienced trainers using two independent groups. The focus was on one specific movement called deadlift. Physical parameters under considerations were the spine (i.e. loss of midline stability resulting in flexion) and the forward displacement of the barbell during the repetitions relative to the mid-foot. We recruited 31 recreational weight lifters (21-42 years of age). Results revealed that both feedback types are effective in improving the movements for deadlift. No significant differences were found across the two feedback types, neither in terms of movement, nor in terms of clarity and motivation. The results suggest that the proposed feedback system is a valid tool for technology-aided training and self-training practices. [ABSTRACT FROM AUTHOR]

Evidence for using auditory–motor coupling in neurological rehabilitation to facilitate walking is increasing. However, the distinction between spontaneous and intended coupling and its underlying mechanisms is yet to be investigated. In this study, we include 30 persons with multiple sclerosis and 30 healthy controls (HCs) in an experiment with two sessions in which participants were asked to walk to music with various tempi, matching their preferred walking cadence (PWC) up to 10% above in incremental steps of 2%. In the first session, no instructions were given to synchronize. In the second, participants were instructed to synchronize steps to the beats. Spontaneous synchronization was possible at 0% and +2% of the PWC, and fewer persons with multiple sclerosis were able to do so compared with HCs. Instruction was needed to synchronize at above +2% tempo in all participants. In the instructed session, the +6% condition marked a cutoff for cognitively impaired persons, as they were no longer able to synchronize. Based on our findings, we constructed a model illustrating that spontaneous entrainment is limited, operating during spontaneous coupling at only 0% and +2% of the PWC, and that at a higher tempo, entrainment requires intentional synchronization, with an active cognitive control mechanism. [ABSTRACT FROM AUTHOR]

In expressive music performance, tempo is known to be a fundamental parameter. In this article, we explored effects of changes in musical tempo on performers' movement articulations. Eight duos (piano – violin) played two pieces at a predefined tempo, after which this start tempo was gradually increased and decreased. Throughout the different performances, we measured acceleration of the violinists' head and right wrist, together with the downward force applied by their body to the ground surface. We calculated periodicities in downward force using fast Fourier transform (FFT) analyses and tested whether differences occurred across different tempi. Also, we clustered acceleration and force patterns across different tempi using self-organizing maps (SOMs) and k-means clustering. The results show that a continuous change in performance tempo leads to distinct "performance states" with characteristic bodily behavior in terms of periodic body movement and co-articulated gestures, which supports theories of tempo-variant motor control. [ABSTRACT FROM AUTHOR]

The use of music and specifically tempo-matched music has been shown to affect running performance. But can we maximize the synchronization of movements to music and does maximum synchronization influence kinematics and motivation? In this study, we explore the effect of different types of music-to-movement alignment strategies on phase coherence, cadence and motivation. These strategies were compared to a control condition where the music tempo was deliberately not aligned to the running cadence. Results show that without relative phase alignment, a negative mean asynchrony (NMA) of footfall timings with respect to the beats is obtained. This means that footfalls occurred slightly before the beat and that beats were anticipated. Convergence towards this NMA or preferred relative phase angle was facilitated when the first music beat of a new song started close to the step, which means that entrainment occurred. The results also show that using tempo and phase alignment, the relative phase can be manipulated or forced in a certain angle with a high degree of accuracy. Ensuring negative angles larger than NMA (step before beat) results in increased motivation and decreasing cadence. Running in NMA or preferred relative phase angles results in a null effect on cadence. Ensuring a positive phase angle with respect to NMA results in higher motivation and higher cadence. None of the manipulations resulted in change in perceived exhaustion or a change in velocity. Results also indicate that gender plays an important role when using forced phase algorithms: effects were more pronounced for the female population than for the male population. The implementation of the proposed alignment strategies and control of beat timing while running opens possibilities optimizing the individual running cadence and motivation. [ABSTRACT FROM AUTHOR]

A philologist's approach to heritage is traditionally based on the curation of documents, such as text, audio and video. However, with the advent of interactive multimedia, heritage becomes floating and volatile, and not easily captured in documents. We propose an approach to heritage that goes beyond documents. We consider the crucial role of institutes for interactive multimedia (as motor of a living culture of interaction) and propose that the digital philologist's task will be to promote the collective/shared responsibility of (interactive) documenting, engage engineering in developing interactive approaches to heritage, and keep interaction-heritage alive through the education of citizens. [ABSTRACT FROM AUTHOR]

Background: Interdisciplinary work is needed for scientific progress, and with this review, our interest is in the scientific progress toward understanding the underlying mechanisms of auditory-motor coupling, and how this can be applied to gait rehabilitation. Specifically we look into the process of entrainment and synchronization; where entrainment is the process that governs the dynamic alignments of the auditory and motor domains based on error-prediction correction, whereas synchronization is the stable maintenance of timing during auditory-motor alignment. Methodology: A systematic literature search in databases PubMed and Web of Science were searched up to 9th of August 2017. The selection criteria for the included studies were adult populations, with a minimum of five participants, investigating walking to an auditory stimulus, with an outcome measure of entrainment, and synchronization. The review was registered in PROSPERO as CRD42017080325. Objectives: The objective of the review is to systematically describe the metrics which measure entrainment and synchronization to auditory stimuli during walking in healthy and neurological populations. Results: Sixteen articles were included. Fifty percent of the included articles had healthy controls as participants (N = 167), 19% had neurological diseases such as Huntington's and Stroke (N = 76), and 31% included both healthy and neurological [Parkinson's disease (PD) and Stroke] participants (N = 101). In the included studies, six parameters were found to capture the interaction between the human movement and the auditory stimuli, these were: cadence, relative phase angle, resultant vector length, interval between the beat and the foot contact, period matching performance, and detrended fluctuation analysis. Conclusion: In this systematic review, several metrics have been identified, which measure the timing aspect of auditory-motor coupling and synchronization of auditory stimuli in healthy and neurological populations during walking. The application of these metrics may enhance the current state of the art and practice across the neurological gait rehabilitation. These metrics also have current shortcomings. Of particular pertinence is our recommendation to consider variability in data from a time-series rather than time-windowed viewpoint. We need it in view of the promising practical applications from which the studied populations may highly benefit in view of personalized medical care. [ABSTRACT FROM AUTHOR]

Electronic and digital technologies open immense opportunities for music composition, listening, interaction, and participation. However, at the same time, they critically challenge some of the most basic principles that drive human engagement and interaction with music. This article first presents a theoretical discussion of two of these principles, namely sensorimotor control and participatory sense-making. Thereafter, it presents SoundBikes, a music installation that implements these theoretical considerations. SoundBikes is rooted in the idea that collective music-making is a form of participatory sense-making that emerges from embodied, dynamical and collaborative interactions between co-performers. The core components of SoundBikes include an EMS Synthi 100 and two stationary bikes equipped with sensors. To stimulate social interaction and collaboration between cyclist-performers, we designed SoundBikes in a way that performers could exert control over expressive features in the playback of music compositions, by coordinating their (cycling) movements with one another. This functionality is integrated in a gameplay--to further stimulate social collaboration and competition--and a visually attractive environment--to provide visual feedback and to create ambiance. [ABSTRACT FROM AUTHOR]

Music is frequently used as a means of relaxation. Conversely, it is used as a means of arousal in sports and exercise contexts. Previous research suggests that tempo is one of the most significant determinants of music-related arousal and relaxation effects. Here we investigate the specific effect of music tempo, but also more generally, the influence of music on human heart rate. We took the pulses of 32 participants in silence, and then we played them non-vocal, ambient music at a tempo corresponding to their heart rates. Finally, we played the same music again, either with the tempo increased or decreased by a factor of 45%, 30%, or 15%; or maintaining the same tempo as in the first playing. Mixed-design ANOVA tests revealed a significant increase in heart rate while listening to the music as compared with silence (p < .05). In addition, substantial decreases in tempo (-45% or -30%) could account for smaller subsequent heart rate reductions (p < .05). We neither found links between increases in tempo (+15%, +30%, and +45%) and heart rate change, nor small decreases (-15%). In addition, neither effects of gender, music training, nor of musical preference were found. This indicates that during passive music listening, music exerts a general arousal effect on human heart rate, which might be regulated by tempo. These results are a major contribution to the way in which music may be used in everyday activities. [ABSTRACT FROM AUTHOR]

This article presents PLXTRM, a system tracking picking-hand micro-gestures for real-time music applications and live performance. PLXTRM taps into the existing gesture vocabulary of the guitar player. On the first level, PLXTRM provides a continuous controller that doesn’t require the musician to learn and integrate extrinsic gestures, avoiding additional cognitive load. Beyond the possible musical applications using this continuous control, the second aim is to harness PLXTRM’s predictive power. Using a reservoir network, string onsets are predicted within a certain time frame, based on the spatial trajectory of the guitar pick. In this time frame, manipulations to the audio signal can be introduced, prior to the string actually sounding, ’prefacing’ note onsets. Thirdly, PLXTRM facilitates the distinction of playing features such as up-strokes vs. down-strokes, string selections and the continuous velocity of gestures, and thereby explores new expressive possibilities. [ABSTRACT FROM AUTHOR]