Search

Objectives Insufficient physical activity (PA) has long been a global health issue, and a number of studies have explored correlates of PA to identify the mechanisms underlying inactive lifestyles. In the literature, dozens of correlates have been identified at different (eg, individual, environmental) levels, but there is little or no direct evidence for the mutual associations of these correlates. This study analysed 44 variables identified as theoretically and empirically relevant for PA to clarify the factors directly and indirectly associated with PA.Methods A cross-sectional survey dataset of 19 005 Japanese-speaking adults (mean age=53.50 years, SD=17.40; 9706 women) was analysed. The data encompassed demographic and anthropometric variables; self-reported PA levels; perceived social support and environments (eg, awareness of urban facilities for PA); psychological traits and health-behaviour characteristics (eg, personality, motivation, self-efficacy, decisional balance, process of change strategies); and technology use (eg, mobile health apps).Results Network analyses were performed to select meaningful associations (partial correlations) among variables, which identified nine variables directly positively associated with PA: job/employment status, self-efficacy, perceived social support, intrinsic motivation, stage of change, counter conditioning, self-reevaluation, environment and technology use. Indirect associations (two-step neighbourhood) were identified for 40 (out of 44) variables, implying that most of the known PA-correlates are associated with PA—at least indirectly.Conclusion These identified associations echo the importance of the multilevel perspective in understanding how people maintain (in)active lifestyles. Interventions for PA could have mixed-level targets, including intraindividual characteristics, social support and physical and digital environments.

BackgroundWearable activity trackers have become key players in mobile health practice as they offer various behavior change techniques (BCTs) to help improve physical activity (PA). Typically, multiple BCTs are implemented simultaneously in a device, making it difficult to identify which BCTs specifically improve PA. ObjectiveWe investigated the effects of BCTs implemented on a smartwatch, the Fitbit, to determine how each technique promoted PA. MethodsThis study was a single-blind, pilot randomized controlled trial, in which 70 adults (n=44, 63% women; mean age 40.5, SD 12.56 years; closed user group) were allocated to 1 of 3 BCT conditions: self-monitoring (feedback on participants’ own steps), goal setting (providing daily step goals), and social comparison (displaying daily steps achieved by peers). Each intervention lasted for 4 weeks (fully automated), during which participants wore a Fitbit and responded to day-to-day questionnaires regarding motivation. At pre- and postintervention time points (in-person sessions), levels and readiness for PA as well as different aspects of motivation were assessed. ResultsParticipants showed excellent adherence (mean valid-wear time of Fitbit=26.43/28 days, 94%), and no dropout was recorded. No significant changes were found in self-reported total PA (dz

Abstract BackgroundPhysical inactivity is a global health issue, and mobile health (mHealth) apps are expected to play an important role in promoting physical activity. Empirical studies have demonstrated the efficacy and efficiency of app-based interventions, and an increasing number of apps with more functions and richer content have been released. Regardless of the success of mHealth apps, there are important evidence gaps in the literature; that is, it is largely unknown who uses what app functions and which functions are associated with physical activity. ObjectiveThis study aims to investigate the use patterns of apps and wearables supporting physical activity and exercise in a Japanese-speaking community sample. MethodsWe recruited 20,573 web-based panelists who completed questionnaires concerning demographics, regular physical activity levels, and use of apps and wearables supporting physical activity. Participants who indicated that they were using a physical activity app or wearable were presented with a list of app functions (eg, sensor information, goal setting, journaling, and reward), among which they selected any functions they used. ResultsApproximately one-quarter (n=4465) of the sample was identified as app users and showed similar demographic characteristics to samples documented in the literature; that is, compared with app nonusers, app users were younger (odds ratio [OR] 0.57, 95% CI 0.50-0.65), were more likely to be men (OR 0.83, 95% CI 0.77-0.90), had higher BMI scores (OR 1.02, 95% CI 1.01-1.03), had higher levels of education (university or above; OR 1.528, 95% CI 1.19-1.99), were more likely to have a child (OR 1.16, 95% CI 1.05-1.28) and job (OR 1.28, 95% CI 1.17-1.40), and had a higher household income (OR 1.40, 95% CI 1.21-1.62). Our results revealed unique associations between demographic variables and specific app functions. For example, sensor information, journaling, and GPS were more frequently used by men than women (ORs

Abstract Social learning is beneficial for efficient information search in unfamiliar environments (“within-task” learning). In the real world, however, possible search spaces are often so large that decision makers are incapable of covering all options, even if they pool their information collectively. One strategy to handle such overload is developing generalizable knowledge that extends to multiple related environments (“across-task” learning). However, it is unknown whether and how social information may facilitate such across-task learning. Here, we investigated participants’ social learning processes across multiple laboratory foraging sessions in spatially correlated reward landscapes that were generated according to a common rule. The results showed that paired participants were able to improve efficiency in information search across sessions more than solo participants. Computational analysis of participants’ choice-behaviors revealed that such improvement across sessions was related to better understanding of the common generative rule. Rule understanding was correlated within a pair, suggesting that social interaction is a key to the improvement of across-task learning.

Humans often perform rhythmic synchronized movements. Professional musicians and dancers particularly perform such movement tasks well and have a higher interoceptive accuracy (IAcc) than non-musicians and non-dancers. We thus hypothesized that rhythmic synchronized movements might be enhanced by a higher IAcc. To investigate this hypothesis, this study conducted a heartbeat counting task and a rhythmic synchronization tapping task with normal (easier) and slow (harder) tempi metronomes. Inconsistent with our hypothesis, however, a higher IAcc was negatively correlated with timing control, but only in the slow tempo condition [r (30) = 0.46, p < 0.05]. This suggests that a higher IAcc did not enhance timing control in rhythmic synchronized movements but rather weakened it, resting heart rate variability was not correlated with timing control.

Abstract People tend to avoid risk in the domain of gains but take risks in the domain of losses; this is called the reflection effect. Formal theories of decision-making have provided important perspectives on risk preferences, but how individuals acquire risk preferences through experiences remains unknown. In the present study, we used reinforcement learning (RL) models to examine the learning processes that can shape attitudes toward risk in both domains. In addition, relationships between learning parameters and personality traits were investigated. Fifty-one participants performed a learning task, and we examined learning parameters and risk preference in each domain. Our results revealed that an RL model that included a nonlinear subjective utility parameter and differential learning rates for positive and negative prediction errors exhibited better fit than other models and that these parameters independently predicted risk preferences and the reflection effect. Regarding personality traits, although the sample sizes may be too small to test personality traits, increased primary psychopathy scores could be linked with decreased learning rates for positive prediction error in loss conditions among participants who had low anxiety traits. The present findings not only contribute to understanding how decision-making in risky conditions is influenced by past experiences but also provide insights into certain psychiatric problems.

People sometimes persistently pursue hard-to-get targets. Why people pursue such targets is unclear. Here, we hypothesized that choice perseverance, which is the tendency to repeat the same choice independent of the obtained outcomes, leads individuals to repeatedly choose a hard-to-get target, which consequently increases their preference for the target. To investigate this hypothesis, we conducted an online experiment involving an avatar choice task in which the participants repeatedly selected one avatar, and the selected avatar expressed their valence reactions through facial expressions and voice. We defined “hard-to-get” and “easy-to-get” avatars by manipulating the outcome probability such that the hard-to-get avatars rarely provided a positive reaction when selected, while the easy-to-get avatars frequently did. We found that some participants repeatedly selected hard-to-get avatars (Pursuit group). Based on a simulation, we found that higher choice perseverance accounted for the pursuit of hard-to-get avatars and that the Pursuit group had significantly higher choice perseverance than the No-pursuit group. Model fitting to the choice data also supported that choice perseverance can account for the pursuit of hard-to-get avatars in the Pursuit group. Moreover, we found that although baseline attractiveness was comparable among all avatars used in the choice task, the attractiveness of the hard-to-get avatars was significantly increased only in the Pursuit group. Taken together, we conclude that people with high choice perseverance pursue hard-to-get targets, rendering such targets more attractive. The tolerance for negative outcomes might be an important factor for succeeding in our lives but sometimes triggers problematic behavior, such as stalking. The present findings may contribute to understanding the psychological mechanisms of passion and perseverance for one’s long-term goals, which are more general than the romantic context imitated in avatar choice.

This study aimed to investigate whether instrumental reward learning is affected by the cardiac cycle. To this end, we examined the effects of the cardiac cycle (systole or diastole) on the computational processes underlying the participants’ choices in the instrumental learning task. In the instrumental learning task, participants were required to select one of two discriminative stimuli (neutral visual stimuli) and immediately receive reward/punishment feedback depending on the probability assigned to the chosen stimuli. To manipulate the cardiac cycle, the presentation of discriminative stimuli was timed to coincide with either cardiac systole or diastole. We fitted the participants’ choices in the task with reinforcement learning (RL) models and estimated parameters involving instrumental learning (i.e., learning rate and inverse temperature) separately in the systole and diastole trials. Model-based analysis revealed that the learning rate for positive prediction errors was higher than that for negative prediction errors in the systole trials; however, learning rates did not differ between positive and negative prediction errors in the diastole trials. These results demonstrate that the natural fluctuation of cardiac afferent signals can affect asymmetric value updating in instrumental reward learning.

Abstract The learning rate is a key parameter in reinforcement learning that determines the extent to which novel information (outcome) is incorporated in guiding subsequent actions. Numerous studies have reported that the magnitude of the learning rate in human reinforcement learning is biased depending on the sign of the reward prediction error. However, this asymmetry can be observed as a statistical bias if the fitted model ignores the choice autocorrelation (perseverance), which is independent of the outcomes. Therefore, to investigate the genuine process underlying human choice behavior using empirical data, one should dissociate asymmetry in learning and perseverance from choice behavior. The present study addresses this issue by using a Hybrid model incorporating asymmetric learning rates and perseverance. First, by conducting simulations, we demonstrate that the Hybrid model can identify the true underlying process. Second, using the Hybrid model, we show that empirical data collected from a web-based experiment are governed by perseverance rather than asymmetric learning. Finally, we apply the Hybrid model to two open datasets in which asymmetric learning was reported. As a result, the asymmetric learning rate was validated in one dataset but not another.

Abstract Objective Amyotrophic lateral sclerosis (ALS) is a multisystem disorder associated with motor impairment and behavioral/cognitive involvement. We examined decision‐making features and changes in the neural hub network in patients with ALS using a probabilistic reversal learning task and resting‐state network analysis, respectively. Methods Ninety ALS patients and 127 cognitively normal participants performed this task. Data from 62 ALS patients and 63 control participants were fitted to a Q‐learning model. Results ALS patients had anomalous decision‐making features with little shift in choice until they thought the value of the two alternatives had become equal. The quantified parameters (Pαβ) calculated by logistic regression analysis with learning rate and inverse temperature well represented the unique choice pattern of ALS patients. Resting‐state network analysis demonstrated a strong correlation between Pαβ and decreased degree centrality in the anterior cingulate gyrus and frontal pole. Interpretation Altered decision‐making in ALS patients may be related to the decreased hub function of medial prefrontal areas.

Computational modeling has been applied for data analysis in psychology, neuroscience, and psychiatry. One of its important uses is to infer the latent variables underlying behavior by which researchers can evaluate corresponding neural, physiological, or behavioral measures. This feature is especially crucial for computational psychiatry, in which altered computational processes underlying mental disorders are of interest. For instance, several studies employing model-based fMRI-a method for identifying brain regions correlated with latent variables-have shown that patients with mental disorders (e.g., depression) exhibit diminished neural responses to reward prediction errors (RPEs), which are the differences between experienced and predicted rewards. Such model-based analysis has the drawback that the parameter estimates and inference of latent variables are not necessarily correct-rather, they usually contain some errors. A previous study theoretically and empirically showed that the error in model-fitting does not necessarily cause a serious error in model-based fMRI. However, the study did not deal with certain situations relevant to psychiatry, such as group comparisons between patients and healthy controls. We developed a theoretical framework to explore such situations. We demonstrate that the parameter-misspecification can critically affect the results of group comparison. We demonstrate that even if the RPE response in patients is completely intact, a spurious difference to healthy controls is observable. Such a situation occurs when the ground-truth learning rate differs between groups but a common learning rate is used, as per previous studies. Furthermore, even if the parameters are appropriately fitted to individual participants, spurious group differences in RPE responses are observable when the model lacks a component that differs between groups. These results highlight the importance of appropriate model-fitting and the need for caution when interpreting the results of model-based fMRI.

[This corrects the article DOI: 10.1371/journal.pone.0244434.].

The value learning process has been investigated using decision-making tasks with a correct answer specified by the external environment (externally guided decision-making, EDM). In EDM, people are required to adjust their choices based on feedback, and the learning process is generally explained by the reinforcement learning (RL) model. In addition to EDM, value is learned through internally guided decision-making (IDM), in which no correct answer defined by external circumstances is available, such as preference judgment. In IDM, it has been believed that the value of the chosen item is increased and that of the rejected item is decreased (choice-induced preference change; CIPC). An RL-based model called the choice-based learning (CBL) model had been proposed to describe CIPC, in which the values of chosen and/or rejected items are updated as if own choice were the correct answer. However, the validity of the CBL model has not been confirmed by fitting the model to IDM behavioral data. The present study aims to examine the CBL model in IDM. We conducted simulations, a preference judgment task for novel contour shapes, and applied computational model analyses to the behavioral data. The results showed that the CBL model with both the chosen and rejected value's updated were a good fit for the IDM behavioral data compared to the other candidate models. Although previous studies using subjective preference ratings had repeatedly reported changes only in one of the values of either the chosen or rejected items, we demonstrated for the first time both items' value changes were based solely on IDM choice behavioral data with computational model analyses.

The field of computational psychiatry is growing in prominence along with recent advances in computational neuroscience, machine learning, and the cumulative scientific understanding of psychiatric disorders. Computational approaches based on cutting-edge technologies and high-dimensional data are expected to provide an understanding of psychiatric disorders with integrating the notions of psychology and neuroscience, and to contribute to clinical practices. However, the multidisciplinary nature of this field seems to limit the development of computational psychiatry studies. Computational psychiatry combines knowledge from neuroscience, psychiatry, and computation; thus, there is an emerging need for a platform to integrate and coordinate these perspectives. In this study, we developed a new database for visualizing research papers as a two-dimensional “map” called the Computational Psychiatry Research Map (CPSYMAP). This map shows the distribution of papers along neuroscientific, psychiatric, and computational dimensions to enable anyone to find niche research and deepen their understanding ofthe field.

Surprise occurs because of differences between a decision outcome and its predicted outcome (prediction error), regardless of whether the error is positive or negative. It has recently been postulated that surprise affects the reward value of the action outcome; studies have indicated that increasing surprise as an absolute value of prediction error decreases the value of the outcome. However, how surprise affects the value of the outcome and subsequent decision making is unclear. We suggest that, on the assumption that surprise decreases the outcome value, agents will increase their risk-averse choices when an outcome is often surprising. Here, we propose the surprise-sensitive utility model, a reinforcement learning model that states that surprise decreases the outcome value, to explain how surprise affects subsequent decision making. To investigate the properties of the proposed model, we compare the model with previous reinforcement learning models on two probabilistic learning tasks by simulations. As a result, the proposed model explains the risk-averse choices like the previous models, and the risk-averse choices increase as the surprise-based modulation parameter of outcome value increases. We also performed statistical model selection by using two experimental datasets with different tasks. The proposed model fits these datasets better than the other models with the same number of free parameters, indicating that the model can better capture the trial-by-trial dynamics of choice behavior.

One of the major goals of basic studies in psychiatry is to find etiological mechanisms or biomarkers of mental disorders. A standard research strategy to pursue this goal is to compare observations of potential factors from patients with those from healthy controls. Classifications of individuals into patient and control groups are generally based on a diagnostic system, such as the 'Diagnostic and Statistical Manual of Mental Disorders (DSM)' or the 'International Classification of Diseases (ICD)'. Several flaws in these conventional diagnostic-based approaches have been recognized. The flaws are primarily due to the complexity in the relation between the pathogenetic factors (causes) and disorders: The current diagnostic categories may not reflect the underlying etiological mechanisms. To overcome this difficulty, the National Institute of Mental Health initiated a novel research strategy called Research Domain Criteria (RDoC), which encourages studies to focus on the neurobiological mechanisms and core aspects of behavior rather than to rely on traditional diagnostic categories. However, how RDoC can improve research in psychiatry remains a matter of debate. In this article, we propose a theoretical framework for evaluating psychiatric research strategies, including the conventional diagnostic category-based approaches and the RDoC approach. The proposed framework is based on the statistical modeling of the processes of how the disorder arises from pathogenetic factors. This framework provides the statistical power to quantify how likely relevant pathogenetic factors are to be detected under various research strategies. On the basis of the proposed framework, we can discuss which approach performs better in different types of situations. We present several theoretical and numerical results that highlight the advantages and disadvantages of the strategies. We also demonstrate how a computational model is incorporated into the proposed framework as a generative model of behavioral observations. This demonstration highlights how the computational models contribute to designing psychiatric studies.

Individuals with psychopathy often show deficits in learning, which often have negative consequences. Several theories have been proposed to explain psychopathic behaviors, but the learning mechanisms in psychopathy are still unclear. To clarify the learning anomalies in psychopathy, we fitted reinforcement learning (RL) models to behavioral data. We conducted two experiments to examine the effect of psychopathy as a group difference (Experiment 1) and as a continuum (Experiment 2). Forty-three undergraduates (in Experiment 1) and fifty-five undergraduate and graduate students (in Experiment 2) performed a go/no-go based learning task with accompanying rewards or punishments. Although we observed no differences in learning performance among the levels of psychopathic traits, the learning rate for the positive prediction error in the loss domain was lower for those with high-psychopathic trait than for those with low-psychopathic trait. This finding indicates that individuals with high-psychopathic traits update an action value less when they avoid a negative outcome. Our model can represent previous theories under a computational framework and provide a new perspective on impaired learning in psychopathy.

Decision-making is assumed to be supported by model-free and model-based systems: the model-free system is based purely on experience, while the model-based system uses a cognitive map of the environment and is more accurate. The recently developed multistep decision-making task and its computational model can dissociate the contributions of the two systems and have been used widely. This study used this task and model to understand our value-based learning process and tested alternative algorithms for the model-free and model-based learning systems. The task used in this study had a deterministic transition structure, and the degree of use of this structure in learning is estimated as the relative contribution of the model-based system to choices. We obtained data from 29 participants and fitted them with various computational models that differ in the model-free and model-based assumptions. The results of model comparison and parameter estimation showed that the participants update the value of action sequences and not each action. Additionally, the model fit was improved substantially by assuming that the learning mechanism includes a forgetting process, where the values of unselected options change to a certain default value over time. We also examined the relationships between the estimated parameters and psychopathology and other traits measured by self-reported questionnaires, and the results suggested that the difference in model assumptions can change the conclusion. In particular, inclusion of the forgetting process in the computational models had a strong impact on estimation of the weighting parameter of the model-free and model-based systems.

Complex sequencing rules observed in birdsongs provide an opportunity to investigate the neural mechanism for generating complex sequential behaviors. To relate the findings from studying birdsongs to other sequential behaviors such as human speech and musical performance, it is crucial to characterize the statistical properties of the sequencing rules in birdsongs. However, the properties of the sequencing rules in birdsongs have not yet been fully addressed. In this study, we investigate the statistical properties of the complex birdsong of the Bengalese finch (Lonchura striata var. domestica). Based on manual-annotated syllable labeles, we first show that there are significant higher-order context dependencies in Bengalese finch songs, that is, which syllable appears next depends on more than one previous syllable. We then analyze acoustic features of the song and show that higher-order context dependencies can be explained using first-order hidden state transition dynamics with redundant hidden states. This model corresponds to hidden Markov models (HMMs), well known statistical models with a large range of application for time series modeling. The song annotation with these models with first-order hidden state dynamics agreed well with manual annotation, the score was comparable to that of a second-order HMM, and surpassed the zeroth-order model (the Gaussian mixture model; GMM), which does not use context information. Our results imply that the hierarchical representation with hidden state dynamics may underlie the neural implementation for generating complex behavioral sequences with higher-order dependencies.