Search

The rise of computational modeling in the past decade has led to a substantial increase in the number of papers that report parameter estimates of computational cognitive models. A common application of computational cognitive models is to quantify individual differences in behavior by estimating how these are expressed in differences in parameters. For these inferences to hold, models need to be identified, meaning that one set of parameters is most likely, given the behavior under consideration. For many models, model identification can be achieved up to a scaling constraint, which means that under the assumption that one parameter has a specific value, all remaining parameters are identified. In the current note, we argue that this scaling constraint implies a strong assumption about the cognitive process that the model is intended to explain, and warn against an overinterpretation of the associative relations found in this way. We will illustrate these points using signal detection theory, reinforcement learning models, and the linear ballistic accumulator model, and provide suggestions for a clearer interpretation of modeling results.

Most data analyses rely on models. To complement statistical models, psychologists have developed cognitive models, which translate observed variables into psychologically interesting constructs. Response time models, in particular, assume that response time and accuracy are the observed expression of latent variables including 1) ease of processing, 2) response caution, 3) response bias, and 4) non-decision time. Inferences about these psychological factors, hinge upon the validity of the models' parameters. Here, we use a blinded, collaborative approach to assess the validity of such model-based inferences. Seventeen teams of researchers analyzed the same 14 data sets. In each of these two-condition data sets, we manipulated properties of participants' behavior in a two-alternative forced choice task. The contributing teams were blind to the manipulations, and had to infer what aspect of behavior was changed using their method of choice. The contributors chose to employ a variety of models, estimation methods, and inference procedures. Our results show that, although conclusions were similar across different methods, these "modeler's degrees of freedom" did affect their inferences. Interestingly, many of the simpler approaches yielded as robust and accurate inferences as the more complex methods. We recommend that, in general, cognitive models become a typical analysis tool for response time data. In particular, we argue that the simpler models and procedures are sufficient for standard experimental designs. We finish by outlining situations in which more complicated models and methods may be necessary, and discuss potential pitfalls when interpreting the output from response time models.

For multi-factor analyses of response times, descriptive models (e.g., linear regression) arguably constitute the dominant approach in psycholinguistics. In contrast empirical cognitive models (e.g., sequential sampling models, SSMs) may fit fewer factors simultaneously, but decompose the data into several dependent variables (a multivariate result), offering more information to analyze. While SSMs are notably popular in the behavioural sciences, they are not significantly developed in language production research. To contribute to the development of this modelling in language, we (i) examine SSMs as a measurement modelling approach for spoken word activation dynamics, and (ii) formally compare SSMs to the default method, regression. SSMs model response activation or selection mechanisms in time, and calculate how they are affected by conditions, persons, and items. While regression procedures also model condition effects, it is only in respect to the mean RT, and little work has been previously done to compare these approaches. Through analyses of two language production experiments, we show that SSMs reproduce regression predictors, and further extend these effects through a multivariate decomposition (cognitive parameters). We also examine a combined regression-SSM approach that is hierarchical Bayesian, which can jointly model more conditions than classic SSMs, and importantly, achieve by-item modelling with other conditions. In this analysis, we found that spoken words principally differed from one another by their activation rates and production times, but not their thresholds to be activated.

The notion of "mixtures" has become pervasive in behavioral and cognitive sciences, due to the success of dual-process theories of cognition. However, providing support for such dual-process theories is not trivial, as it crucially requires properties in the data that are specific to mixture of cognitive processes. In theory, one such property could be the fixed-point property of binary mixture data, applied-for instance- to response times. In that case, the fixed-point property entails that response time distributions obtained in an experiment in which the mixture proportion is manipulated would have a common density point. In the current article, we discuss the application of the fixed-point property and identify three boundary conditions under which the fixed-point property will not be interpretable. In Boundary condition 1, a finding in support of the fixed-point will be mute because of a lack of difference between conditions. Boundary condition 2 refers to the case in which the extreme conditions are so different that a mixture may display bimodality. In this case, a mixture hypothesis is clearly supported, yet the fixed-point may not be found. In Boundary condition 3 the fixed-point may also not be present, yet a mixture might still exist but is occluded due to additional changes in behavior. Finding the fixed-property provides strong support for a dual-process account, yet the boundary conditions that we identify should be considered before making inferences about underlying psychological processes., Competing Interests: The authors have declared that no competing interests exist.

We propose and demonstrate the shifted Wald (SW) distribution as both a useful measurement tool and intraindividual process model for psychological response time (RT) data. Furthermore, we develop a methodology and fitting approach that readers can easily access. As a measurement tool, the SW provides a detailed quantification of the RT data that is more sophisticated than mean and SD comparisons. As an intraindividual process model, the SW provides a cognitive model for the response process in terms of signal accumulation and the threshold needed to respond. The details and importance of both of these features are developed, and we show how the approach can be easily generalized to a variety of experimental domains. The versatility and usefulness of the approach is demonstrated on 3 published data sets, each with a different canonical mode of responding: manual, vocal, and oculomotor modes. In addition, model-fitting code is included with the article. (PsycINFO Database Record, ((c) 2016 APA, all rights reserved).)

We propose and demonstrate evidence accumulation as a plausible theoretical and/or empirical model for the lexical selection process of lexical retrieval. A number of current psycholinguistic theories consider lexical selection as a process related to selecting a lexical target from a number of alternatives, which each have varying activations (or signal supports), that are largely resultant of an initial stimulus recognition. We thoroughly present a case for how such a process may be theoretically explained by the evidence accumulation paradigm, and we demonstrate how this paradigm can be directly related or combined with conventional psycholinguistic theory and their simulatory instantiations (generally, neural network models). Then with a demonstrative application on a large new real data set, we establish how the empirical evidence accumulation approach is able to provide parameter results that are informative to leading psycholinguistic theory, and that motivate future theoretical development., (Copyright © 2015 Elsevier Inc. All rights reserved.)

Trial-to-trial fluctuations in an observer's state of mind have a direct influence on their behavior. However, characterizing an observer's state of mind is difficult to do with behavioral data alone, particularly on a single-trial basis. In this article, we extend a recently developed hierarchical Bayesian framework for integrating neurophysiological information into cognitive models. In so doing, we develop a novel extension of the well-studied drift diffusion model (DDM) that uses single-trial brain activity patterns to inform the behavioral model parameters. We first show through simulation how the model outperforms the traditional DDM in a prediction task with sparse data. We then fit the model to experimental data consisting of a speed-accuracy manipulation on a random dot motion task. We use our cognitive modeling approach to show how prestimulus brain activity can be used to simultaneously predict response accuracy and response time. We use our model to provide an explanation for how activity in a brain region affects the dynamics of the underlying decision process through mechanisms assumed by the model. Finally, we show that our model performs better than the traditional DDM through a cross-validation test. By combining accuracy, response time, and the blood oxygen level-dependent response into a unified model, the link between cognitive abstraction and neuroimaging can be better understood., ((c) 2015 APA, all rights reserved).)

When multiple strategies can be used to solve a type of problem, the observed response time distributions are often mixtures of multiple underlying base distributions each representing one of these strategies. For the case of two possible strategies, the observed response time distributions obey the fixed-point property. That is, there exists one reaction time that has the same probability of being observed irrespective of the actual mixture proportion of each strategy. In this paper we discuss how to compute this fixed-point, and how to statistically assess the probability that indeed the observed response times are generated by two competing strategies. Accompanying this paper is a free R package that can be used to compute and test the presence or absence of the fixed-point property in response time data, allowing for easy to use tests of strategic behavior.

Models of decision making differ in how they treat early evidence as it recedes in time. Standard models, such as the drift diffusion model, assume that evidence is gradually accumulated until it reaches a boundary and a decision is initiated. One recent model, the urgency gating model, has proposed that decision making does not require the accumulation of evidence at all. Instead, accumulation could be replaced by a simple urgency factor that scales with time. To distinguish between these fundamentally different accounts of decision making, we performed an experiment in which we manipulated the presence, duration, and valence of early evidence. We simulated the associated response time and error rate predictions from the drift diffusion model and the urgency gating model, fitting the models to the empirical data. The drift diffusion model predicted that variations in the evidence presented early in the trial would affect decisions later in that same trial. The urgency gating model predicted that none of these variations would have any effect. The behavioral data showed clear effects of early evidence on the subsequent decisions, in a manner consistent with the drift diffusion model. Our results cannot be explained by the urgency gating model, and they provide support for an evidence accumulation account of perceptual decision making.

This article discusses how sequential sampling models can be integrated in a cognitive architecture. The new theory Retrieval by Accumulating Evidence in an Architecture (RACE/A) combines the level of detail typically provided by sequential sampling models with the level of task complexity typically provided by cognitive architectures. We will use RACE/A to model data from two variants of a picture-word interference task in a psychological refractory period design. These models will demonstrate how RACE/A enables interactions between sequential sampling and long-term declarative learning, and between sequential sampling and task control. In a traditional sequential sampling model, the onset of the process within the task is unclear, as is the number of sampling processes. RACE/A provides a theoretical basis for estimating the onset of sequential sampling processes during task execution and allows for easy modeling of multiple sequential sampling processes within a task., (Copyright © 2011 Cognitive Science Society, Inc.)

Between-trial effects in Stroop-like interference tasks are linked to differences in the amount of cognitive control. Trials following an incongruent trial show less interference, an effect suggested to result from the increased control caused by the incongruent previous trial (known as the Gratton effect). In this study, we show that cognitive control not only results in a different amount of interference but also in a different locus of the interference. That is, the stage of the task that shows the most interference changes as a function of the preceding trial. Using computational cognitive modeling, we explain these effects by a difference in the amount of processing of the irrelevant dimension of the stimulus., (Copyright © 2009 Cognitive Science Society, Inc.)