Search

This article reports on a post hoc study using a randomised controlled trial with 31,842 students in the Netherlands and an instrument consisting of 21 paired problems. The trial showed a variability in the differences of students’ results in solving contextual mathematical problems with either a descriptive or a depictive representation of the problem situation. In this study the relation between this variability and two task characteristics is investigated: (1) complexity of the task representation; and (2) the content domain of the task. We found indications that differences in performance on descriptive and depictive representations of the problem situation are related to the content domain of the problems. One of the tentative conclusions is that for depicted problems in the domain of measurement and geometry the inferential step from representation of the problem situation to the mathematical problem to be solved is smaller than for word problems.

Research on solving mathematical word problems suggests that students may perform better on problems with a close to real-life representation of the problem situation than on word problems. In this study we pursued real-life representation by a mainly depictive representation of the problem situation, mostly by photographs. The prediction that students perform better on problems with a depictive representation of the problem situation than on comparable word problems was tested in a randomised controlled trial with 31,842 students, aged 10–20 years, from primary and secondary education. The conclusion was that students scored significantly higher on problems with a depictive representation of the problem situation, but with a very small effect size of Cohen's d = 0.09. The results of this research are likely to be relevant for evaluations of mathematics education where word problems are used to evaluate the mathematical capacity of students.

The aim of this study is to contribute to the body of knowledge on the use of contextual mathematical problems. Word problems are a predominant genre in mathematics classrooms in assessing students’ ability to solve problems from everyday life. Research on word problems, however, reveals a range of difficulties in their use in mathematics education. In our research we took an alternative approach: we designed image-rich numeracy problems as alternatives for word problems. A set of word problems was modified by systematically replacing the descriptive representation of the problem situation by a more depictive representation and an instrument was designed to measure the effect of this modification on students’ performance. The instrument can measure the effect of this alternative approach in a randomized controlled trial. In order to use the instrument at scale, we made this instrument also usable as a diagnostic test for an upcoming nationwide examination on numeracy. In this article we explain and discuss the design of the instrument and the validation of its intended uses.