Search

L2 requests in developmental pragmatics research are commonly investigated using non-interactive data collection techniques or sidelining the larger discourse sequence in which the request proper is embedded. This study takes a different approach to the study of L2 requests. In a cross-sectional design, we collected role play data from learners at four proficiency levels, and focused on the sequential organization of the interactions and the impact of participants’ proficiency level. Findings indicate that lower level learners were less likely to project the upcoming request and lay the groundwork for it through ascertaining interlocutor availability and providing accounts. They used fewer first-pair parts and uttered the request early relying on the interlocutor to elicit further information. The interlocutor also adjusted to learners’ proficiency level in keeping complications to a minimum. Effects of the social context variable Power were very limited but discernible at high-proficiency levels. We argue for a more discursive approach to developmental data in interlanguage pragmatics that allows the identification of interactional correlates of proficiency.

Routine formulae are highly frequent, situationally bound chunks that are beneficial to L2 learners? pragmatic performance. These formulae are usually more easily acquired in the target language setting but they are to some extent also learnable in foreign language classrooms. This study investigates the effect of different lengths of residence abroad on the recognition of situational routine formulae. A total of 262 ESL and EFL learners completed a test battery which included assessment of receptive knowledge of routines. Learners with even short-term residence of two months had increased knowledge of routines, and further residence led to further improvement in knowledge in this area. Even EFL learners without residence knew some routine formulae but knowledge of routines was independent of general proficiency. Learners in the L2 setting get routines �for free� through exposure to contextualized L2 discourse, but which specific routines are acquired depends on the interactional settings in which learners communicate.

Language testing marks 50 years since Lado's (1961) book Language Testing laid the foundation of the field. The past 50 years have seen some international trends throughout the field, most notably ...

Testing of second language pragmatic competence is an underexplored but growing area of second language assessment. Tests have focused on assessing learners’ sociopragmatic and pragmalinguistic abilities but the speech act framework informing most current productive testing instruments in interlanguage pragmatics has been criticized for under-representing the construct. In particular, the assessment of learners’ ability to produce extended monologic and dialogic discourse is a missing component in existing assessments. This paper reviews existing tests and argues for a discursive re-orientation of pragmatics tests. Suggestions for tasks and scoring approaches to assess discursive abilities while maintaining practicality are provided, and the problematicity of native speaker benchmarking is discussed.

This study investigates differential item functioning (DIF) in a 36-item test of English as a Second Language pragmalinguistics, assessing 254 learners' knowledge of implicature, routines, and speech acts. Two common DIF techniques, the Mantel-Haenszel method and the standardization method, detected nine items functioning differentially for test takers of Asian and European language background. More detailed analyses of these items showed that DIF was mostly statistical, but some substantive DIF was also present.

This study established a current profile of Canadian pediatric occupational therapy practice in terms of theories/practice models, assessments, and interventions.Respondents were 272 members of the Canadian Association of Occupational Therapists who indicated that pediatrics was their primary area of clinical practice. A purpose-designed survey was mailed to participants.The response rate was adequate at 27.2% (n = 272/1,000). The primary client groups seen by pediatric therapists were developmental delay, learning disability, neurology, and those requiring rehabilitation. Sensory Integration and Client-Centred Practice were the most frequently utilized theories/practice models. The most commonly used assessments were the Developmental Test of Visual Motor Integration, Peabody Developmental Motor Scales, Bruininks-Oseretsky Test of Motor Proficiency, and the Sensory Profile. The most frequently used intervention techniques with pediatric clients were the instruction of parents/caregivers and children; assistive devices, adaptive equipment, and technology; activities of daily living/self-care skills; and environmental modification/access/structuring/adaptation.Pediatric occupational therapists mainly used theories/ practice models that focused on three areas: Client-Centred practice, practice-oriented theories, and several theories/practice models based on occupation. Interventions focused on teaching, activities unique to occupational therapy, and on the functional needs of the client.

In this book, the authors foreground an aspect of language testing that is usually not much discussed and is frequently considered an “advanced” topic: the social dimension of language testing. They see various social dimensions in language testing. There are socially oriented language tests, i.e., tests which assess learners’ ability to use language in social settings. These are primarily oral proficiency interviews and tests of second language pragmatics. But the authors also understand “social” as “societal” and look at the larger-scale impact of tests on individual learners or groups of learners by discussing fairness and bias in language testing. They also broaden their view and discuss the role of language testing in a macro-social context, e.g. as accountability measures in education systems, as gatekeeping instruments for migration, and as tools for constructing and defining social groups. Their discussion is anchored in traditional and more recent views of validity theory.

Despite increasing interest in interlanguage pragmatics research, research on assessment of this crucial area of second language competence still lags behind assessment of other aspects of learners’ developing second language (L2) competence. This study describes the development and validation of a 36-item web-based test of ESL pragmalinguistics, measuring learners’ offline knowledge of implicatures and routines with multiple-choice questions, and their knowledge of speech acts with discourse completion tests. The test was delivered online to 267 ESL and EFL learners, ranging in proficiency from beginner to advanced. Evidence for construct validity was collected through correlational analyses and comparisons between groups. The effect of browser familiarity was found to be negligible, and learners generally performed as previous research would suggest: their knowledge of speech acts increased with proficiency, as did their knowledge of implicature. Their knowledge of routines, however, was strongly dependent on L2 exposure. Correlations between the sections and factor analysis confirmed that the routines, implicatures, and speech act sections are related but that each has some unique variance. The test was sufficiently reliable and practical, taking an hour to administer and little time to score. Limitations and future research directions are discussed.

The paediatric content of the eight undergraduate and entry-level postgraduate occupational therapy programmes in South Africa was examined through a survey of the faculties. In the first of a two-part article documenting the study, current best practices in paediatric occupational therapy are reviewed by means of a literature review. Part two will identify and discuss the current status of the paediatric content of occupational therapy education programmes in South Africa, including theoretical frameworks, assessments and intervention strategies. The literature suggests that there is a degree of commonality in paediatric occupational therapy practice between Canada, the US, the UK and Australia in terms of theoretical frameworks, assessment tools and intervention strategies used. Teaching staff must not only include current best practices based on sound research evidence in paediatrics in curricula, but teach in the context of the diverse client diagnostic groups that students will encounter upon graduation.

Comparisons were made of the paediatric content of professional entry-level occupational therapy university program curricula in Australia, New Zealand, and Canada using an ex post facto survey methodology. The findings indicated that in Australia/New Zealand, paediatrics made up 20% of the total curriculum, but only 13% in Canada. Canadian reference materials were utilized less often in Canadian universities than in Australia/New Zealand. Theories taught most often in Australia/New Zealand were: Sensory Integration, Neurodevelopmental Therapy, Client-Centered Practice, Playfulness, and the Model of Human Occupation. In Canada, the most frequent theories were: Piaget's Stages of Cognitive/Intellectual Development, Neurodevelopmental Therapy, Erikson's Eight Stages of Psychosocial Development and Sensory Integration. The most frequently taught paediatric assessment tools in both regions were the Bruininks-Oseretsky Test of Motor Proficiency and Miller Assessment for Preschoolers. Paediatric intervention methods taught to students in all three countries focused on activities of daily living/self-care, motor skills, perceptual and visual motor integration, and infant and child development.

The paediatric curriculum component of entry-level occupational therapy education programmes in the United Kingdom was examined and comparisons were made with the practice literature to determine if students were being taught current best practices. Questionnaires were mailed electronically to the identified paediatric faculty members of the 27 universities with an entry-level occupational therapy education programme in the United Kingdom. Ten completed questionnaires were returned, giving a response rate of 37%. The survey results indicated that paediatrics constituted less than 5% of the total curriculum content of the respondent university programmes. The theory, assessments and treatment approaches taught in the education programmes were similar to those used in clinical practice with children. Some gaps in what was taught to students were apparent, notably in the key paediatric area of visual perceptual dysfunction. The theory, assessments and intervention methods were not always taught as a cohesive stand-alone unit, so gaps occurred in the education programmes. This could lead to graduates using an eclectic approach or using personal conceptual frameworks based on postgraduate learning and work experience.

Paediatric occupational therapists were surveyed regarding their practices in Canada and Australia. Two hundred and eighty-nine Canadian occupational therapists and 330 Australian occupational therapists participated representing response rates of 28.9% and 55% respectively. The majority of respondents were female (98%), between 30 and 49 years of age (69%), had a bachelor's degree, worked on average 10.5 years in paediatrics and spent well over 50% of their work time in direct client care. The largest client diagnostic groups in both countries were those with developmental delays, learning disabilities and neurological disorders. Diagnostic groups were used as an organizing framework to portray theory, assessment and intervention use. Overall, the theoretical models cited most frequently in both countries were: Sensory Integration, Sensory Processing/Sensory Diet, Client-Centred Practice, and Occupational Performance Model. Australian therapists employed the Occupational Performance Model (Australia) for all groups, while it was rarely utilized in Canada. Common assessment tools in both Australia and Canada were the Peabody Developmental Motor Scales, Developmental Test of Visual Motor Integration, and the Bruininks-Oseretsky Test of Motor Proficiency. Intervention methods focused on: parental/care-giver education; activities of daily living/self-care skills training; client education; environmental modification; assistive devices; sensory integration techniques; sensory stimulation and sensory diet treatment methods; and neurodevelopmental techniques.

Research in second language pragmatics is increasingly investigating the sequential organization of interaction and how it might be affected by second language learners’ developing proficiency. In this paper, we are focusing on a specific aspect of request organization, namely multiple requests. Through data from natural interaction and role plays, we found that multiple requests occurred in a single turn, either as an original request and its same-format reiteration bracketing accounts and explanations or as repetitions with a more complex and polite format. Multiple requests across turns served a repair function. We argue that same-turn multiple requests are recipient designed to increase the likelihood of acceptance. Higher-level learners of Arabic were more likely to produce multiple requests in the same turn than low-level learners whereas the latter exhibited more multiple requests across turns. The data collection method did not have a discernible effect on findings.

In this book, the authors describe the development and validation of a web-based test of second language pragmatics for learners of English.

Learner background factors have been shown to affect learning of L2 pragmatics, which has been demonstrated especially for proficiency and length of residence. However, these factors have generally been investigated individually, not allowing conclusions as to their relative contributions. In this study, we use Poisson regression to investigate the effect of proficiency, length of residence, gender and multilingualism on learners' comprehension of implicature, recognition of routine formulae and production of speech acts in English. 229 ESL and EFL learners completed a web-based pragmatics test with 12 items per section. We found that only proficiency significantly affected implicature comprehension, length of residence and proficiency were significant factors in the recognition of routine formulae, and proficiency and gender significantly impacted speech act production. Although the effect of proficiency in our study is far greater than for any other background factor, we caution against overemphasizing its importance to learning of pragmatics overall.

Preference structure is a fundamental organizational principle of talk, and research has shown that preferred actions tend to be done immediately and without mitigation whereas dispreference is indicated by delays, elaboration, hesitation, and mitigation. However, little research exists on how second language learners do preference and dispreference. In this study, we investigate how 67 learners of Arabic at four proficiency levels managed preference structure in requests and how their management of preference changed over a five-month period. We found a strong increase in the use of preliminary moves with proficiency level, and also greater occurrence of preliminary moves over the five-month period among lower-level learners. Absence of clear dispreference marking with lower-proficiency learners led to repair sequences, and only high-proficiency learners used multiple preliminary moves. Offers by the interlocutor were rare and limited to interactions with high-proficiency learners. We conclude that interactions involving second language learners can be affected by the learners' developing L2 proficiency, which limits their ability to carry out social actions in a conventional way in the target language.

Pragmatics as an overall construct is concerned with the influence of situational and social context on language use (Austin, 1962; Crystal, 1997; Mey, 2001), be it through the representation of objects and concepts by means of reference and deixis, the indexing of social relationships by means of politeness or honorifics, or the creation of implicature through the flouting of conversational maxims. While pragmatic knowledge and ability for use is an uncontroversial part of general L2 communicative cornpetence (Bachman, 1990; Bachrnan & Palmer, 1996), testing instruments for L2 pragmatics had been underrepresented in language test development until the mid-90s. Since then, several projects have been undertaken to develop tests of second language pragmatics (for overviews and critiques, see McNamara & Roever, 2006; Roever, 2011). The instruments developed so far have focused on the sociopragmatic appropriateness of speech acts (Ahn, 2005; Hudson, Detmer & Brown, 1995; Tada, 2005; Yamashita, 1996; Yoshitake, 1997; Liu, 2006), pragmalinguistic knowledge of implicature, routines and speech acts (Bouton, 1988, 1994, 1999; Roever, 1996, 2005, 2006), speech styles (Cook, 2001), and compliments (Walters, 2004, 2007). Some further testing instruments have been developed for acquisitional and psycholinguistic research studies in the area of speech acts (e.g., Bardovi-Harlig & Dornyei, 1998; Matsumura, 2001, 2003) and implicature (Taguchi, 2005, 2007, 2008).

The assessment of second language pragmatics is a relatively recent enterprise. This entry will briefly review the construct of pragmatics, discuss some major approaches to testing pragmatics, and highlight some of the challenges for pragmatics assessment. Keywords: pragmatics; second language acquisition; assessment

It may seem contradictory to talk about “testing” in the context of “research”: after all, testing in a narrow sense is usually done to collect evidence for real-world decisions and involves stakes for all parties involved in the process, and tests therefore need to be based on a carefully designed interpretive validity argument (Messick, 1989; Kane, 2006; Bachman & Palmer, 2010), which in itself requires a fairly extensive research program. However, testing in a simpler sense is the measurement of the strength of an attribute, which does not necessarily have to be the basis for a high-stakes decision. Rather, it might be undertaken to answer a research question; for example, to evaluate the effectiveness of an instructional intervention intended to improve learners’ knowledge or skills, trace learners’ development in language abilities over time, or compare participants with each other who differ in theoretically interesting background variables, such as proficiency level, gender, native language, or study-abroad experience. Keywords: assessment methods in applied linguistics; pragmatics; research methods in applied linguistics; second language acquisition

Pragmatics, the ability to act and interact by means of language, is a necessary and sometimes daunting learning task for second and foreign language learners. This chapter will review central issues and findings in second language (L2) developmental pragmatics, examine the effects of instruction, and provide an overview of data collection methods.

LanguEdge™ Courseware is a software tool that is designed to help teachers of English as a second language (ESL) build and assess the communicative skills of their students. The purpose of this study was to generate information to help LanguEdge Courseware users understand better the meaning (or validity) of the assessment scores bases on the LanguEdge Courseware. Specifically, the objective was to describe, for each of the four sections of the LanguEdge assessment, relevant characteristics of test takers at various test score levels. To accomplish this objective, we gathered data that represent two different perspectives—those of instructors and those of students themselves. Approximately 3,000 students each took one of two parallel forms of the LanguEdge assessment at domestic and international testing sites. Participants also completed a number of self-assessment questions about their English language skills. In addition, for some study participants, instructors rated selected language skills. LanguEdge test scores related moderately (correlations mostly in the .30s and .40s) with student self-assessments. Of the four LanguEdge tests, Listening exhibited the strongest relationships to self-assessments; Speaking, the next strongest; Reading, the next; and Writing, the least. The correlations of faculty ratings with each of the LanguEdge section test scores were generally in the .40s, with some reaching the .50s. The correlations between the various student self-assessment scales and faculty ratings were modest, mostly in the .30s. These correlations suggest that students and faculty had different perspectives on students' English language skills.

This study investigates the social impact of a policy requiring university graduates to pass an English proficiency test by examining the consequences of test use in the workplace in Taiwan. Interviews were conducted with 19 business people in charge of recruiting potential employees in 17 industries across Taiwan. All these 19 employers hired the gratudes from a technological university in southern Taiwan. These interviews sought to discover the importance of English certification as an element of job hunting,the opinions of businesses regarding various certification tests, and their attitudes towards the exit requirement. Findings indicate that although these employers were favorably disposed towards this policy, only 13 % of them required English certificates as a hiring criterion. Another finding was that 53 % of employers regarded the certificates as evidence that applicants who possessed them were diligent and likely to be hard-working employees. These informants interpreted tests differently from testers, focusing on cultural notions of what personal qualities tests highlight rather than on language ability. Due to this and other factors, the impact of the test remained weak.