Search

This research goal to develop a multiple-choice closed-ended test to assessing and evaluate students' digital literacy skills. The sample in this study were students at MTsN 1 Blitar City who were selected using a purposive sampling technique. The test was also validated by experts, namely 2 Doctors of Physics and Science from Yogyakarta State University. The test instrument was developed based on five aspects of digital literacy skills: information, communication, content creation, security and problem-solving. Data have been analyzed descriptively and inferentially using the Rasch version and the assist of Quest software. The results showed that eight multiple-choice closed-ended test instruments were declared valid based on expert validation with an Aiken V value of 1.00. The reliability result is 0.97 with a very high category, and the INFIT MNSQ standard deviation value is 0.86-1.16, so seven items are by the Rasch model. Thus, the seven items in the multiple-choice closed-ended test instrument can be used to assessing and evaluate students' digital literacy skills in learning science.

The examination of the testing mode effect has received increased attention as higher education has shifted to remote testing during the COVID-19 pandemic. We believe the testing mode effect consists of four components: the ability to physically write on the test, the method of answer recording, the proctoring/testing environment, and the effect testing mode has on instructor question selection. This paper examines the first component, the ability to write on the test, which we believe is a neglected area of study. Using a normalization technique to control for student aptitude and instructor bias, we find that removing the ability of students to physically write on the test significantly lowers student performance. This finding holds across multiple question types classified by difficulty level, Bloom's taxonomy, and on figure/graph-based questions, and has implications for testing in both face-to-face and online environments.

Testing is an effective method to determine learning outcomes for knowledge and skills learning domains. The aim of this study was to examine the differences in test achievements among 50 Saudi female English major students at the College of Languages at Princess Nourah University in Riyadh. The tests were administered using two different methods: paper-based and Blackboard-based (online). Additionally, the study explored the impact of these two test methods on students' achievement in terms of course learning outcomes. The results of the study indicated that there was no significant difference between the two test methods in terms of overall test scores. However, it was found that the Blackboard-based test resulted in slightly higher scores for knowledge domain outcomes, while the paper-based test showed higher scores for skills domain outcomes. The results obtained in this study suggest that both paper-based and Blackboard-based test methods can be equally effective at assessing the general achievement of students. However, the choice of test method may have a slight impact on the specific learning outcomes being assessed, with Blackboard-based tests favouring knowledge domain outcomes and paper-based tests favouring skills domain outcomes. Furthermore, when using Blackboard-based tests, time pressure should be taken into consideration, as it is observed to significantly influence students' performance in both learning domains.

The present research reports the findings of the study that sought to examine the in-service training needs of in-service EFL teachers in the language testing and assessment field. With this aim, four domains of language testing and assessment field were identified which were classroom-focused LTA, knowledge of testing and assessment, purposes of testing, and content and concepts of LTA. Quantitative research design was employed in this study and quantitative data was collected through a questionnaire. A total of 300 in-service EFL teachers working in different formal and non-formal education institutions participated in this study. The quantitative data was analyzed using descriptive statistics. Results indicated that these in-service EFL teachers need an intermediate level of further training in the LTA field. The area where need for training was expressed more was "content and concepts of LTA" and "classroom-focused LTA" was the domain where need for in-service training was revealed less. The findings of this study will serve as needs analysis for in-service programs and will be beneficial for curriculum development, teacher education programs, and more specifically assessment courses offered in pre- and INSET programs.

During the COVID pandemic, universities around the globe had to move not only their content delivery online, but also their assessments. Due to COVID causing significant upheaval in Higher Education (HE), this enforced experiment also afforded an opportunity to reflect on traditional, invigilated, closed book exams (ICBE) resulting in research and advice in this area. A systematic review of this academic and grey literature was performed concentrating on maths heavy physics examinations to investigate what guidance is given to examination writers, educators who prepare students for exams and HE examinees themselves. The literature review results were divided into: Advice for examiners who need to provide an uinvigilated open book exam (UOBE), discussions on cheating, advice for students and case studies. It was found that ICBEs were good at examining lower order cognitive skills, e.g. recall and understanding, but higher order skills, such as analysing and synthesising, are better examined with access to a larger range of resources. Guidance on making academic misconduct more difficult also suggested using higher order thinking skills in exam questions as responses to these types of tasks are more individual and getting outside help may be more difficult in a time constrained UOBE. Furthermore, literature encouraged reflection on the motivation for cheating and suggested that overly demanding assessment may encourage students to seek inappropriate help. The advice for students highlighted the need to prepare as thoroughly for a UOBE as they would for a traditional exam. Probably the thrust should change from pure memorization to students preparing their notes so that they can efficiently access their material to locate relevant parts for synthesis during a UOBE. Some of the case studies used statistical methods to investigate comparability of grades between UOBEs and ICBEs and some of the studies found them comparable, so a large shift of results may be due to other factors rather than the exam type. Other studies describe their approach and include stakeholder reflections. The main recommendation to exclude lower cognitive skills can pose a problem for maths heavy exams as they mainly assess how well an examinee has mastered these skills before building on them. However, it seems advisable to climb higher up Bloom's taxonomy if possible. Also, it may be conceivable to break up exams into shorter sections that require individual uploading before access to the next part is granted to reduce the possibility of outside help. Furthermore, individualised maths type problems could be achievable by using different data sets for a question. Student advice should highlight the differences between UOBEs and ICBEs so that they can prepare appropriately.

This research paper investigated the importance of conducting measurement invariance analysis in developing measurement tools for assessing differences between and among study variables. Most of the studies, which tended to develop an inventory to assess the existence of an attitude, behavior, belief, IQ, or an intuition in a person's characterological profile, ignored testing measurement invariance for equivalency between comparable variables. With this finding, measurers lack in true validity and reliability and suffer methodological bias and have little or no chance to figure out the true differences between variables being studied. This article, therefore, explains the necessity and use of measurement invariance analysis when a researcher wanted to develop a new measurement tool or adapt a tool from one source language to another target language. The types of measurement invariance levels mentioned in this study are configural-invariance, scalar invariance, metric invariance and structural invariance analysis. The approaches used to conduct those invariance models and the way they have been interpreted were all discussed in great detail with a robust collection of supportive literature.

Demand for online courses continues to grow. To remain competitive, higher education institutions must accede to this demand while ensuring that academic rigor and integrity are maintained. The authors teach introductory Fundamentals of Financial and Managerial Accounting courses online. Previously, there was no proctoring of the exams. Prior experience teaching these courses led the professors to suspect a high likelihood that academic integrity on these tests was low and that cheating was high. To address academic integrity concerns, the professors utilized a remote proctoring service employing a lockdown browser with screen and webcam monitoring. The program monitors the students remotely, recording sound, video and the information appearing on the students' screens. The videos are reviewed for detectable instances of breach of academic integrity prior to releasing the grades. Data was collected and analyzed for the average exam scores prior to and after the implementation of the remote proctoring software. The data analysis reveals a significant difference in the two sets of scores, with the average exam scores after the implementation of the remote proctoring being significantly lower than the ones before implementation. These results indicate that concern about academic integrity in online test-taking in the accounting curriculum is valid.

The present study examines how online instruction during the COVID pandemic impacted learning and performs a partial replication of a study by Hahn et al. (2012), which compared students' testing outcomes of the Major Field Test in Business (MFTB) and the Comprehensive Business Exam (CBE). Our results find that online instruction during the 2020-2021 pandemic isolation period had no significant impact on pre- and post-COVID testing outcomes for either exam. It was further found that the question set employed by the CBE exam appears to have changed from the pre- to the post-COVID testing timeframes, making this exam questionable for assurance of learning purposes when comparing to prior year results.

This manuscript aimed to develop an instrument assessing vocational values among students (VVS-S). The scale was developed in French using three different samples of Togolese participants for item development (N = 140), exploratory (N = 308) and confirmatory analyses (N = 300). It consists of 17 items divided into the five subscales of Power, Family, Helping, Salary, and Creativity. The correlational, higher-order, and bifactor models showed that these values could be considered independently. Moreover, four of the values correlated positively but weakly with life satisfaction. The VVS-S's usefulness for research and practice in counseling, particularly in sub-Saharan Africa, is discussed.

Data on attaining indicators of early speech, language, and literacy development, notably phonological awareness, among children with visual impairments (VI) are limited. This U.S. study utilized the "National Survey of Children's Health" (NSCH), 2016-2020, to observe the distinctive population of children with VI and speech, language, and literacy needs. Chi-square bivariate and multivariable logistic regression analyses established differences between children ages 3 to 5 years with VI (n = 186) and without VI (n = 25,354). Significant differences included lower parental education and higher rates of family poverty for children with VI. Significantly fewer children with VI had attained early phonological awareness (identifying initial sounds in words and word rhyming). Nearly three times more children with VI had been diagnosed with a speech or language disorder. Findings affirm that interventions address speech, language, and literacy development among children with VI, including explicit phonological awareness. Communication disorders research based on population health databases can inform evidence-based practice.

In various fields, including college admission, medical board certifications, and military recruitment, high-stakes decisions are frequently made based on scores obtained from large-scale assessments. These decisions necessitate precise and reliable scores that enable valid inferences to be drawn about test-takers. However, the ability of such tests to provide reliable, accurate inference on a test-taker's performance could be jeopardized by aberrant test-taking practices, for instance, practicing real items prior to the test. As a result, it is crucial for administrators of such assessments to develop strategies that detect potential aberrant test-takers after data collection. The aim of this study is to explore the implementation of machine learning methods in combination with multimodal data fusion strategies that integrate bio-information technology, such as eye-tracking, and psychometric measures, including response times and item responses, to detect aberrant test-taking behaviors in technology-assisted remote testing settings.

In recent years, many schools have started implementing remote teaching due to the impact of the COVID-19. Flipped classroom has been proven to be a student-centered teaching method that can effectively improve learning effectiveness. Nonetheless, if students fail to watch the instructional videos prior to class or encounter difficulties during the learning process, it can result in unfavorable learning outcomes. Therefore, this study proposes the use of the flipped classroom combined with the WPACQ learning model for programming courses. During the pre-class phase, students engage in online collaboration with their classmates, working together to accomplish the tasks outlined in the flipped classroom learning sheet. They actively share essential summaries with peers, engage in collective problem-solving of concepts and processes, all with the ultimate goal of enhancing the effectiveness of their learning experience. This study will develop a learning system that combines the flipped classroom with the WPACQ learning model, guiding learners to adopt the WPACQ learning strategy. In this system, the experimental group learners go through stages including watching instructional videos (Watch), guided outline-style note-taking with peers (Peer-Summary), unit test (Assessment), error correction (Correction), and final questioning (Question). Through viewing peer-summary key notes and engaging in error correction activities with peers, learners cultivate the ability to summarize key points and deepen their understanding of the learning content. They reflect on their own learning process to identify areas for improvement. The research results demonstrate that learners who adopt the flipped classroom combined with the WPACQ learning model exhibit better learning effectiveness compared to those using the conventional flipped classroom learning model. Furthermore, this approach effectively helps learners enhance their learning motivation, self-efficacy, reflective abilities, programming learning attitudes, and reduce cognitive load.

The testing effect refers to the gains in learning and retention that result from taking practice tests before the final test. Understanding the conditions under which practice tests improve learning is crucial, so four experiments were conducted with a total of 438 undergraduate students in Turkey. In the first study, students who took graded practice tests outperformed those who took them as ungraded practice. In the second study, students who took short-answer questions before the first exam and multiple-choice questions before the second exam scored higher on the second exam. In the third study, multiple-choice, short-answer and hybrid questions produced similar learning gains. In the fourth study, students who received detailed feedback immediately after class performed similarly to those who received feedback at the beginning of the next class. The results suggested the contribution of graded practice tests in general; however, the type of questions or the timing of feedback did not predict learning outcomes.

Numerous studies have revealed an alarming prevalence of test anxiety among Chinese junior high school students. Prevention of test anxiety in this population has become crucial. Brief meditation intervention (BMI) has shown promising results for promoting students' well-being and reducing test anxiety, but its mechanism for reducing test anxiety remains unknown. This study examined the effects of BMI and the roles mindfulness and self-efficacy play in mediating between the intervention and test anxiety. The BMI was optimized in content and form and culturally tailored for Chinese eighth graders. It includes guided meditation with relaxation music, mindful breathing and body scanning, and positive suggestions that promote self-efficacy. Six eighth grade classes at an urban junior high school in Beijing (N = 202, M[subscript age] = 14.14, 102 males) were assigned to either a BMI group (3 classes, N = 103) or a control group (3 classes, N = 99). Test anxiety, mindfulness, and self-efficacy measures were administered before, in the middle of, immediately after, and one month after the intervention. Repeated measures ANOVA and mediation analysis indicated that BMI had a significant effect on reducing test anxiety and enhancing mindfulness and self-efficacy over time. The study also found that mindfulness and self-efficacy played a chain of mediating roles in the relationship between BMI and test anxiety. The mediation effect value accounted for 68.35% of the intervention effects.

Computer-assisted language assessment literacy (LAL) has gained momentum in English as a foreign language (EFL) teaching since computer-based education became particularly common in language education. As EFL teachers play a critical role in administering computer-assisted language assessments, Iranian EFL teachers need to learn, relearn, and improve their computer-assisted LAL. Iranian EFL teachers can use collaborative reflection (CR) to improve their computer-assisted LAL and practices. This study, therefore, qualitatively investigated how collaborative reflective practices can improve novice and experienced EFL teachers' computer-assisted LAL. To achieve the goals of the present study, we adopted an instrumental case study to explore how EFL teachers perceive the benefits, applications, and challenges of computer-assisted language assessment practices and how teachers could improve their computer-assisted LAL through virtual CR. Four novice and experienced EFL teachers were selected purposively to explore internet-based CR through social media, observations, and interviews. The data were qualitatively analyzed through inductive thematic analysis. The results of the study demonstrated that computer-assisted language assessment practices enhanced the quality of formative assessment and assessment for learning, authenticity, and meaningfulness of tasks, administration, scoring, and interpretation, among others. Furthermore, EFL teachers experienced various personal, social, educational, and professional advantages of their computer-based language assessment practices through internet-based CR. The pedagogical implications of the study for the development of computer-assisted LAL of EFL in-service language teachers through online reflective practices are discussed.

This study employed the Systematic Review (SR) methodology to examine the content and reasons for resisting the implementation of Continuous Assessment Learning Activities (CALA) in Zimbabwean Secondary schools. The Overcoming Resistance to Change (ORC) model was exploited as the analytical lenses. The study found that factors such as education, training, communication, participation, cost, motivation and resources determined the acceptance or rejection of the implementation of CALA. The shortage or absence of these elements has resulted in intensified resistance to the implementation of CALA. This study therefore recommends sustained effort in raising the level of education, communication, training, participation and motivation teachers, parents, and learners. In addition, the government of Zimbabwe should increase its support through cost bearing and resources supply as required to meet the demands of CALA.

This study analyzes the alignment between the educational policy of Turkey and high-stakes tests administered for students transitioning from secondary to high school. Research questions focus on the opinions of secondary school teachers about the alignment between transit exam questions and curricula, course books and materials, and their views on high-stakes testing. The research used a survey study model utilizing the triangulation design. A total of 109 teachers from six different majors working in Ankara participated in the study. An online survey consisting of eight questions was used to get teachers' opinions. The research question was analyzed using quantitative (percentages) and qualitative (content analysis) methods. Results showed that education serves dominantly for tests emphasizing a testing-oriented education system in the current Turkish learning and teaching process, which contrasts with education policy documents targeting 2023.

Large-scale performance assessment programs are a longstanding reform tool. However, standard setting can be a challenge for assessment programs that use primarily non-standardized assessments. The purpose of this paper is to extend this field of research by explaining the standard setting methodology applied to one more recent instantiation of a state performance assessment program. The second purpose of this paper is to discuss the data quality control and quality assurance challenges experienced after five years of applying the standard setting method. Recognizing the burgeoning interest again in large-scale performance assessment programs, the goal and intended contribution of this paper is to inform future decisions about selecting appropriate standard setting methods and dealing with unanticipated challenges that may arise during implementation based upon the lessons learned from one program. It is likely that other large-scale performance assessment programs may face similar operational challenges, especially those that do not rely on standardized tests or standardized administration procedures to produce annual determinations of student proficiency or other scores used for accountability purposes. Assessment system designers can use the insights in this paper to consider standard setting methods and how those methods may need to be adapted to promote technical quality.

Resit exams allow students who have failed a subject a second chance to demonstrate achievement of the academic standards required for program progression. Contrary to previous studies in this field, this paper reports on the value of resit exams with a comprehensive discussion of the lessons learned from the implementation of resits in different conditions and is intended to assist educators to decide whether such exams are a useful and fair way to promote student progression. The data were obtained from student academic performance metrics, a survey with a total of 444 students, six student focus group interviews with a total of 29 students, and three individual staff interviews. The study suggests the benefits of resit exams as a tool to improve student learning outcomes and progression, especially with the close relationship between resit exams and threshold and high-stakes assessment requirements. While the psychological and progression benefits of resit exams were acknowledged by the participants, concerns were expressed about some aspects of the way the school offered the resits and the issue of inequality. Alternatives were proposed to avoid unnecessary failure and promote learning.

In this article, we report the results of a study through which we collected English language teachers' needs and wants to design an online language assessment course. Through a mixed-methods approach, we asked 20 teachers from four Latin American countries what they wanted to learn in the course. The teachers wanted a course in which they could address the challenges they faced in assessment; discuss and develop new ways to assess; and learn about authentic, valid, and ethical assessment. Therefore, the findings suggest that the teachers wanted a course that mixed theory, practice, and principles of assessment. Additionally, the course should address emerging topics in English language assessment, namely bilingual assessment and the assessment of learners with special educational needs.

Cheating in examinations across the globe is an issue of growing concern. This study argues that the culture of cheating in exams in Balochistan has reduced the efficiency of human resource and has resulted in producing students with high qualifications but less potential in the province. Therefore, it is very important to explore the factors contributing to cheating in exams and to suggest a course of action to mitigate the menace it poses. A quantitative research method was employed for this study. Similarly, statistical techniques such as correlation and logistic regression were conducted for statistical analysis and explanation of the study using SPSS. Theoretically, the study is inspired by rational choice theory. The findings of the study show a significant relationship between personal, institutional, and situational factors. Personal factors that contribute to cheating were found to be students' desire to excel, low GPA, and slow learning. Institutional factors include the weak administrative role of institutions, poor academic policies, overload on students, and weak performance of the teachers. Situational factors such as the poor management strategy of the examiner, time pressure, and technological tools were found to be instigating students towards cheating. The study suggests that an appropriate exam hall setting, effective monitoring, concept-oriented exams, and a strong honor code can decrease cheating.

This article explores student perceptions of writing online examinations for the first time during the COVID-19 pandemic. Prior to the pandemic, examinations at an open and distance learning institution in South Africa were conducted as venue-based examinations. From March 2020, all examinations were moved online. Online examinations were introduced as an emergency measure to adhere to safety and health protocols. Although students in developed countries have indicated benefits to online examinations, less is known about students living in the Global South when it comes to writing examinations online. Not enough is known about the benefits and challenges of online examinations since they were implemented as an emergency measure. We aimed at exploring student perceptions of writing online examinations for the first time, to improve examination processes by including student views. Through an analysis of 336 written responses to an open-ended question posed at the end of an online survey, we established that digital access, duration of the examination, and the examination system interface affected students' success in online examinations. Based on the findings, we recommend that students need to be given tools and data to participate in online examinations. Furthermore, students should be granted ample opportunity to practise writing online examinations while receiving the necessary support.

Literature review shows that the development process of an achievement test is mainly investigated in dissertations. Moreover, preparing a form that will shed light on developing an achievement test is expected to guide those who will administer the test. In this line, the current study aims to create an "Achievement Test Development Process Control Form" and investigate the achievement tests for Maths based on this form. Document analysis was conducted within the framework of qualitative research and was done based on descriptive analysis. Within the scope of the research, 1683 articles published in designated journals between 2015-2020 were reviewed. It was determined that a mathematics achievement test was developed in 39 of these articles, which were coded on the control form. The articles that were included in the scope of the current study were investigated in terms of the type of items used in the tests, the theory or practice on which the test was developed, the use of rubric for open-ended items, the number of items in the pilot and final form, features of the test form as well as those pertaining to the table of specifications, the features of item pool, the evaluation of pilot testing, the evaluation of real study, test validity and reliability, and the setting in which tests were administered. The current study findings show that mostly an item pool was not prepared, the pilot application was not conducted or was not specified, and even if it was conducted, item analysis was not performed, test forms or example items were not included in the articles, and there were some deficiencies regarding validity. On the other hand, it was clear that the articles mostly specified the test goal and reported the reliability coefficient. In light of the current findings, some suggestions are provided for test developers and those who will administer these tests.

Educational equity is understood as the recognition of a school system to ensure resources to safeguard that all students have equitable access, opportunity, and outcomes (Galloway & Ishimaru, 2015). Yet inequity persists in the American educational system. School accountability remains at the forefront of education policy to ensure equitable achievement between students from all backgrounds regardless of race, ethnicity, family income, linguistic background, and ability (Krejsler, 2018; Skrla, 2001). This article reflects a qualitative approach to understanding public school superintendent voices regarding experiences, feelings, and beliefs related to our ongoing era of accountability in a changing social environment. This study examines the results of interviews of 13 public school superintendents in a large metropolitan area and identifies emergent themes in superintendent thinking as it revolves around school accountability. These themes are couched in larger discussion of educational equity.

In this study, Kernel test equating methods were compared under NEAT and NEC designs. In NEAT design, Kernel post-stratification and chain equating methods taking into account optimal and large bandwidths were compared. In the NEC design, gender and/or computer/tablet use was considered as a covariate, and Kernel test equating methods were performed by using these covariates and considering bandwidths. The study shows that, in the NEAT design, Kernel chain equating methods exhibit higher error than the post-stratification equating methods do since the lowest error in the NEC design was obtained from the Kernel equating method with large bandwidth through the computer/tablet variable. Kernel test equating results based on the NEC design, which considers gender and computer tablet use variables as a covariate separately, showed lower SEE than that of the NEC pattern, which takes these variables together as covariates. In terms of the bandwidth, when all methods are compared within the pattern used (i.e., NEAT and NEC), it has been seen that generally Kernel test equating with large bandwidth results in fewer errors than the Kernel test equating with optimal bandwidth. When the NEAT and NEC designs are compared generally, the NEAT design has a lower SEE than that of the NEC design.

Assessment policy in England is often of public significance. Assessments, especially GCSEs, A levels and their vocational equivalents, have significant stakes for candidates and wider society (including for school accountability and for selection to higher education). Such assessments are frequently critiqued. There has been little major (intended) assessment reform since early 2010s developments under Michael Gove. However, the COVID-19 pandemic has upended previous certainties about assessment. Consequently, a number of reports from educationalists and think tanks into how things might be done differently in the future have been published since 2020. In this article, I overview these reports, explore similarities and differences, and assess the policy changes they recommend. The ideas are explored in relation to four overarching themes: high stakes assessment at 16, the use of online or digital assessment, the number of subjects studied in each phase, and the relationship of academic to vocational study.

A critical part of supporting the development of students' algorithmic thinking is understanding the challenges that emerge when students engage with algorithmatizing tasks--tasks that require the creation of an algorithm. Knowledge of these challenges can serve as a basis upon which educators can build effective strategies for enhancing students' algorithmic thinking skills. This paper presents three illustrative cases of emergent challenges evident as students grapple with the process of creating an algorithm. The first challenge highlights discrepancies between the method with which students solve a problem and the algorithm they create, and claim would, when implemented, solve the same problem. The second challenge pertains to the persistence of students' normatively incorrect algorithms, despite going through multiple iterations of testing and revising. Finally, the third challenge concerns issues around the use of test problems for supporting students in their creation of generalized algorithms. These three challenges are discussed using student data (illustrative cases) from three different mathematical algorithmatizing tasks. Suggestions are put forth for addressing some of these challenges, with a particular emphasis on practical pedagogical suggestions for cultivating students' mathematical thinking in the context of algorithmatizing tasks.

One of the biggest challenges for online learning is upholding academic integrity in online assessments. In particular, institutions and faculties attach importance to exam security and academic dishonesty in the online learning process. The aim of this study was to compare the test-taking behaviors and academic achievements of students in proctored and unproctored online exam environments. The log records of students in proctored and unproctored online exam environments were compared using visualization and log analysis methods. The results showed that while a significant difference was found between time spent on the first question on the exam, total time spent on the exam, and the mean and median times spent on each question, there was no significant difference between the exam scores of students in proctored and unproctored groups. In other words, it has been observed that reliable exams can be conducted without the need for proctoring through an appropriate assessment design (e.g., using multiple low-stake formative exams instead of a single high-stake summative exam). The results will guide instructors in designing assessments for their online courses. It is also expected to help researchers in how exam logs can be analyzed and in extracting insights regarding students' exam-taking behaviors from the logs.

Research on multi-attempt online assessments is sparse and inconclusive and lacks the voice of students. To help bridge the gap, this paper analyzes student survey data across multiple supply chain management classes. The results show that students prefer three attempts on quantitative assessments. The preferences do not depend on age, gender or GPA. Other findings indicate that students favor concrete feedback over abstract. Rather than have the correct answer given away, students prefer the type of feedback that allows them to solve the problem on their own. This study helps pave the way to better understanding of effectiveness of and student satisfaction with different assessment settings of online assessments of quantitative assignments.

Two-stage testing is a form of collaborative assessment that creates an active learning environment during test taking. In two-stage testing, students first complete an exam individually, and then complete a subset of the same questions as part of a learning team with the ultimate exam score being a weighted average of the individual and team portions. In the second (team-based) part of the exam, students are encouraged to discuss solutions until a consensus among team members is achieved, thus actively engaging students with course material and each other during the exam. A short open-ended survey was administered to students at the end of the semester, and the responses coded by thematic analysis, with themes generated using inductive coding based on the principles of grounded theory. The most important conclusion was that students overwhelmingly preferred two-stage tests for the development of positive peer relationships in class. The most common themes that emerged from student responses involved positive feelings from forced interaction with their peers, the benefits of meeting and socializing with other students, sharing of knowledge with others, and solidarity or positive affect towards the process of working as part of a team. Finally, students also expressed an overall preference for two-stage exams when compared to solely individual, one-stage exams.