Search

Student evaluations of college teaching have been endorsed and criticized for as long as they have been used as part of important decision-making practices in higher education. With the growth of distance education, the need for alternative approaches for these assessments has increased. We were interested in the extent to which outcomes were comparable across in-class and on-line course evaluations. We conducted a randomized controlled trial across 7 colleges, 25 departments, and 41 instructors at a large urban research university in the southeastern part of the United States. The distribution of ratings across demographic and comparison groups was similar. Response rates were lower for students participating online; however, none of the scale score differences between groups exceeded an effect size 0.21 and the estimated benefits were large. We discuss the advantages and disadvantages of alternative approaches for evaluating instruction in the context of past, current, and future research and practice.

Under the umbrella of ubiquitous technologies, many computational artifacts have been designed to enhance the learning experience in physical settings such as classrooms or playgrounds, but few of them focus on aiding orchestration. This paper presents a systematic evaluation of the signal orchestration system (SOS) used by students for a jigsaw activity in an authentic classroom setting. The SOS comprises multiple wearable personal signal devices and an orchestration signal manager. Color and sound signals can be configured in the manager to be transmitted to the personal devices worn by the students to indicate orchestration signals for collaboration. The comparison between the SOS and a paper-based method traditionally employed for the orchestration of the jigsaw collaborative pattern showed that students in the SOS group spent significantly less time organizing the activity, obtained higher scores in the tests, experienced a stronger feeling of group formation awareness, and reported having enjoyed the experience to a greater degree.

Home-based rehabilitation programs for older adults have demonstrated effectiveness, desirability, and reduced burden. However, the feasibility and effectiveness of balance-intervention training delivered through traditional paper-versus novel smartphone-based methods is unknown. Therefore, the purpose of this study was to evaluate if a home-based balance-intervention program could equally improve balance performance when delivered via smartphone or paper among adults over the age of 65. A total of 31 older adults were randomized into either a paper or phone group and completed a 4-week asynchronous self-guided balance intervention across 12 sessions for approximately 30 min per session. Baseline, 4-week, and 8-week walking and standing balance evaluations were performed, with exercise duration and adherence recorded. Additional self-reported measures were collected regarding the enjoyment, usability, difficulty, and length of the exercise program. Twenty-nine participants completed the balance program and three assessments, with no group differences found for any outcome measure. Older adults demonstrated an approximately 0.06 m/s faster gait velocity and modified balance strategies during walking and standing conditions following the intervention protocol. Participants further self-reported similar enjoyment, difficulty, and exercise effectiveness. Results of this study demonstrated the potential to safely deliver home-based interventions as well as the feasibility and effectiveness of delivering balance intervention through a smartphone-based application. [ABSTRACT FROM AUTHOR]

Although experimental evaluations have been labeled the "gold standard" of evidence for policy (U.S. Department of Education, 2003), evaluations without an analysis of costs are not sufficient for policymaking (Monk, 1995; Ross et al., 2007). Funding organizations now require cost-effectiveness data in most evaluations of effects. Yet, there is little guidance on how to integrate research on costs into efficacy or effectiveness evaluations. As a result, research proposals and papers are disjointed in the treatment of costs, implementation, and effects, and studies often miss opportunities to integrate what is learned from the cost component into what is learned about effectiveness. To address this issue, this paper uses common evaluation frameworks to provide guidance for integrating research on costs into the design of field experiments building on the ingredients method (Levin et al., 2018). The goal is to improve study design, resulting in more cohesive, efficient, and higher-quality evaluations.

Evidence-based medicine integrates results from randomized controlled trials (RCTs) and meta-analyses, combining the best external evidence with individual clinical expertise and patients' preferences. However, RCTs of surgery differ from those of medicine in that surgical performance is often assumed to be consistent. Yet, evaluating whether each surgery is performed to the same standard is quite challenging. As a primary issue, the novelty of this review is to emphasize—with a focus on orthopedic trauma—the advantage of having complete intra-operative image documentation, allowing the direct evaluation of the quality of the intra-operative technical performance. The absence of complete intra-operative image documentation leads to the inhomogeneity of case series, yielding inconsistent results due to the impossibility of a secondary analysis. Thus, comparisons and the reproduction of studies are difficult. Access to complete intra-operative image data in surgical RCTs allows not only secondary analysis but also comparisons with similar cases. Such complete data can be included in electronic papers. Offering these data to peers—in an accessible link—when presenting papers facilitates the selection process and improves publications for readers. Additionally, having access to the full set of image data for all presented cases serves as a rich resource for learning. It enables the reader to sift through the information and pinpoint the details that are most relevant to their individual needs, allowing them to potentially incorporate this knowledge into daily practice. A broad use of the concept of complete intra-operative image documentation is pivotal for bridging the gap between clinical research findings and real-world applications. Enhancing the quality of surgical RCTs would facilitate the equalization of evidence acquisition in both internal medicine and surgery. Joint effort by surgeons, scientific societies, publishers, and healthcare authorities is needed to support the ideas, implement economic requirements, and overcome the mental obstacles to its realization. [ABSTRACT FROM AUTHOR]

Background: Novel survey methods are needed to tackle declining response rates. The 2020 National Maternity Survey included a randomised controlled trial (RCT) and social media survey to compare different combinations of sampling and data collection methods with respect to: response rate, respondent representativeness, prevalence estimates of maternity indicators and cost. Methods: A two-armed parallel RCT and concurrent social media survey were conducted. Women in the RCT were sampled from ONS birth registrations and randomised to either a paper or push-to-web survey. Women in the social media survey self-selected through online adverts. The primary outcome was response rate in the paper and push-to-web surveys. In all surveys, respondent representativeness was assessed by comparing distributions of sociodemographic characteristics in respondents with those of the target population. External validity of prevalence estimates of maternity indicators was assessed by comparing weighted survey estimates with estimates from national routine data. Cost was also compared across surveys. Results: The response rate was higher in the paper survey (n = 2,446) compared to the push-to-web survey (n = 2,165)(30.6% versus 27.1%, difference = 3.5%, 95%CI = 2.1–4.9, p < 0.0001). Compared to the target population, respondents in all surveys were less likely to be aged < 25 years, of Black or Minority ethnicity, born outside the UK, living in disadvantaged areas, living without a partner and primiparous. Women in the social media survey (n = 1,316) were less representative of the target population compared to women in the paper and push-to-web surveys. For some maternity indicators, weighted survey estimates were close to estimates from routine data, for other indicators there were discrepancies; no survey demonstrated consistently higher external validity than the other two surveys. Compared to the paper survey, the cost saving per respondent was £5.45 for the push-to-web survey and £22.42 for the social media survey. Conclusions: Push-to-web surveys may cost less than paper surveys but do not necessarily result in higher response rates. Social media surveys cost significantly less than paper and push-to-web surveys, but sample size may be limited by eligibility criteria and recruitment window and respondents may be less representative of the target population. However, reduced representativeness does not necessarily introduce more bias in weighted survey estimates. [ABSTRACT FROM AUTHOR]

In people with bone and soft tissue injuries of the wrist, hand and/or fingers, do feedback-guided exercises performed on a tablet touchscreen hasten return to work, reduce healthcare usage and improve clinical recovery more than a home exercise program prescribed on paper? Randomised, parallel-group trial with concealed allocation, assessor blinding and intention-to-treat analysis. Seventy-four workers with limited functional ability due to bone and soft tissue injuries of the wrist, hand and/or fingers. Participants in the experimental and control groups received the same in-patient physiotherapy and occupational therapy. Participants in the experimental group received a home exercise program using the ReHand tablet application, which guides exercises performed on a tablet touchscreen with feedback, monitoring and progression. Participants in the control group were prescribed an evidence-based home exercise program on paper. The primary outcome was the time taken to return to work. Secondary outcomes included: healthcare usage (number of clinical appointments); and functional ability, pain intensity, and grip and pinch strength 2 and 4 weeks after randomisation. Compared with the control group, the experimental group: returned to work sooner (MD –18 days, 95% CI –33 to –3); required fewer physiotherapy sessions (MD –7.4, 95% CI –13.1 to –1.6), rehabilitation consultations (MD –1.9, 95% CI –3.6 to 0.3) and plastic surgery consultations (MD –3.6, 95% CI –6.3 to –0.9); and had better short-term recovery of functional ability and pinch strength. In people with bone and soft-tissue injuries of the wrist, hand and/or fingers, prescribing a feedback-guided home exercise program using a tablet-based application instead of a conventional program on paper hastened return to work and improved the short-term recovery of functional ability and pinch strength, while reducing the number of required healthcare appointments. ACTRN12619000344190 [ABSTRACT FROM AUTHOR]

Background: Promoting physical activity (PA) for university students is essential as PA levels decrease during the transition from secondary to higher education. Providing technology-supported university courses targeting students' PA levels may be a viable option to combat the problem. However, it is still unclear how and what technologies should be implemented in university courses to promote PA. This study aims to create a series of design principles for technology-supported physical education courses that aim to increase university students' PA knowledge, motivation and levels. Method: The proposed methodology underpinning the research program is a seven-phase design-based research (DBR) approach, with the seven phases encompassed in four sequential studies. These four studies are a systematic review, a qualitative focus group study, a pilot study, and a randomised controlled trial (RCT) study. The protocol paper aims to detail the plan for conducting the four studies in a comprehensive and transparent manner, thus contributing to the methodological evidence base in this field. Discussion: Design principles generated from this project will contribute to the growing evidence focusing on effective design and implementation features. Future practitioners can also use these to develop physical education courses that aim to promote university students' physical activity levels, knowledge, and motivation. Trial registration: The RCT registry number: ACTRN12622000712707, 18/05/2022. [ABSTRACT FROM AUTHOR]

Abstract Question In people who have undergone surgical carpal tunnel release, do sensorimotor-based exercises performed on the touchscreen of a tablet device improve outcomes more than a conventional home exercise program prescribed on paper? Design Randomised, parallel-group trial with concealed allocation, assessor blinding, and intention-to-treat analysis. Participants Fifty participants within 10 days of surgical carpal tunnel release. Intervention Each participant was prescribed a 4-week home exercise program. Participants in the experimental group received the ReHand tablet application, which administered and monitored exercises via the touchscreen. The control group was prescribed a home exercise program on paper, as is usual practice in the public hospital system. Outcome measures The primary outcome was functional ability of the hand, reported using the shortened form of the Disabilities of the Arm, Shoulder and Hand (QuickDASH) questionnaire. Secondary outcomes were grip strength, pain intensity measured on a 10-cm visual analogue scale, and dexterity measured with the Nine-Hole Peg Test. Outcomes were measured by a blinded assessor at baseline and at the end of the 4-week intervention period. Results At Week 4, functional ability improved significantly more in the experimental group than the control group (MD –21, 95% CI –33 to –9) on the QuickDASH score (0 to 100). Although the mean estimates of effect on the secondary outcome also all favoured the experimental group, none reached statistical significance: grip strength (MD 5.6 kg, 95% CI –0.5 to 11.7), pain (MD –1.4 cm, 95% CI –2.9 to 0.1), and dexterity (MD –1.3 seconds, 95% CI –3.7 to 1.1). Conclusion Use of the ReHand tablet application for early rehabilitation after carpal tunnel release is more effective in the recovery of functional ability than a conventional home exercise program. It remains unclear whether there are any benefits in grip strength, pain or dexterity. Trial registration ACTRN12618001887268. [ABSTRACT FROM AUTHOR]

The impact of COVID‐19 has underlined the need for reliable information to guide clinical practice and policy. This urgency has to be balanced against disruption to journal handling capacity and the continued need to ensure scientific rigour. We examined the reporting quality of highly disseminated COVID‐19 research papers using a bibliometric analysis examining reporting quality and risk of bias (RoB) amongst 250 top scoring Altmetric Attention Score (AAS) COVID‐19 research papers between January and April 2020. Method‐specific RoB tools were used to assess quality. After exclusions, 84 studies from 44 journals were included. Forty‐three (51%) were case series/studies, and only one was an randomized controlled trial. Most authors were from institutions based in China (n = 44, 52%). The median AAS and impact factor was 2015 (interquartile range [IQR] 1,105–4,051.5) and 12.8 (IQR 5–44.2) respectively. Nine studies (11%) utilized a formal reporting framework, 62 (74%) included a funding statement, and 41 (49%) were at high RoB. This review of the most widely disseminated COVID‐19 studies highlights a preponderance of low‐quality case series with few research papers adhering to good standards of reporting. It emphasizes the need for cautious interpretation of research and the increasingly vital responsibility that journals have in ensuring high‐quality publications. [ABSTRACT FROM AUTHOR]

• The use of the ProFibro app for six weeks was not more effective than the use of a traditional paper book with similar content for health-related quality of life, symptoms, or self-care agency in individuals with fibromyalgia. • Improvements on severity of symptoms in both groups suggest that the self-care program using a mobile app or a paper book may be beneficial in individuals with fibromyalgia. • The Sleep Strategies was the most used function of the ProFibro app, followed by the Exercise Program, and the diary for the practice of gratitude. The ProFibro application (app) was developed as a Mobile Health resource to promote self-care in fibromyalgia management. This study aimed to assess the effects of the use of the ProFibro app for six weeks compared to the use of a traditional paper book of similar content to improve health-related quality of life, symptoms, and self-care agency in individuals with fibromyalgia. Forty individuals with fibromyalgia were included in this randomized, single-blind, parallel trial. One group received intervention content using the ProFibro app on a smartphone while the other received similar information using a paper book. Participants were assessed at baseline and after six weeks. The primary outcome was the Revised Fibromyalgia Impact Questionnaire. Secondary outcomes were Widespread Pain Index, Pain Visual Analog Scale, Symptom Severity Scale, and Appraisal of Self-Care Agency Scale – Revised. No differences in changes were found between groups at the end of the treatment for any outcome. Both groups showed improvements in symptom severity. The use of the ProFibro app for six weeks was not more effective than the use of a traditional paper book with similar content for health-related quality of life, symptoms, or self-care agency in individuals with fibromyalgia. Both groups showed improvements from baseline on severity of symptoms, suggesting that the self-care program using a mobile app or a paper book may be beneficial for individuals with fibromyalgia. [ABSTRACT FROM AUTHOR]

Question Do people with musculoskeletal conditions better adhere to their home exercise programs when these are provided to them on an app with remote support compared to paper handouts? Design Randomised, parallel-group trial with intention-to-treat analysis. Participants Eighty participants with upper or lower limb musculoskeletal conditions were recruited to the trial. Each participant was prescribed a 4-week home exercise program by a physiotherapist at a tertiary teaching hospital in Australia. Participants were randomly assigned via a computer-generated concealed block randomisation procedure to either intervention (n = 40) or control (n = 40) groups. Intervention Participants in the intervention group received their home exercise programs on an app linked to the freely available website www.physiotherapyexercises.com . They also received supplementary phone calls and motivational text messages. Participants in the control group received their home exercise programs as a paper handout. Outcome measures Blinded assessors collected outcome measures at baseline and 4 weeks. The primary outcome was self-reported exercise adherence. There were five secondary outcomes, which captured functional performance, disability, patient satisfaction, perceptions of treatment effectiveness, and different aspects of adherence. Results Outcomes were available on 77 participants. The mean between-group difference for self-reported exercise adherence at 4 weeks was 1.3/11 points (95% CI 0.2 to 2.3), favouring the intervention group. The mean between-group difference for function was 0.9/11 points (95% CI 0.1 to 1.7) on the Patient-Specific Functional Scale, also favouring the intervention group. There were no significant between-group differences for the remaining outcomes. Conclusion People with musculoskeletal conditions adhere better to their home exercise programs when the programs are provided on an app with remote support compared to paper handouts; however, the clinical importance of this added adherence is unclear. Trial registration ACTRN12616000066482. [Lambert TE, Harvey LA, Avdalis C, Chen LW, Jeyalingam S, Pratt CA, Tatum HJ, Bowden JL, Lucas BR (2017) An app with remote support achieves better adherence to home exercise programs than paper handouts in people with musculoskeletal conditions: a randomised trial. Journal of Physiotherapy 63: 161–167] [ABSTRACT FROM AUTHOR]

In 2015, the first large‐scale placebo‐controlled trial designed to assess cardiovascular safety of glucose‐lowering with sodium–glucose co‐transporter 2 (SGLT2) inhibition in type 2 diabetes mellitus raised hypotheses that the class could favourably modify not only risk of atherosclerotic cardiovascular disease, but also hospitalization for heart failure, and the development or worsening of nephropathy. By the start of 2021, results from 10 large SGLT2 inhibitor placebo‐controlled clinical outcome trials randomizing ∼71 000 individuals have confirmed that SGLT2 inhibitors can provide clinical benefits for each of these types of outcome in a range of different populations. The cardiovascular and renal benefits of SGLT2 inhibitors appear to be larger than their comparatively modest effect on glycaemic control or glycosuria alone would predict, with three trials recently reporting that clinical benefits extend to individuals without diabetes mellitus who are at risk due to established heart failure, or albuminuric chronic kidney disease. This European Society of Cardiology position paper summarizes reported results from these 10 large clinical outcome trials considering separately each of the different types of cardiorenal benefit, summarizes key molecular and pathophysiological mechanisms, and provides a synopsis of metabolic effects and safety. We also describe ongoing placebo‐controlled trials among individuals with heart failure with preserved ejection fraction and among individuals with chronic kidney disease. [ABSTRACT FROM AUTHOR]

McKinney (2018) has argued that for the scholarship of teaching and learning (SoTL) to advance within a discipline, the integration of SoTL must be closely examined and opportunities for growth in SoTL must be recognized and discussed. To that end, this paper reflects on the degree to which SoTL is integrated into communication sciences and disorders (CSD) by examining a variety of topics: perspectives and theories historically valued by our discipline, existing supports for SoTL at various levels (i.e., individual teacher-scholars, departments, institutions, and the CSD discipline as a whole), the application of SoTL findings in teaching and learning. Four specific recommendations are made because of this examination and reflection.

Randomized A/B tests within online learning platforms represent an exciting direction in learning sciences. With minimal assumptions, they allow causal effect estimation without confounding bias and exact statistical inference even in small samples. However, often experimental samples and/or treatment effects are small, A/B tests are underpowered, and effect estimates are overly imprecise. Recent methodological advances have shown that power and statistical precision can be substantially boosted by coupling design-based causal estimation to machine-learning models of rich log data from historical users who were not in the experiment. Estimates using these techniques remain unbiased and inference remains exact without any additional assumptions. This paper reviews those methods and applies them to a new dataset including over 250 randomized A/B comparisons conducted within ASSISTments, an online learning platform. We compare results across experiments using four novel deep-learning models of auxiliary data and show that incorporating auxiliary data into causal estimates is roughly equivalent to increasing the sample size by 20% on average, or as much as 50-80% in some cases, relative to t-tests, and by about 10% on average, or as much as 30-50%, compared to cutting-edge machine learning unbiased estimates that use only data from the experiments. We show that the gains can be even larger for estimating subgroup effects, hold even when the remnant is unrepresentative of the A/B test sample, and extend to post-stratification population effects estimators.

To investigate if a written guide or augmented reality (AR) guide improves free recall of diversified chiropractic adjusting technique and to capture participants' impressions of the study in a poststudy questionnaire. Thirty-eight chiropractic students were evaluated for diversified listing (a nomenclature denoting vertebral malposition and correction) recall, pre-AR and post-AR, or written guide review. The vertebral segments used were C7 and T6. Two randomized groups reviewed an original course written guide (n = 18) or a new AR guide (n = 20). A Wilcoxon-Mann-Whitney (C7) and t test (T6) compared group differences in reevaluation scores. A poststudy questionnaire was given to capture participants' impressions of the study. Both groups showed no significant differences in free recall scores after reviewing the guides for C7 or T6. The poststudy questionnaire suggested a number of strategies could be used to improve current teaching material such as more detail in the written guides and organizing content into smaller blocks. Use of an AR or written guide does not seem to change participants' free recall ability when used to review diversified technique listings. The poststudy questionnaire was useful to identify strategies to improve currently used teaching material. [ABSTRACT FROM AUTHOR]

Objective Friction foot blisters are a common injury occurring in up to 39% of marathoners, the most common injury in adventure racing, and represent more than 70% of medical visits in multi-stage ultramarathons. The goal of the study was to determine whether paper tape could prevent foot blisters in ultramarathon runners. Methods This prospective randomized trial was undertaken during RacingThePlanet 155-mile (250-km), 7-day self-supported ultramarathons in China, Australia, Egypt, Chile, and Nepal in 2010 and 2011. Paper tape was applied prerace to one randomly selected foot, with the untreated foot acting as the own control. The study end point was development of a hot spot or blister on any location of either foot. Results One hundred thirty-six participants were enrolled with 90 (66%) having completed data for analysis. There were 36% women, with a mean age of 40 ± 9.4 years (range, 25–40 years) and pack weight of 11 ± 1.8 kg (range, 8–16 kg). All participants developed blisters, with 89% occurring by day 2 and 59% located on the toes. No protective effect was observed by the intervention (47 versus 35; 52% versus 39%; P = .22), with fewer blisters occurring around the tape on the experimental foot than under the tape (23 vs 31; 25.6% versus 34.4%), yet 84% of study participants when queried would choose paper tape for blister prevention in the future. Conclusions Although paper tape was not found to be significantly protective against blisters, the intervention was well tolerated with high user satisfaction. [ABSTRACT FROM AUTHOR]

Background: With advances in cancer diagnosis and treatment, women with early-stage breast cancer (ESBC) are living longer, increasing the number of patients receiving post-treatment follow-up care. Best-practice survivorship models recommend transitioning ESBC patients from oncology-provider (OP) care to community-based care. While developing materials for a future randomized controlled trial (RCT) to test the feasibility of a nurse-led Telephone Survivorship Clinic (TSC) for a smooth transition of ESBC survivors to follow-up care, we explored patients' and OPs' reactions to several of our proposed methods.Methods: We used a qualitative study design with thematic analysis and a two-pronged approach. We interviewed OPs, seeking feedback on ways to recruit their ESBC patients for the trial, and ESBC patients, seeking input on a questionnaire package assessing outcomes and processes in the trial.Results: OPs identified facilitators and barriers and offered suggestions for study design and recruitment process improvement. Facilitators included the novelty and utility of the study and simplicity of methods; barriers included lack of coordination between treating and discharging clinicians, time constraints, language barriers, motivation, and using a paper-based referral letter. OPs suggested using a combination of electronic and paper referral letters and supporting clinicians to help with recruitment. Patient advisors reported satisfaction with the content and length of the assessment package. However, they questioned the relevance of some questions (childhood trauma) while adding questions about trust in physicians and proximity to primary-care providers.Conclusions: OPs and patient advisors rated our methods for the proposed trial highly for their simplicity and relevance then suggested changes. These findings document processes that could be effective for cancer-patient recruitment in survivorship clinical trials. [ABSTRACT FROM AUTHOR]

Pain represents a common symptom of several diseases and is often associated with a reduction in rehabilitation outcomes and recovery. The effectiveness of pain alleviation by botulinum toxin has been recently demonstrated. We searched in PubMed the papers about this topic published in the last ten years, and we selected clinical trials, guidelines, meta-analyses, reviews, and systematic reviews. We used different approaches: multiperspective presentation, lexical evaluation, and systematic review. The systematic review was only performed for the randomized controlled trials. We predominantly found reviews and trials about the rehabilitation of stroke/brain injury and epicondylitis. The most common outcome measures were pain, function, and spasticity. Among the common words, pain was the most frequent and the terms were grouped into different families, especially concerning the outcomes. Rehabilitation showed a relatively low frequency. Finally, the systematic review showed moderate-low levels of bias which confirms the effectiveness of botulinum toxin for pain treatment. The current literature about botulinum toxin is wide and globally diffuse but with some limitations in study strategies and clearness in the formal presentation. The evidence justifies the use of botulinum toxin in treating pain in different diseases. [ABSTRACT FROM AUTHOR]

Although many patients suffer from taste disorder, methods to improve taste sensitivity are limited. To develop a taste recall training method to improve the perception of taste, 42 healthy individuals were randomly assigned to either the training or the control group. Using the filter paper disc method, participants in the training group were asked to match the four tastes (sweetness, saltiness, sourness, and bitterness) between those of taste recognition thresholds and those of a one-step higher concentration until they get them right. Then, they were asked to match the four tastes between those of one-step lower and one-step higher in concentration from their taste recognition thresholds until they get them right. Finally, they were asked to match the four tastes between those of one-step lower concentration and those of their taste recognition thresholds until they get them right. This training was repeated until perfectly matched. The taste recall training program led to a lowered taste recognition threshold in healthy adults for each taste quality, suggesting the improvement of taste sensitivity. This lowered threshold for each taste was observed with each additional training session. We conclude that this taste recall training method might be a therapeutic approach for treating taste disorder. [ABSTRACT FROM AUTHOR]

Background: Overall survival is the "gold standard" endpoint in cancer clinical trials. It plays a key role in determining the clinical- and cost-effectiveness of a new intervention and whether it is recommended for use in standard of care. The assessment of overall survival usually requires trial participants to be followed up for a long period of time. In this time, they may stop receiving the trial intervention and receive subsequent anti-cancer treatments, which also aim to extend survival, during trial follow-up. This can potentially change the interpretation of overall survival in the context of the clinical trial. This review aimed to determine how overall survival has been assessed in cancer clinical trials and whether subsequent anti-cancer treatments are considered. Methods: Two searches were conducted using MEDLINE within OVID© on the 9th of November 2021. The first sought to identify papers publishing overall survival results from randomised controlled trials in eight reputable journals and the second to identify papers mentioning or considering subsequent treatments. Papers published since 2010 were included if presenting or discussing overall survival in the context of treating cancer. Results: One hundred and thirty-four papers were included. The majority of these were presenting clinical trial results (98, 73%). Of these, 45 (46%) reported overall survival as a (co-) primary endpoint. A lower proportion of papers including overall survival as a (co-) primary endpoint compared to a secondary endpoint were published in recent years. The primary analysis of overall survival varied across the papers. Fifty-nine (60%) mentioned subsequent treatments. Seven papers performed additional analysis, primarily when patients in the control arm received the experimental treatment during trial follow-up (treatment switching). Discussion: Overall survival has steadily moved from being the primary to a secondary endpoint. However, it is still of interest with papers presenting overall survival results with the caveat of subsequent treatments, but little or no investigation into their effect. This review shows that there is a methodological gap for what researchers should do when trial participants receive anti-cancer treatment during trial follow-up. Future research will identify the stakeholder opinions, on how this methodological gap should be addressed. [ABSTRACT FROM AUTHOR]

Peer review is the backbone of academia and humans constitute a cornerstone of this process, being responsible for reviewing submissions and making the final acceptance/rejection decisions. Given that human decision-making is known to be susceptible to various cognitive biases, it is important to understand which (if any) biases are present in the peer-review process, and design the pipeline such that the impact of these biases is minimized. In this work, we focus on the dynamics of discussions between reviewers and investigate the presence of herding behaviour therein. Specifically, we aim to understand whether reviewers and discussion chairs get disproportionately influenced by the first argument presented in the discussion when (in case of reviewers) they form an independent opinion about the paper before discussing it with others. In conjunction with the review process of a large, top tier machine learning conference, we design and execute a randomized controlled trial that involves 1,544 papers and 2,797 reviewers with the goal of testing for the conditional causal effect of the discussion initiator's opinion on the outcome of a paper. Our experiment reveals no evidence of herding in peer-review discussions. This observation is in contrast with past work that has documented an undue influence of the first piece of information on the final decision (e.g., anchoring effect) and analyzed herding behaviour in other applications (e.g., financial markets). Regarding policy implications, the absence of the herding effect suggests that the current status quo of the absence of a unified policy towards discussion initiation does not result in an increased arbitrariness of the resulting decisions. [ABSTRACT FROM AUTHOR]