Search

The COVID-19 pandemic in Singapore led to limited access to mental health services, resulting in increased distress among the population. This study explores the potential benefits of offering a digital mental health intervention (DMHI), Wysa, as a brief and longitudinal intervention as part of the mindline.sg initiative launched by the MOH Office for Healthcare Transformation in Singapore. The paper aims to (i) Evaluate the engagement and retention of Singaporean users across the brief intervention on the mindline.sg website and the longitudinal app version of Wysa; (ii) Examine the types of negative thoughts and challenges managed during the pandemic; and (iii) Assess the impact of the conversational agent (CA) in supporting cognitive restructuring across attributional styles and cognitive patterns. A retrospective observational design with a mixed-methods approach was utilized. Website users ( N  = 69,055) and app users ( N  = 4,103) from September 1, 2020, to July 25, 2022, were included in the study. Engagement and retention were evaluated through usage data, and T-tests were used to compare engagement and retention between the app and website. A thematic analysis assessed the types of negative thoughts and the success of cognitive restructuring. Logistic regression was used to estimate the likelihood of restructuring based on negative thought type and attributional style. Users who used the longitudinal intervention after first using a brief intervention demonstrated significantly higher engagement and retention ( P  < 0.001). In user ratings received for mindline.sg ( n  = 8,959), 83.03% rated the app 3 or higher (out of 5) on helpfulness. 91.6% of the users ( n  = 862) who attempted cognitive restructuring ( n  = 790) on the app successfully reframed a thought. A single conversation with Wysa was also significantly associated with the ability to restructure future-oriented negative thoughts ( P  < 0.001) and internal, stable and global ( P  < 0.001) negative thoughts, while other attributional styles required more intervention. Psychosocial challenges managed by users during COVID-19 were also documented through negative thoughts mentioned within the CA. The findings demonstrate that brief interventions can facilitate enhanced engagement with DMHIs and that digital interventions can successfully facilitate cognitive restructuring and improve mental health outcomes. The study provides useful inputs to guide the development of DMHIs and improve their effectiveness., Competing Interests: CS and DD are employees of Wysa Inc. and CS owns equity in the company. YP and CH work with the MOH Office for Healthcare Transformation, Singapore, which created mindline.sg., (© 2024 Sinha, Dinesh, Heaukulani and Phang.)

Background: The website mindline.sg is a stress management and coping website that can be accessed anonymously in Singapore for free. Although designed to serve individuals who are well or have mild depression and anxiety symptoms, mindline.sg may potentially be used by clinicians as an adjunct therapeutic aid for patients with clinically diagnosed mental disorders., Objective: This study aims to determine the perceived usability, acceptability, and usefulness of mindline.sg among individuals with diagnosed mental disorders in a clinical setting., Methods: A cross-sectional study with 173 participants was conducted in the waiting room of a psychiatrist's office at the National University Hospital in Singapore. Participants waiting for an appointment were given 30 minutes and a simple set of instructions to use three features of mindline.sg. They subsequently answered a set of web-based survey questions via their smartphones, including a 16-item subset of the Post-Study System Usability Questionnaire (PSSUQ) for usability measurement and 5 questions designed to understand the perceived usefulness and acceptability of mindline.sg. Multiple linear regression is used to determine the associated demographic factors with overall PSSUQ score. A chi-square test is performed to investigate associations of psychiatric condition with users' responses on acceptability and perceived usefulness of mindline.sg. For this study, P<.05 is considered significant., Results: We observed that the overall (mean 2.86, SD 1.46), system usefulness (mean 2.74, SD 1.46), and information quality (mean 2.98, SD 1.33) subscores of the PSSUQ survey are within a 99% CI of a literature-derived norm, which all have the interpretation of having high perceived usability. However, interface quality (mean 2.98, SD 1.33) scored lower than the literature-derived norm, although it is still better than the neutral score of 4. We find participants with lower than a General Certificate of Education O-Level or N-Level education tend to give a lower usability score as compared to others (β=.49; P=.02). Participants who have not been hospitalized previously due to their condition are also more likely to give a lower PSSUQ score as compared to individuals who have been hospitalized (β=.18; P=.03). The platform mindline.sg is also deemed to be generally useful and acceptable with all the survey questions receiving more than a 60% positive response. We found no association between the type(s) of self-reported psychiatric disorder(s) and the perceived usefulness and acceptability of mindline.sg., Conclusions: Our results show that mindline.sg is generally perceived as usable and acceptable by individuals with a diagnosed mental disorder in Singapore. The study suggests improving usability among individuals with lower education levels. Particularly promising is the finding that previously hospitalized individuals have significantly higher perceived usability and satisfaction of the website, suggesting potential impact could be found among a moderately to severely at-risk clinical population. The effectiveness of mindline.sg as an adjunct therapy for individuals with diagnosed mental disorders should therefore be explored in future studies., (©Ye Sheng Phang, Creighton Heaukulani, Wijaya Martanto, Robert Morris, Mian Mian Tong, Roger Ho. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 29.03.2023.)