Usability evaluation of a web-based patient information system for individuals with severe mental health problems

Department of Nursing Science, University of Turku, Finland, Turku, Finland.
Journal of Advanced Nursing (Impact Factor: 1.69). 12/2010; 66(12):2701-10. DOI: 10.1111/j.1365-2648.2010.05411.x
Source: PubMed

ABSTRACT This paper is a report of a study conducted to compare service users', nursing students' and Registered Nurses' evaluations of the usability of a patient education website intended for individuals with severe mental health problems.
There is an obvious need for reliable mental health information on the Internet. When evaluating the usability of Internet-based patient education methods, the opinions of all parties need to be ascertained.
An explorative descriptive design was used. Twenty-one service users, 20 nursing students and 35 Registered Nurses were recruited for the study in 2003 and 2004. Data were collected using a self-developed questionnaire on the content, structure and visual appearance of the website.
Service users had positive attitudes towards computer and Internet use but they needed support when using the computer and Internet. According to the evaluations, the content, structure and visual appearance of the website were good and it could be adopted for clinical practise after minor revisions. There were some differences in the evaluations between participant groups. Nurses were the most critical group, and the service user group was the most satisfied, although they were less experienced with using both computers and the Internet.
It is especially important to include service users' evaluations at the early stages of the development process of Web-based patient education systems. It is possible to produce an information technology-based patient education system for individuals with severe mental health problems. Nurses working in psychiatric services need to pay more attention to supporting service users in computer and Internet use.

1 Bookmark
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Objectives: To describe the association of team climate with attitudes toward information and communication technology among nursing staff working on acute psychiatric wards. Background: Implementation of ICT applications in nursing practice brings new operating models to work environments, which may affect experienced team climate on hospital wards. Method: Descriptive survey was used as a study design. Team climate was measured by the Finnish modification of the Team Climate Inventory, and attitudes toward ICT by Burkes' questionnaire. The nursing staff (N = 181, n = 146) on nine acute psychiatric wards participated in the study. Results: It is not self-evident that experienced team climate associates with attitudes toward ICT, but there are some positive relationships between perceived team climate and ICT attitudes. The study showed that nurses' motivation to use ICT had statistically significant connections with experienced team climate, participative safety (p = 0.021), support for innovation (p = 0.042) and task orientation (p = 0.042). Conclusion: The results suggest that asserting team climate and supporting innovative operations may lead to more positive attitudes toward ICT. It is, in particular, possible to influence nurses' motivation to use ICT. More attention should be paid to psychosocial factors such as group education and co-operation at work when ICT applications are implemented in nursing.
    Informatics for Health and Social Care 01/2015; 40(1):79-90. DOI:10.3109/17538157.2013.872112 · 0.71 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: The results of routine patient assessments in psychiatric healthcare in the Northern Netherlands are primarily used to support clinicians. We developed Wegweis, a web-based advice platform, to make this data accessible and understandable for patients. OBJECTIVE: We show that a fully automated explanation and interpretation of assessment results for schizophrenia patients, which prioritizes the information in the same way that a clinician would, is possible and is considered helpful and relevant by patients. The goal is not to replace the clinician but rather to function as a second perspective and to enable patient empowerment through knowledge. METHODS: We have developed and implemented an ontology-based approach for selecting and ranking information for schizophrenia patients based on their routine assessment results. Our approach ranks information by severity of associated schizophrenia-related problems and uses an ontology to decouple problems from advice, which adds robustness to the system, because advice can be inferred for problems that have no exact match. RESULTS: We created a problem ontology, validated by a group of experts, to combine and interpret the results of multiple schizophrenia-specific questionnaires. We designed and implemented a novel ontology-based algorithm for ranking and selecting advice, based on questionnaire answers. We designed, implemented, and illustrated Wegweis, a proof of concept for our algorithm, and, to the best of our knowledge, the first fully automated interpretation of assessment results for patients suffering from schizophrenia. We evaluated the system vis-à-vis the opinions of clinicians and patients in two experiments. For the task of identifying important problems based on MANSA questionnaires (the MANSA is a satisfaction questionnaire commonly used in schizophrenia assessments), our system corresponds to the opinion of clinicians 94% of the time for the first three problems and 72% of the time, overall. Patients find two out of the first three advice topics selected by the system to be relevant and roughly half of the advice topics overall. CONCLUSIONS: Our findings suggest that an approach that uses problem severities to identify important problems for a patient corresponds closely to the way a clinician thinks. Furthermore, after applying a severity threshold, the majority of advice units selected by the system are considered relevant by the patients. Our findings pave the way for the development of systems that facilitate patient-centered care for chronic illnesses by automating the sharing of assessment results between patient and clinician.
    Artificial intelligence in medicine 02/2013; DOI:10.1016/j.artmed.2013.01.002 · 1.65 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: Background: E-mental health interventions can have a positive impact on patient-reported and clinical outcomes. The purpose of this project was to develop a user-centered e-mental health portal. Methods: The development of the portal included mixed-methods techniques for needs assessment to identify user-relevant content. Furthermore, user-centered design techniques were applied by utilizing individual usability testing with cognitive task analysis. First, a basic version of the portal was created and introduced to the public by means of a media campaign. After the development of module-specific content, exposure and use of the portal was investigated as part of a process evaluation. Results: Relevant content identified by needs assessment covered both, overarching and diagnosis-specific topics. Results of the process evaluation showed a highly accessed website. During the first 18 months, 119 423 visits were tracked. The portal was predominantly accessed by Google searches (73.9%), while 17.6% of visits were related to direct traffic. Discussion: Serving as a complement to face-to-face consultations, attempts to inform about mental disorders, and engage patients in the course of their treatment. Results of the process evaluation confirm the high relevance and potential of the portal and can be used for further improvements and extensions in the future.
    Informatics for Health and Social Care 02/2015; DOI:10.3109/17538157.2015.1008486 · 0.71 Impact Factor


Available from
May 21, 2014