Usability evaluation of a web-based patient information system for individuals with severe mental health problems.

Department of Nursing Science, University of Turku, Finland, Turku, Finland.
Journal of Advanced Nursing (Impact Factor: 1.69). 12/2010; 66(12):2701-10. DOI: 10.1111/j.1365-2648.2010.05411.x
Source: PubMed

ABSTRACT This paper is a report of a study conducted to compare service users', nursing students' and Registered Nurses' evaluations of the usability of a patient education website intended for individuals with severe mental health problems.
There is an obvious need for reliable mental health information on the Internet. When evaluating the usability of Internet-based patient education methods, the opinions of all parties need to be ascertained.
An explorative descriptive design was used. Twenty-one service users, 20 nursing students and 35 Registered Nurses were recruited for the study in 2003 and 2004. Data were collected using a self-developed questionnaire on the content, structure and visual appearance of the website.
Service users had positive attitudes towards computer and Internet use but they needed support when using the computer and Internet. According to the evaluations, the content, structure and visual appearance of the website were good and it could be adopted for clinical practise after minor revisions. There were some differences in the evaluations between participant groups. Nurses were the most critical group, and the service user group was the most satisfied, although they were less experienced with using both computers and the Internet.
It is especially important to include service users' evaluations at the early stages of the development process of Web-based patient education systems. It is possible to produce an information technology-based patient education system for individuals with severe mental health problems. Nurses working in psychiatric services need to pay more attention to supporting service users in computer and Internet use.

1 Bookmark
  • [Show abstract] [Hide abstract]
    ABSTRACT: The results of routine patient assessments in psychiatric healthcare in the Northern Netherlands are primarily used to support clinicians. We developed Wegweis, a web-based advice platform, to make this data accessible and understandable for patients. OBJECTIVE: We show that a fully automated explanation and interpretation of assessment results for schizophrenia patients, which prioritizes the information in the same way that a clinician would, is possible and is considered helpful and relevant by patients. The goal is not to replace the clinician but rather to function as a second perspective and to enable patient empowerment through knowledge. METHODS: We have developed and implemented an ontology-based approach for selecting and ranking information for schizophrenia patients based on their routine assessment results. Our approach ranks information by severity of associated schizophrenia-related problems and uses an ontology to decouple problems from advice, which adds robustness to the system, because advice can be inferred for problems that have no exact match. RESULTS: We created a problem ontology, validated by a group of experts, to combine and interpret the results of multiple schizophrenia-specific questionnaires. We designed and implemented a novel ontology-based algorithm for ranking and selecting advice, based on questionnaire answers. We designed, implemented, and illustrated Wegweis, a proof of concept for our algorithm, and, to the best of our knowledge, the first fully automated interpretation of assessment results for patients suffering from schizophrenia. We evaluated the system vis-à-vis the opinions of clinicians and patients in two experiments. For the task of identifying important problems based on MANSA questionnaires (the MANSA is a satisfaction questionnaire commonly used in schizophrenia assessments), our system corresponds to the opinion of clinicians 94% of the time for the first three problems and 72% of the time, overall. Patients find two out of the first three advice topics selected by the system to be relevant and roughly half of the advice topics overall. CONCLUSIONS: Our findings suggest that an approach that uses problem severities to identify important problems for a patient corresponds closely to the way a clinician thinks. Furthermore, after applying a severity threshold, the majority of advice units selected by the system are considered relevant by the patients. Our findings pave the way for the development of systems that facilitate patient-centered care for chronic illnesses by automating the sharing of assessment results between patient and clinician.
    Artificial intelligence in medicine 02/2013; · 1.65 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Objectives: To describe the association of team climate with attitudes toward information and communication technology among nursing staff working on acute psychiatric wards. Background: Implementation of ICT applications in nursing practice brings new operating models to work environments, which may affect experienced team climate on hospital wards. Method: Descriptive survey was used as a study design. Team climate was measured by the Finnish modification of the Team Climate Inventory, and attitudes toward ICT by Burkes' questionnaire. The nursing staff (N = 181, n = 146) on nine acute psychiatric wards participated in the study. Results: It is not self-evident that experienced team climate associates with attitudes toward ICT, but there are some positive relationships between perceived team climate and ICT attitudes. The study showed that nurses' motivation to use ICT had statistically significant connections with experienced team climate, participative safety (p = 0.021), support for innovation (p = 0.042) and task orientation (p = 0.042). Conclusion: The results suggest that asserting team climate and supporting innovative operations may lead to more positive attitudes toward ICT. It is, in particular, possible to influence nurses' motivation to use ICT. More attention should be paid to psychosocial factors such as group education and co-operation at work when ICT applications are implemented in nursing.
    Informatics for Health and Social Care 01/2014; · 0.71 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Integrating information technology into healthcare has the potential to bring treatment to hard-to-reach people. Individuals with serious mental illness (SMI), however, may derive limited benefit from these advances in care because of lack of computer ownership and experience. To date, conclusions about the computer skills and attitudes of adults with SMI have been based primarily on self-report. In the current study, 28 psychiatric outpatients with co-occurring cocaine use were interviewed about their computer use and opinions, and 25 were then directly observed using task analysis and think aloud methods as they navigated a multi-component health informational website. Participants reported low rates of computer ownership and use, and negative attitudes towards computers. Self-reported computer skills were higher than demonstrated in the task analysis. However, some participants spontaneously expressed more positive attitudes and greater computer self-efficacy after navigating the website. Implications for increasing access to computer-based health information are discussed.
    Psychiatric Quarterly 06/2012; · 1.26 Impact Factor


Available from
May 21, 2014