Usability evaluation of a web-based patient information system for individuals with severe mental health problems

Department of Nursing Science, University of Turku, Finland, Turku, Finland.
Journal of Advanced Nursing (Impact Factor: 1.74). 12/2010; 66(12):2701-10. DOI: 10.1111/j.1365-2648.2010.05411.x
Source: PubMed


This paper is a report of a study conducted to compare service users', nursing students' and Registered Nurses' evaluations of the usability of a patient education website intended for individuals with severe mental health problems.
There is an obvious need for reliable mental health information on the Internet. When evaluating the usability of Internet-based patient education methods, the opinions of all parties need to be ascertained.
An explorative descriptive design was used. Twenty-one service users, 20 nursing students and 35 Registered Nurses were recruited for the study in 2003 and 2004. Data were collected using a self-developed questionnaire on the content, structure and visual appearance of the website.
Service users had positive attitudes towards computer and Internet use but they needed support when using the computer and Internet. According to the evaluations, the content, structure and visual appearance of the website were good and it could be adopted for clinical practise after minor revisions. There were some differences in the evaluations between participant groups. Nurses were the most critical group, and the service user group was the most satisfied, although they were less experienced with using both computers and the Internet.
It is especially important to include service users' evaluations at the early stages of the development process of Web-based patient education systems. It is possible to produce an information technology-based patient education system for individuals with severe mental health problems. Nurses working in psychiatric services need to pay more attention to supporting service users in computer and Internet use.

Download full-text


Available from: Lauri Kuosmanen,
  • Source
    • "Both nurses and patients were able to work with the system [18] [19] [20]. Patients were able to access services and find relevant information [19], and they report their satisfaction with the system [21]. "
    [Show abstract] [Hide abstract]
    ABSTRACT: The results of routine patient assessments in psychiatric healthcare in the Northern Netherlands are primarily used to support clinicians. We developed Wegweis, a web-based advice platform, to make this data accessible and understandable for patients. OBJECTIVE: We show that a fully automated explanation and interpretation of assessment results for schizophrenia patients, which prioritizes the information in the same way that a clinician would, is possible and is considered helpful and relevant by patients. The goal is not to replace the clinician but rather to function as a second perspective and to enable patient empowerment through knowledge. METHODS: We have developed and implemented an ontology-based approach for selecting and ranking information for schizophrenia patients based on their routine assessment results. Our approach ranks information by severity of associated schizophrenia-related problems and uses an ontology to decouple problems from advice, which adds robustness to the system, because advice can be inferred for problems that have no exact match. RESULTS: We created a problem ontology, validated by a group of experts, to combine and interpret the results of multiple schizophrenia-specific questionnaires. We designed and implemented a novel ontology-based algorithm for ranking and selecting advice, based on questionnaire answers. We designed, implemented, and illustrated Wegweis, a proof of concept for our algorithm, and, to the best of our knowledge, the first fully automated interpretation of assessment results for patients suffering from schizophrenia. We evaluated the system vis-à-vis the opinions of clinicians and patients in two experiments. For the task of identifying important problems based on MANSA questionnaires (the MANSA is a satisfaction questionnaire commonly used in schizophrenia assessments), our system corresponds to the opinion of clinicians 94% of the time for the first three problems and 72% of the time, overall. Patients find two out of the first three advice topics selected by the system to be relevant and roughly half of the advice topics overall. CONCLUSIONS: Our findings suggest that an approach that uses problem severities to identify important problems for a patient corresponds closely to the way a clinician thinks. Furthermore, after applying a severity threshold, the majority of advice units selected by the system are considered relevant by the patients. Our findings pave the way for the development of systems that facilitate patient-centered care for chronic illnesses by automating the sharing of assessment results between patient and clinician.
    Artificial intelligence in medicine 02/2013; 58(1). DOI:10.1016/j.artmed.2013.01.002 · 2.02 Impact Factor
  • [Show abstract] [Hide abstract]
    ABSTRACT: A lot of researches have proven that health education can help patients to maintain and improve their health. And it also shortens the time staying in hospital to save medication resource. Because the patients are willing to get healthcare knowledge to enhance the ability of self-care, they pay more attention to the health education. In Taiwan, the clinical nurses play an important role in patient education, and the health education take most time in their daily work. Such work includes the collection, production and delivery of education materials. To generate the correct and customized health education material is the key of success of patient education. In this study, we established a computer-aided health education contents generating system for psychiatric patients by integrating the databases for disease, medicine and nursing knowledge to assist nurse generating the customized health education document suitable for different patients. This system was evaluated by clinical nurses in usability and feasibility. This system is helpful for nurse to carry out the clinical health education to patients and further to encourage patient to pay attention to self-health.
    Journal of Medical Systems 09/2010; 36(3):1373-9. DOI:10.1007/s10916-010-9599-4 · 2.21 Impact Factor

Show more