Assisting consumer health information retrieval with query recommendations

Bunker Hill Community College, Boston, Massachusetts, United States
Journal of the American Medical Informatics Association (Impact Factor: 3.93). 01/2006; 13(1):80-90. DOI: 10.1197/jamia.M1820
Source: DBLP

ABSTRACT Health information retrieval (HIR) on the Internet has become an important practice for millions of people, many of whom have problems forming effective queries. We have developed and evaluated a tool to assist people in health-related query formation.
We developed the Health Information Query Assistant (HIQuA) system. The system suggests alternative/additional query terms related to the user's initial query that can be used as building blocks to construct a better, more specific query. The recommended terms are selected according to their semantic distance from the original query, which is calculated on the basis of concept co-occurrences in medical literature and log data as well as semantic relations in medical vocabularies.
An evaluation of the HIQuA system was conducted and a total of 213 subjects participated in the study. The subjects were randomized into 2 groups. One group was given query recommendations and the other was not. Each subject performed HIR for both a predefined and a self-defined task.
The study showed that providing HIQuA recommendations resulted in statistically significantly higher rates of successful queries (odds ratio = 1.66, 95% confidence interval = 1.16-2.38), although no statistically significant impact on user satisfaction or the users' ability to accomplish the predefined retrieval task was found.
Providing semantic-distance-based query recommendations can help consumers with query formation during HIR.


Available from: Qing Zeng-Treitler, May 22, 2015
  • Source
    The Twenty-First Text REtrieval Conference (TREC 2012), Gaithersburg, Maryland; 11/2012
  • [Show abstract] [Hide abstract]
    ABSTRACT: Health information portals (HIPs) are now well-established channels for providing reliable and relevant health information as a service to health information consumers. The concept of a smart health information portal was proposed to improve the search experience of HIP users, advancing HIPs learning capability by looking at usage data. This paper describes a design-science research project which utilized insights from usage data to address search issues. A conceptual approach and an architecture to enable usage-driven capability are described. We propose two specific applications, a HIP-specific content issue reporting tool and a topic search feature, to demonstrate how usage data can enhance HIP operations and users’ search experience. Based on the demonstrated implementations and empirical analysis, this paper also discusses how usage-driven design can lead to improved service in online health information provision.
    Information Systems Frontiers 01/2014; 17(3). DOI:10.1007/s10796-014-9507-4 · 0.76 Impact Factor
  • Source
    [Show abstract] [Hide abstract]
    ABSTRACT: Non-medical professionals (consumers) are increasingly using the Internet to support their health information needs. However, the cognitive effort required to perform health information searches is affected by the consumer's familiarity with health topics. Consumers may have different levels of familiarity with individual health topics. This variation in familiarity may cause misunderstandings because the information presented by search engines may not be understood correctly by the consumers. As a first step toward the improvement of the health information search process, we aimed to examine the effects of health topic familiarity on health information search behaviors by identifying the common search activity patterns exhibited by groups of consumers with different levels of familiarity. Each participant completed a health terminology familiarity questionnaire and health information search tasks. The responses to the familiarity questionnaire were used to grade the familiarity of participants with predefined health topics. The search task data were transcribed into a sequence of search activities using a coding scheme. A computational model was constructed from the sequence data using a Markov chain model to identify the common search patterns in each familiarity group. Forty participants were classified into L1 (not familiar), L2 (somewhat familiar), and L3 (familiar) groups based on their questionnaire responses. They had different levels of familiarity with four health topics. The video data obtained from all of the participants were transcribed into 4595 search activities (mean 28.7, SD 23.27 per session). The most frequent search activities and transitions in all the familiarity groups were related to evaluations of the relevancy of selected web pages in the retrieval results. However, the next most frequent transitions differed in each group and a chi-squared test confirmed this finding (P<.001). Next, according to the results of a perplexity evaluation, the health information search patterns were best represented as a 5-gram sequence pattern. The most common patterns in group L1 were frequent query modifications, with relatively low search efficiency, and accessing and evaluating selected results from a health website. Group L2 performed frequent query modifications, but with better search efficiency, and accessed and evaluated selected results from a health website. Finally, the members of group L3 successfully discovered relevant results from the first query submission, performed verification by accessing several health websites after they discovered relevant results, and directly accessed consumer health information websites. Familiarity with health topics affects health information search behaviors. Our analysis of state transitions in search activities detected unique behaviors and common search activity patterns in each familiarity group during health information searches.
    01/2015; 3(1):e16. DOI:10.2196/medinform.3803