PresentationPDF Available

Use of SEIQoL as an Alternative Approach to Measure the Effects of Human Services Interventions

Authors:

Abstract

The paper introduces the SEIQoL (Schedule for the Evaluation of Individual Quality of Life), a tool for evaluating the quality of life from a subjective perspective. The contribution turns the attention to quality of life as an important aspect of interventions impact and their evaluation. It offers practical experiences with SEIQoL administration and provides a balanced combination of practicalities and underlying conceptual explanations. Attention is also paid to selected methodological issues such as the dynamic nature of quality of life, administrators´ bias, or usability for evaluation of human services interventions. SEIQoL provides a useful insight into the impacts of human services interventions on individual quality of life. Moreover, being open to subjective “cues”, i.e., the areas that individuals consider important for their quality of life, and following the participatory approach, SEIQoL can help to reshape the knowledge about the needs of beneficiaries.
JIRI REMR
ACKNOWLEDGMENT
The presentation was created within the project
SETTING THE CONDITIONS AND ENVIRONMENT FOR
INTERNATIONAL AND INTERSECTORAL COOPERATION”,
reg. no. CZ.02.2.69/0.0/0.0/18_054/0014660, which
is co-financed by the European Union.
ABSTRACT
The paper introduces the SEIQoL (Schedule for the Evaluation of Individual Quality of Life), a tool for
evaluating the quality of life from a subjective perspective. The contribution turns the attention to quality
of life as an important aspect of interventions impact and their evaluation. It offers practical experiences
with SEIQoL administration and provides a balanced combination of practicalities and underlying
conceptual explanations. Attention is also paid to selected methodological issues such as the dynamic
nature of quality of life, administrators´bias, or usability for evaluation of human services interventions.
SEIQoL provides a useful insight into the impacts of human services interventions on individual quality of
life. Moreover, being open to subjective “cues”, i.e., the areas that individuals consider important for their
quality of life, and following the participatory approach, SEIQoL can help to reshape the knowledge about
the needs of beneficiaries.
Keywords: quality of life; SEIQoL; counseling; participatory approach; human services intervention
THE QUALITY OF LIFE (QoL) MEASURES
There are various approaches to its evaluation, for instance,
WHOQoL-BREF, SF-36, HRQoL, QoLS, MQoL, etc. Most of the
existing measures are health-related; they have been designed
to assess the impact of illness and treatment on the QoL of
patients/clients.
2
Results are presented as group statistics. They provide little or
no individual-level data on the QoL.
3
QoL is a multi-dimensional construct. It is a individuals´
perception of their position in life in the context of culture and
value systems in which they live and in relation to their goals,
expectations, standards and concerns (WHOQOL Group, 1995)
1
THE QUALITY OF LIFE (QoL) MEASURES
0101 Pre-ordinate design and dimensions focused on limitations
and impediments (for some participants irrelevant)
0202 High number of items neglecting the variation of their
importance (obtrusive, cognitively demanding)
0303 Heavy on analysis (not suitable for having real-time results)
SCHEDULE FOR EVALUATION OF INDIVIDUAL
QUALITY OF LIFE (SEIQoL)
SEIQoL
SEIQoL in contrast to other approaches does not
determine what and how the participant should
consider important with respect to the quality of life.
Individuals take ownership of the QoL concept.
Takes into account the plurality of perceptions and
perspectives of participants, their personal values.
It is a person-centered measure, not a health-based one.
Semi-structured interview is a typical mode of data
collection resulting in qualitative and quantitative
outcomes.
HOW DOES SEIQoL MEASURE THE QoL?
Participants are free to come-up with areas of their life (cues) that they
consider important. Personal cues are defined spontaneously.
Evaluation of the degree of satisfaction with the indicated cues
in percentages on a scale from 0 to 100.
The relative importance of each cue that the participant evaluates
proportionally by dividing 100 % among the cues.
1
First session Other sessions;
continued therapy
or counseling
Final session
32
CONTEXT OF SEIQoL USAGE
SEIQoL DEPLOYMENT
(PRE-TEST)
SEIQoL DEPLOYMENT
(POST-TEST)
THE COURSE OF SEIQoL ADMINISTRATION
Introduction
Eliciting the five most important areas of life (the cues)
Determining levels of satisfaction
Elicit importance rating of present life
QoL scoring
01.
02.
03.
04.
05.
1.
2.
3.
4.
5.
TOTAL = 100%
HEALTH 15%
WORK 45%
PARTNERSHIP 15%
TRAVELLING 15%
PERSONAL DEVELOPMENT 10%
LIFE GOALS IMPORTANCESATISFACTION
75%
85%
90%
75%
60%
75 x 15 = 1125
85 x 45 = 3825
90 x 15 = 1350
75 x 15 = 1125
60 x 10 = 600
SUM 8025
SEIQoL = 80.25%
COMPUTATION OF SEIQoL INDEX
The SEIQoL measures the QoL on an individual level. Individual measures
are derived from an idiographic approach reflecting the uniqueness of
human experience.
Summary index can still be produced when group comparisons
are required.
As the index is a continuous measure (ranging from 0 to 100) it can be
analyzed using parametric statistical methods.
SUMMARY
CASE EXAMPLE
CASE EXAMPLE
Source: INESAN (20212022)
TARGET GROUP
I N T E R V E N T I O N
94 clients
SEIQoL (PRE-TEST)
59 clients
SEIQoL (POST-TEST)
63 clients
47 clients passed both, the pre-test and the post-test
CASE EXAMPLE
SEIQoL
(PRE-TEST)
average duration
12 minutes
SEIQoL
(POST-TEST)
range
5-30 minutes
Source: INESAN (20212022)
average duration
14 minutes
range
5-40 minutes
SEIQoL
(PRE-TEST)
average time-lag:
275 days
SEIQoL
(POST-TEST)
range:
92-517 days
83%
81%
72%
45%
45%
23%
30%
17%
26%
91%
81%
68%
38%
47%
15%
32%
19%
30%
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
health
family relationships
education
friendly relations
partnership
relax and hobby
sport
personal development
relation to self
pre-test
post-test
CASE EXAMPLE Elicited cues (pre AND post only)
Data show the percentage of participants who nominated any cue.
Source: INESAN (20212022, n=47/47)
CASE EXAMPLE Rating of the elicited cues
(average satisfaction)
Source: INESAN (20212022, n=8-41/6-42)
53
52
50
48
45
44
37
33
28
67
58
55
58
63
63
61
67
60
020 40 60 80 100
relax and hobby
education
sport
friendly relations
partnership
family relationships
health
personal development
relation to self
Percents
pre-test
post-test
14
6
5
10
18
19
24
34
32
Percentage points
difference
(p=0.105)
(p=0.149)
(p=0.462)
(p=0.145)
(p=0.011)
(p=0.000)
(p=0.000)
(p=0.000)
(p=0.000)
Note: t-test
CASE EXAMPLE Direct weighting of the cues
(average weight)
31
30
23
22
19
17
15
13
10
28
30
23
22
16
18
13
14
10
010 20 30 40
relation to self
health
partnership
family relationships
sport
personal development
friendly relations
education
relax and hobby
Percents
pre-test
post-test
-2,6
-0,5
-0,2
-0,1
-2,8
1,1
-1,9
0,7
-0,2
Percentage points
difference
(p=0.626)
(p=0.850)
(p=0.944)
(p=0.969)
(p=0.441)
(p=0.831)
(p=0.568)
(p=0.732)
(p=0.947)
Source: INESAN (20212022, n=8-41/6-42)
Note: t-test
CASE EXAMPLE SEIQoL index (total sample)
Source: INESAN (20212022, n=47)
Note: 0 = the worst QoL, 100 = the best QoL
pre-test post-test
Mean Median Std.
Deviation
Range
pre
-test 43.1 45 18.07
7.5
-
89.0
post
-test 61.5 59 11.82
35.0
-
94.8
-5.610, df=82, p=0.000]
CASE EXAMPLE SEIQoL index (comparison)
Source: INESAN (20212022, n=14/33)
Note: 0 = the worst QoL, 100 = the best QoL
pre-test post-test pre-test post-test
Therapist #1 Therapist #2
SEIQoL
REFLECTION
ADVANTAGES OF SEIQoL
SEIQoL might serve as an ice-breaker; facilitates the start of the
interview between a participant (client, patient) and the interviewer
(counsellor, therapist, social worker, expert). Moreover, it helps to focus
the subsequent help or therapy, and build a trust.
SEIQoL was proved as a feasible, reliable and valid instrument.
SEIQoL can be used repeatedly (pre-test and post-test); in many
studies, it has been shown to be sensitive to change. Moreover, it
allows for benchmarking.
SEIQoL is suitable for different populations or target groups; burden on
participants is low.
ISSUES RELATED TO SEIQoL ADMINISTRATION
SEIQoL
Nominating the cues:
Some participants could not think of five cues and the
use of prompts was necessary.
Other participants provided more than five cues, so their
prioritization had to be done.
Poor recall of self-evident cues (e.g., health).
Pre/post change in cues might indicate the QoL
reconceptualization (response shift).
ISSUES RELATED TO SEIQoL ADMINISTRATION
SEIQoL
Determining cue levels:
Some participants reflected the importance of the
particular cue rather than how the cue is for them at the
given moment.
Cue functioning is interchanged with its satisfaction.
Determining cue weights:
The participants conceive the task as dividing up the pie
in terms of current functioning in that area.
Pre/post change in cues might indicate the value change.
IMPORTANT TAKE-AWAY
An interviewer (administrator) must be properly trained and engaged.
Identification of cues is demanding and critical part of SEIQoL. The administrators
(typically counsellors or therapists) should incorporate SEIQoL into their routines.
Browne, J.P., C.A. O’Boyle, H.M. McGee, N.J. McDonald and C.R. Joyce (1997). Development of a direct weighting procedure for quality-of-life domains. Quality of Life
Research 6: 301309.
Ďurďa, O., Ponocná, P. a Gumančík, J. (2022) Psychoterapeutická podpora v Anabell Praha. Závěrečná evaluační zpráva. Praha: INESAN.
Fayers, P. M., Machin, D. (2007). Quality of life. The assessment, analysis and interpretation of patient-reported outcomes. Chichester: Wiley.
Holubová, M., Remr, J., Pilný, J. Postup validizace dotazníku Osteo-arthritis Knee and Hip Quality of Life OAKHQOL. Evaluační teorie a praxe. 2017, 5(1): 35–55.
Keyes, C.L., Shmotkin, D., Ryff, C.D. (2002). Optimizing well-being: the empirical encounter of two traditions. Journal of Personality and Social Psychology 82: 10071022.
Krivohlavy, J., Petrikova, F. (2001). Faith, meaningfulness and quality of life. Studia Psychologica, 43(3): 211214.
Martin, F., Camfield, L., Rodham, K., Kliempt, P., & Ruta, D. (2007). Twelve years’ experience with the Patient Generated Index (PGI) of quality of life: A graded structured
review. Quality of Life Research, 16(4): 705715.
Mitchell, J., Bradley, C. (2004). Design of an individualised measure of the impact of macular disease on quality of life (the MacDQoL). Quality of Life Research, 13(6):
11631175.
Naughton, M.J., Wiklund, I. (1993). A critical review of dimension-specific measures of health-related quality of life in cross-cultural research. Quality of Life Research 2:
397432.
O’Boyle, C., H.M. McGee, A. Hickey, C.R.B. Joyce, J. Browne, and K. O’Malley (1993). ‘The Schedule for the Evaluation of Individual Quality of Life’, User Manual
(Department of Psychology, Royal College of Surgeons in Ireland, Dublin).
Ponocná, P., Ďurďa, O. a Rohanová, K. (2022) Peer-program a mini-multidisciplinární tým v Anabell. Závěrečná evaluační zpráva. Praha: INESAN.
Remr, J. Honba za vyšší návratností. Stojí opravdu za to?. Evaluační teorie a praxe. 2015, 3(1): 3359.
Remr, J. Methodological Peculiarities of Needs Assessment. Evaluační teorie a praxe. 2018, 6(2): 3352.
Remr, J. Participativně založené evaluační přístupy. Evaluační teorie a praxe. 2015, 3(2): 79100.
Remr, J. Srovnání vybraných přístupů k realizaci evaluací. Evaluační teorie a praxe. 2013, 1(1): 29-52.
Ring, L., Höfer, S., Mcgee, H., Hickey, A., O‘Boyle, C. (2007). Individual quality of life: Can it be accounted for psychological or subjective well-being? In: Social Indicators
Research, 82 (3): 443-461
Ryff, C.D., Singer, B. (1996). Psychological well-being: meaning, measurement, and implications for psychotherapy research. Psychotherapy and Psychosomatics 65: 14
23.
Sprangers, M.A., Schwartz, C.E. (1999). Integrating response shift into health-related quality of life research: a theoretical model. Soc Sci Med 48(11): 150715.
WHOQOL Group (1995) The World Health Organization Quality of Life assessment (WHOQOL): Position paper from the World Health Organization. Soc. Sci. Med. 41,
1403
REFERENCES
Jiri REMR
Institute for Evaluations and Social Analyses
www.facebook.com/inesan.eu www.researchgate.net cz.linkedin.com/company/inesan
www.inesan.eujiri.remr@inesan.eu
This work is licensed under Creative Commons Attribution License v4.0
http://creativecommons.org/licenses/by-nc/4.0/
ResearchGate has not been able to resolve any citations for this publication.
Technical Report
Full-text available
Tato zpráva prezentuje výsledky evaluace projektu „Psychoterapeutická podpora v Anabell Praha“ (reg. č. CZ.03.2.X/0.0/0.0/18_095/0011206), který byl realizován Centrem Anabell, z. ú. v období 1. 9. 2019–28. 2. 2022. Projekt byl spolufinancován z fondů EU prostřednictvím Operačního programu Zaměstnanost (OPZ), jehož řídícím orgánem je Ministerstvo práce a sociálních věcí ČR. Projekt se zaměřuje na zvýšení kvality života osob s duševním onemocněním, poruchou příjmu potravy (PPP) a využití metody depistáže k nalezení ohrožených osob s PPP v rozsahu, který doposud nebyl v Anabell realizován. Projekt cílí na zvýšení kvality života klienta s poruchou příjmu potravy v pěti sledovaných oblastech rozpracovaných v dotazníku kvality života (SEIQoL). Podpora klientů bude realizována prostřednictvím psychoterapie a nutričního poradenství. Další cíl projektu spočívá ve vyhledání a zapojení osob s PPP prostřednictvím depistáže. Jedná se o osoby, které by jinak odborné pomoci nevyužily nebo ji nevyhledaly.
Technical Report
Full-text available
Tato zpráva představuje výsledky evaluace projektu „Peer-program a mini-multidisciplinární tým v Anabell“ (reg. č. CZ.03.2.60 / 0.0 / 0.0 / 18_088 / 0010652), který realizovalo Centrum Anabell , z.ú. v období září 2019–prosinec 2021. Projekt byl spolufinancován z fondů EU prostřednictvím Operačního programu Zaměstnanost (OPZ), jehož řídícím orgánem je Ministerstvo práce a sociálních věcí ČR. Cílem evaluace bylo zhodnotit dopad relativně inovativní aktivity – peer-programu a mini-multidisciplinárního týmu v Anabell na kvalitu života klientů. Sledováno bylo pět oblastí života klientů, které byly následně hodnoceny dotazníkem individuální kvality života (SEIQoL). Dalším cílem evaluace projektu bylo zhodnotit jednotlivé aktivity projektu a výstupy projektu s ohledem na stanovené cíle.
Article
Full-text available
This article focuses attention on the importance of needs that are understood as a criterium for the evaluation of usefulness. The text proposes a usable conceptual framing of what evidence might be collected. Moreover, it identifies the role of needs within the theory of change that is presented by the generalized logic model and finally it points out the key situation when usefulness can successfully supplement other evaluative criteria like relevance or effectiveness. Discrimination of needs from similar constructs like wants, preferences and demand is analyzed and documented with vivid examples from a study that focused on the needs of informal caregivers providing care to the dependent seniors within their homes. Moreover, the key methodological peculiarities of the systematic process of the identification, analysis and evaluation of needs are brought to attention.
Article
Full-text available
Validization of Osteoarthritis Knee and Hip Quality of Life – OAKHQOL Questionnaire Survey instruments used in medical research are usually taken from foreign sources. Results gained by utilization of these instruments are related to the success of the treatment and to benefits that such intervention brings to the patient. However, the information about the methods of localization and interpretation of the instrument and the methods how its validity was proved within the new (and usually different) context is missing. The aim of this study is to describe the process of validization of the Osteoarthritis Knee and Hip Quality of Life – OAKHQOL questionnaire. This instrument is focused on evaluation of the quality of life of persons with osteoarthritis. Psychometric features of the questionnaire was tested by Cronbach’s´ alpha coefficient, by exploratory factor analysis and by parallel tests of correlations with Short Form 36 Health Survey Questionnaire – SF-36 and with selected codes of International Classification of Functioning, Disability and Health (ICF). The text points-out the key steps of the validization procedure and identification of factors that might determine the findings. As a result of this study, OAKHQOL questionnaire is recommended for practical applications.
Article
Full-text available
Main goal of the paper called "Participatory Evaluation Approaches" is to present the review of main characteristics that differentiate participatory approaches from other ways of conducting evaluations. Based on comparative analysis, the five main characteristics are identified, explained and critically assessed. Central part of the paper is devoted to two different traditions within the participatory approaches. Frist tradition is represented by practical participatory evaluation such as utilization-focused approach by M. Patton, whereas the second tradition is transformative participatory evaluation where the attention is put on empowerment evaluation by D. Fetterman. Moreover, the paper describes historical framework within that participatory approaches developed and it also identifies its key inspirations. In this respect, the paper presents responsive approach introduced by R. Stake that significantly influenced participatory evaluations.
Article
Full-text available
The article called "Chasing Higher Response Rate. Is It Really Worth It?" turns the attention to nonresponse that is the one of the key characteristic of both evaluation and research inquiries. Besides the review of most important definitions of nonresponse, an overview of selected approaches for improvement the response rate is presented. Moreover, the possible changes to research design are introduced and discussed. However, the main attention is paid to follow-ups, their usefulness and impact on response rate and bias of the research estimates. Text also demonstrates how the follow-ups can influence the structure of the research sample and how it affects the character of achieved results. Specific attention is paid to answering the question of optimal number of follow-up waves. Presented conclusions are based on empirical data describing the satisfaction with information system BENFIT7; such data were collected by Institute for evaluations and social analyses with the use of CAWI.
Article
Full-text available
The main goal of the paper that is called "Comparison of Selected Evaluation Approaches" is to show the variety of how evaluators could solve the evaluation tasks. Results of the performed analysis present how uneven the outcomes of evaluation could be when different approach is taken. The article turns attention toward the basics of evaluative thinking by opening the range of alternative methodological and conceptual frameworks that could be used in the course of intervention program evaluation. Evaluation is defined with use of several definitions that put emphasis on methodological aspects of evaluative inquiry. In detail, there are four different approaches compared: goal-based, goal-free, constructivists and theory-driven. Each of the approaches is briefly introduced, context of its dissemination is explained and it is also described how the approach relates to other approaches. Useful component of the analysis is an example that highlights the main distinctions among the four approaches and results that each of the approaches can offer.
Article
Full-text available
C. E. Schwartz and M. A. Sprangers (see records 2000-08799-001 and 2000-08799-006) have defined response shift as a change in the meaning of one's self-evaluation of a target construct as the result of (a) a change in one's internal standards of measurement, (b) a change in one's values, or (c) a redefinition of the target construct. The subjective, dynamic nature of quality of life (QOL) creates significant difficulties for its measurement (S. M. Hunt, 1997; C. R. Joyce, C. A. O'Boyle et al, 1999) and research in this area has produced a number of apparently contradictory findings. First, there is the discrepancy between observer or proxy ratings of QOL and those of the individual concerned (M. A. Sprangers & N. K. Aaronson, 1992). Second, the expected deterioration in QOL often does not occur, even in cases of serious illness, injury, or aging (J. P. Browne et al., 1994; R. W. Evans, 1991; S. Kreitler, C. Samario et al, 1993). Third, serious illness can actually result in an increase in patient satisfaction and QOL (M. A. Andrykowski, M. J. Brady et al, 1993). The purpose of this chapter is to describe how the Schedule for the Evaluation of Individual Quality of Life (SEIQOL) may be applied to measuring some elements of response shift. (PsycINFO Database Record (c) 2012 APA, all rights reserved)
Article
Patients confronted with a life-threatening or chronic disease are faced with the necessity to accommodate to their illness. An important mediator of this adaptation process is 'response shift' which involves changing internal standards, values and the conceptualization of quality of life (QOL). Integrating response shift into QOL research would allow a better understanding of how QOL is affected by changes in health status and would direct the development of reliable and valid measures for assessing changes in QOL. A theoretical model is proposed to clarify and predict changes in QOL as a result of the interaction of: (a) a catalyst, referring to changes in the respondent's health status; (b) antecedents, pertaining to stable or dispositional characteristics of the individual (e.g. personality); (c) mechanisms, encompassing behavioral, cognitive, or affective processes to accommodate the changes in health status (e.g. initiating social comparisons, reordering goals); and (d) response shift, defined as changes in the meaning of one's self-evaluation of QOL resulting from changes in internal standards, values, or conceptualization. A dynamic feedback loop aimed at maintaining or improving the perception of QOL is also postulated. This model is illustrated and the underlying assumptions are discussed. Future research directions are outlined that may further the investigation of response shift, by testing specific hypotheses and predictions about the QOL domains and the clinical and psychosocial conditions that would potentiate or prevent response shift effects.