ArticlePDF Available

Abstract and Figures

The South African Ministry of Health has recognized experiences of care as key to strengthen patient-centred care. This case study aims to measure patient-reported experiences of care at a clinic in South Africa, and its associations with the respondents' sociodemographic characteristics. A survey was conducted in 2019 on a convenience sample of 179 respondents. Questions on experiences of care were based on a standardised set of questions by the Organization for Economic Co-operation and Development (OECD). Logistic regression was used to examine the effects of respondents' characteristics on their experiences. The proportion of respondents who reported that a nurse spent adequate time with them during consultation was significantly higher among literate respondents (92.3 vs. 79.5%). Those who reported past negative experiences were significantly more likely to report a positive experience in regard to perceiving adequate consulting time (odds ratio = 3.865, with a 95% confidence interval between 1.555 and 9.607), receiving easy-to-understand explanations (4.308; 1.665–11.145), being given the opportunity to ask questions (2.156; 1.013–4.589) and shared decision–making (3.822; 1.728–8.457). The results can spur comparisons with other clinics in a similar setting and inform key stakeholders on aspects of the care experience that need greater improvement within the national framework for quality and safety assurance and patient experience measurement.
Content may be subject to copyright.
Patient experiences in a public primary health care
clinic: A South African case study
ÓSCAR BRITO FERNANDES
1,2
*, MUKHETHWA NETSHIOMBO
1
,
L
ASZL
O GUL
ACSI
1
, NIEK S. KLAZINGA
2
,M
ARTA P
ENTEK
1
and
PETRA BAJI
1
1
Department of Health Economics, Corvinus University of Budapest, Budapest, Hungary
2
Department of Public and Occupational Health, University of Amsterdam, Amsterdam, The Netherlands
Received: May 12, 2020 Revised manuscript received: June 17, 2020 Accepted: June 19, 2020
© 2020 The Author(s)
ABSTRACT
The South African Ministry of Health has recognized experiences of care as key to strengthen patient-centred care.
This case study aims to measure patient-reported experiences of care at a clinic in South Africa, and its associations
with the respondentssociodemographic characteristics. A survey was conducted in 2019 on a convenience sample
of 179 respondents. Questions on experiences of care were based on a standardised set of questions by the Or-
ganization for Economic Co-operation and Development (OECD). Logistic regression was used to examine the
effects of respondentscharacteristics on their experiences. The proportion of respondents who reported that a nurse
spent adequate time with them during consultation was signicantly higher among literate respondents (92.3 vs.
79.5%). Those who reported past negative experiences were signicantly more likely to report a positive experience
in regard to perceiving adequate consulting time (odds ratio 53.865, with a 95% condence interval between 1.555
and 9.607), receiving easy-to-understand explanations (4.308; 1.66511.145), being given the opportunity to ask
questions (2.156; 1.0134.589) and shared decisionmaking (3.822; 1.7288.457). The results can spur comparisons
with other clinics in a similar setting and inform key stakeholdersonaspectsofthecareexperiencethatneedgreater
improvement within the national framework for quality and safety assurance and patient experience measurement.
KEYWORDS
primary health care, patient experiences, patient-centred care, South Africa, Sibasa Clinic
JEL CODES
C83, I19
*Corresponding author. E-mail: obritofernandes@uni-corvinus.hu
Society and Economy
DOI: 10.1556/204.2020.00014
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
1. INTRODUCTION
1.1. Patient experiences of care
For more than three decades, increased attention has been placed on developing health systems
that are more patient-centric, to allow greater responsiveness to patientsneeds, expectations
and preferences. Moving health care organizations towards patient-centric and value-based care
trajectories is aligned with evidence that links the use and dissemination of patient data across
health care organizations to steer patient-driven changes (De Rosis et al. 2020). Consequently,
there is an ever-growing use of instruments to capture the voice of patients, typied by patient-
reported outcome measures (PROMs) and patient-reported experience measures (PREMs)
(Coulter 2017; Price et al. 2014).
Greater attention is given to ways of capturing citizensvoices within a value-based care
framework. Value-based care encompasses: i) the promotion of value-based pricing, pur-
chasing and use of treatments and health care services in general; ii) enabling communication
about treatment options and costs and; iii) minimising the impacts of costs with medicines
and other related costs to nancial toxicity (also known as catastrophic health expenditure), to
which patients with several and severe morbidities are more at risk relative to those without
severe diseases (Presidents Cancer Panel 2018; WHO 2018; Xu et al. 2005). The underlying
assumption is that patent-centric and value-based care provide efciency gains to health care
systems in terms of increasing quality life years; greater cost-effectiveness, given patients
adherence to treatment choice where their voice was accounted for; decreased productivity
loss and informal care burden and; contribution to employment sustainability. Given these
effects, many countries strive for health care reforms, which aim at improving the perfor-
mance of the health care system. A key component of performance is efciency, and achieving
efciency gain means getting more value for money, i.e. investments are rewarded by
increasing overall health care productivity (Gul
acsi P
entek 2014). Success requires multiple
factors, including patient-centric and value-based care, where capturing the perspective of
patients (via patient-reported outcome and experience measures) has the potential to inform
decision-makers on where efciency may be gained (Barbazza et al. 2019; Gilmore et al. 2019;
P
entek 2019).
Patient experience encompasses all processes across the continuum of care observable by
patients and which influence a patients perception of the care delivered (Price et al. 2014; Wolfe
et al. 2014). For example, the Agency for Healthcare Research and Quality (AHRQ) describes
patient experience as several aspects of health care delivery that patients value highly when they
seek and receive care, such as getting timely appointments, easy access to information, and good
communication with health care provider(AHRQ 2019). The interaction of many actors and
settings makes patient experience a complex multidimensional concept (Sandager et al. 2016),
which partly explains why it is difcult to dene its core components, and thus, measuring them
(LaVela Gallan 2014).
Notwithstanding, patient experience is an intrinsically relevant dimension of quality of care
(Duschinsky Paddison 2018). There is strong evidence on the association of patient experience
with health care quality indicators (Ahmed et al. 2014; Bleich et al. 2009; Doyle et al. 2013;
Kingsley Patel 2017; Llanwarne et al. 2013; Price et al. 2014). For example, two systematic
reviews have highlighted that positive experiences of care were associated with a decrease in
2Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
primary and secondary care use (e.g. number of hospital admissions, readmissions and primary
care consultations), and greater adherence to prevention and treatment processes (Doyle et al.
2013; Price et al. 2014). On the other hand, poorer experiences of care are often associated with
inadequate patient-doctor communication and poorer involvement of patients in decision
making, with implications for clinical effectiveness and safety (Bao et al. 2017; Kelly et al. 2019).
Given robust evidence on these associations, patient experience has been widely used as a proxy
measure for care quality with many different purposes.
The use of PREMs varies across health systems and their purposes at the micro, meso and
macro level may be complementary. For example, PREMs data can inform health care teams on
the effectiveness of processes of care and provide insights into redesigning care pathways that
better address the needs, expectations and preferences of patients (Kingsley Patel 2017). Also,
PREMs have been used for quality accreditation and certication (Fujisawa Klazinga 2017),
payment programs (LaVela Gallan 2014), and to develop health policies that spur patient-
centred care delivery (OECD 2017). Albeit interest in measuring performance data such as
patient-reported outcomes and experiences is increasing, these are still underused in decision-
making processes (Ivankovic et al. 2020).
Data collection on PREMs is maturing differently across Organization for Economic Co-
operation and Development (OECD) countries. Contextual factors may partly explain these
variations, but also the extent to which some aspects act as barrier for the use of PREMs:
sampling, data collection, timeliness of data collection and reporting, type of data, level of data
aggregation and data reporting (De Rosis et al. 2020). Thus, instruments that are set forth to
collect PREMs data in different health care settings are of utmost importance to assure t for
purpose, streamline data collection, strengthen data quality and comparability, and enhance the
actionability of PREMs data. Examples can be drawn from the work of the Picker Institute, the
AHRQs Consumer Assessment of Healthcare Providers and Systems program, the Common-
wealth Fund and also the OECD. These organizations have been frontline pioneers in patient
experience measurement with standardised tools, which allow for international comparisons and
dissemination of good practices (OECD EU 2019). Their work has positioned PREMs at the
fore of patient-centred care and quality improvement initiatives across many countries (Fuji-
sawa Klazinga 2017). For example, in Hungary, researchers have recently investigated patient
experiences with outpatient care on a national representative sample of 1,000 respondents using
a set of standardised PREMs questions. A rst study focused on forgone medical visits as an
important factor of patient-centric care (Lucevic et al. 2019), examining questions regarding the
existence of unmet medical needs if patients: (1) reported forgone medical visits due to costs; (2)
forgone medical tests and treatment due to costs; (3) unlled prescriptions for medicine, or
skipped doses due to costs; (4) forgone medical visits due to difculties in travelling. In addition,
another study focused on the care experiences of the last outpatient consultation: (1) did the
doctor spend enough time with the patient in consultation; (2) did the doctor provide easy to
understand explanations; (3) did the doctor give the opportunity to ask questions or raise
concerns about care or treatment; (4) did the doctor involve the patient in decisions about care
and treatment (Brito Fernandes et al. 2019). Both studies were important in emphasizing the
need to collect, analyse and report on these patient-reported data in Hungary, in a consistent
manner over time, and to allow cross-national comparisons with other OECD countries, where
the same standardised questions have been used. Conversely, measuring PREMS in South Africa
is still in its infancy (Manga et al. 2018).
Society and Economy 3
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
1.2. Patient experiences in South Africa
In South Africa, the Free Health Care policy of 1996 (Monson 2006) has ensured public
primary health care (PHC) coverage to all citizens. In that regard, many improvements have
been made, for example in access to care (e.g. 90% of the population now live within 7 km of a
public primary care facility) and in health outcomes (e.g. increased life expectancy and
reduction in child and maternal mortality) (McLarenetal.2014). Despite the backdrop of
these milestones, citizens still face a series of challenges, such as low life expectancy at birth,
high infant mortality rates, health care professional and medicine shortages, and health
professionalsoverall limited knowledge about the needs and preferences of patients (OECD
2014, 2019a, 2019b, 2019c).
According to the 2017 General Household Survey, 71.2% of the population use public
providers as a first choice of consultation when in ill-health (Statistics South Africa 2017), with
PHC serving as the rst point of entry into the health system. The quality of care in PHC fa-
cilities is a reoccurring topic that attracts public attention and scrutiny, following strong evi-
dence throughout the years that the health system should be more responsive (e.g. Bresick et al.
2019a, 2019b; Kelly et al. 2019; Peltzer 2009; Peltzer Phaswana-Mafuya 2012).
We conducted a brief literature review on quality of care in PHC in South Africa. The
retrieved articles suggest a growing interest among researchers and government officials about
improving quality of care. For example, the growing number of validated versions of the primary
care assessment tool (PCAT), which focus on dimensions such as access, continuity, compre-
hensiveness, coordination and person-centredness (Bresick et al. 2015, 2016; Dullie et al. 2018).
Baseline PCAT results in South Africas Western Cape Province highlighted that a gap exists
between the experiences of care reported by patients that used PHC services and the perception
of PHC staff regarding the care they provided (Bresick et al. 2016; Mukiapini et al. 2018). These
results underpin an increasing interest about patient care experiences, which are key to the
implementation of a National Health Insurance scheme, which seeks to reform the current
inequitable health system and place an emphasis on patient-centred care (Department of Health
2019a).
In 2017, the South African Ministry of Health published the National Guideline on con-
ducting Patient Experience of Care Survey in Public Health Establishments,introducing the
rst national survey on patient experiences in the inpatient and outpatient settings, and in
mental health establishments (Department of Health 2017). This very important document
showed the Governments commitment to improving quality of care and providing methodo-
logical guidance on how to set up a questionnaire survey t to collect nation-wide data about
experiences of care. This initiative followed those of previous ad-hoc evaluations of patient
experience such as that of the Chronic Care Assessment of Patient Experience (CCAPE), which
was developed as an approach to gauge the care experiences of chronic patients. The survey was
designed to measure patient experiences against a set of norms and standards developed by the
Health Ministry and the Ofce of Health Standards and Compliance. The survey focused on
the following dimensions: i) dignity; ii) autonomy; iii) condentiality; iv) prompt attention; v)
access to social support networks during care; vi) quality of basic amenities; vii) choice of care
provider and; viii) the responsiveness of the health system. The results of this survey aim to
inform PHC facilities on how to achieve a standard of care that is equipped to serve the
population once the proposed Universal Health Coverage policy is set into law. International
4Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
comparisons are deemed as essential, but limited because of the design of the instruments
used.
In addition, parallel to the introduction of the patient experience survey, the South African
Health Ministry has set forth a programme: The Ideal Clinic Realisation and Maintenance
plan(Hunter et al. 2017). This initiative seeks to encourage improvements in PHC facilities
(e.g. good infrastructure and adequate staff) and foster greater cooperation among PHC facil-
ities, the private sector and non-governmental organisations to address social determinants of
health. In this regard, the Ideal Clinic initiative measures PHC facilities against a set of
promulgated norms and standards (e.g. an Ideal Clinic should score an overall average of 70% in
the patient experience of care survey). One of the PHC clinics in South Africa that has been
assessed by this initiative is Sibasa Clinic, which is a nurse-led public clinic in the Vhembe
District, Limpopo (South Africa). We provide further information about this PHC facility and
its context in Box 1.
This study aims to measure patient experiences of care at Sibasa Clinic more in depth and in
an internationally comparative manner, regarding patientnurse communication and patient
involvement in decisionmaking using a standardised set of PREMs, disseminated by the
OECD. Furthermore, we aim to assess associations of experiences of care with sociodemo-
graphic characteristics of the respondents.
Box 1. Brief description of Sibasa Clinic and its context
Makwarela, home to Sibasa Clinic, is a small township in Thulamela municipality, which is the
second largest municipality in Vhembe District, Limpopo Province. Vhembe district is one of the
poorest in South Africa and the education and employment statistics reflect the poor state of
affairs: 21.9% (48.6% in Makwarela) of the population have a completed Matric (High School
Diploma) and 29.9% (35.8% in Makwarela) have a paid job (Statistics South Africa 2011).
Thulamela municipality has the highest concentration of health care facilities: 3 district hospitals,
1 referral hospital and 52 PHC facilities that include 49 clinics (one of them being Sibasa Clinic)
and 3 community health care centres. In Vhembe, only 39% of clinics have an Ideal Clinic status,
for which Sibasa Clinic applied in 2015 and was denied after failing to meet standards and norms
of quality of care.
Sibasa Clinic is a small primary care clinic that serves the population living in the villages of
Makwarela, Sibasa, Dzingahe and Miluwani. Based on the 2011 Census data, these villages
represent an area of 7.4 km
2
, with more than 4,200 households and a total population of 15.578,
of which 53% are women. Monthly, on average, 4,000 people use the services provided at the
Sibasa clinic. The clinic provides services during business hours (7am to 6pm) from Monday to
Friday. Those who have emergencies after hours or on weekends have to seek care elsewhere (24-
h clinics or hospitals). The clinic is meant to offer comprehensive services that are promotional,
preventative, curative, rehabilitative and palliative. Services offered range from acute and chronic
care, to family planning, antenatal and postnatal care, which includes vaccinations for children.
The clinic has a staff of 22, which includes 17 female nurses of varying qualications, 1 dietician
and 1 pharmacy assistant. The other 3 staff member are non-health professionals. The clinic does
not have a resident medical doctor, i.e. the clinic is nurse-led. This is not uncommon in South
Africa as nurses are trained to be the face of PHC facilities.
Society and Economy 5
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
2. METHODS
2.1. Study design, setting, study population and sampling strategy
In early 2019, a cross-sectional survey was conducted at Sibasa Clinic, South Africa. Given time
and cost restraints, a convenience sample was built with adult patients (18 years old and over)
who had received health care at Sibasa Clinic before. A total of 179 fully completed question-
naires were retrieved for further analysis. We used two modes of survey administration: self- and
interviewer-administered. The latter was used to include those respondents who could not read,
as Limpopos proportion of illiterates is 7% among young people (age between 15 and 35 years)
and 28.7% among adults (age between 35 and 64 years) (McLaren 2014). In the interviewer-
administered survey, the interviewer did not discuss the questions or their meanings with the
respondents. Ethical clearance was obtained from the Limpopo Province Research and Ethics
Committee of the Premiersofce (REC-111513-038). Consent was obtained from all re-
spondents involved.
2.2. Data collection
The survey was composed of a set of standardised questions to measure patient-reported ex-
periences with ambulatory care, as suggested by the OECD (Fujisawa Klazinga 2017). These
questions focused on the patient experience with patient-nurse communication and patient
involvement in decisionmaking. These questions were originally in English; hence, we con-
ducted a forward-backward translation to develop a Tshivenda version of the PREMs questions,
with the support of a professional translator. This was necessary because almost 90% of the
population is Tshivenda native-speaking. Both the English and the Tshivenda surveys were
given to a sample of 10 Tshivenda and English-speaking individuals to complete as a pilot. Issues
raised by respondents were reported and discussed with the interviewer, who was the same at all
stages of data collection. The Tshivenda survey was found to correspond in content and
meaning to the English version, with no culturally sensitive wording.
2.3. Variables
Respondents answered the following questions which serve as dependent variables: 1) did the
nurse spend enough time with the patient in consultation; 2) did the nurse provide easy-to-
understand explanations; 3) did the nurse give an opportunity to ask questions or raise concerns;
4) did the nurse involve the patient in decisions about care and treatment.
All questions had two possible answers: yes/no. These were presented in Tshivenda as Ee/
Hai. The original questions in English language had a multiple point Likert scale as the answer
option. In our survey, we decided to simplify the answer options, taking into consideration
previous expectations towards respondentscharacteristics (e.g. great proportion of illiterate
respondents), but also to mimic the binary answer option of the current national survey on
patient experiences in PHC facilities.
To assess associations between positive experiences with ambulatory care and respondents
sociodemographic characteristics, we considered the following independent variables: sex
(women/men), age group (1834, 3564, 65 and over), job status (having a paid job/not having a
paid job) and the existence of a past negative experience of care at the clinic (1: had a previous
negative experience).
6Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
2.4. Data analysis
We used descriptive statistics to describe respondentscharacteristics. The chi-square test was used
to assess differences in the proportion of participants who had a positive experience by socio-
demographic characteristics and existence of a past negative experience at the clinic. Multivariate
logistic regression was used to assess associations between respondentspositive experience of care
(dependent variable) and sociodemographic characteristics and past negative experience at the
clinic. All analyses were conducted in Stata version 16. The level of signicance was set at P<0.05.
3. RESULTS
Our survey resulted in 179 fully completed questionnaires for further analysis (Table 1). The
majority of the respondents were women (73.2%). The average age of the respondents was 36
years old (standard-deviation: 16). Most respondents were aged between 18 and 34 years old
(58.1%), while respondents above 65 years of age accounted for 8.4% of the sample. The majority
of the respondents (78.8%) did not have a paid job. Most respondents reported to have had a
past negative experience while seeking care at the clinic (77.1%). The share of interview-
administered questionnaires with illiterate respondents was of 29.1%. The proportion of illit-
eracy between women and men, and those with and without a paid job did not differ signi-
cantly (29.8 vs. 35.4% and 24.5 vs. 31.1%).
3.1. Patient experiences at Sibasa Clinic
The total proportion of respondents who reported that their nurse spent enough time with them
was of 83.2% (Table 1). Overall, 86.6% of the respondents reported that the nurse gave easy-to-
understand explanations. The proportion of respondents who reported being given the op-
portunity to ask questions or raise concerns was of 69.8%. Lastly, 78.8% of respondents stated
being involved in decision-making about their care and treatment.
Our data suggested that the proportion of positive experiences with the time a nurse spent in
consultation with a respondent differed significantly by literacy status: those who were literate
reported better experience of care (92.3 vs. 79.5%). Moreover, those who reported previous
negative experiences of care at the clinic had significantly better experiences of care regarding a
nurse spending enough time in consultation (88.4 vs. 65.9%), providing easy-to-understand
explanations (91.3 vs. 70.7%) and involving the patient in decisionmaking (84.8 vs. 58.5%).
3.2. Associations of the respondentssociodemographic characteristics with positive
experiences of care
Women were less likely than men to report positive experiences of care regarding a nurse
spending enough time in consultation, giving opportunity to ask questions or raise concerns and
in being involved in decisionmaking (Table 2). Conversely, women were twice as likely than
men to report a positive experience regarding a nurse giving easy-to-understand explanations.
In contrast to young people (between 18 and 34 years of age), respondents aged between 35
and 64 years had a greater likelihood of positive experience of care with the duration of the
consultation [Odds Ratio (OR) 51.216; 95% Condence Interval (CI): 0.4623.198] and being
given easy-to-understand explanations (OR 52.139; 95% CI: 0.7066.482), although the
Society and Economy 7
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
Table 1. Proportion of positive experiences of care in Sibasa Clinic by respondents' characteristics
Sample Size
Nurse spending enough time
with patient during
consultation
Nurse giving easy-to-
understand explanations
Nurse giving opportunity to
ask questions or raise
concerns
Nurse involving patient in
decisions about care and
treatment
N (%) Yes (%) c
2
(Pvalue) Yes (%) c
2
(Pvalue) Yes (%) c
2
(Pvalue) Yes (%) c
2
(Pvalue)
Sex
Men 48 (26.8) 89.6 1.892 79.2 3.115 70.8 0.031 83.3 0.816
Women 131 (73.2) 80.9 (0.169) 89.3 (0.078) 69.5 (0.860) 77.1 (0.366)
Age groups (in years)
1834 104 (58.1) 81.7 0.788 83.7 2.104 72.1 1.010 78.9 0.021
3564 60 (33.5) 86.7 (0.674) 91.7 (0.349) 68.3 (0.604) 78.3 (0.990)
65 and over 15 (8.4) 80.0 86.7 60.0 80.0
Employment status
No paid job 141 (78.8) 80.9 2.718 85.8 0.345 69.5 0.034 80.1 0.746
Has a paid job 38 (21.2) 92.1 (0.099) 89.5 (0.557) 71.1 (0.854) 73.7 (0.388)
Literacy
Literate 127 (70.9) 92.3 4.319* 92.3 2.062 63.5 1.412 84.6 1.497
Illiterate 52 (29.1) 79.5 (0.038) 84.3 (0.151) 72.4 (0.235) 76.4 (0.221)
Previous negative experience
No 41 (22.9) 65.9 11.524* 70.7 11.523* 58.5 3.221 58.5 13.021**
Yes 138 (77.1) 88.4 (0.010) 91.3 (0.001) 73.2 (0.073) 84.8 (<0.001)
Overall positive experiences (Yes, %)
83.2 86.6 69.8 78.8
Source: Authors.
Note: *P-value < 0.05; **P-value < 0.001.
8Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
Table 2. Multivariate logistic regression results to assess associations of respondents' characteristics with positive experiences of care in Sibasa
Clinic
Nurse spending enough time
with patient during
consultation
Nurse giving easy-to-
understand explanations
Nurse giving opportunity to
ask questions or raise
concerns
Nurse involving patient in
decisions about care and
treatment
OR (95% CI) OR (95% CI) OR (95% CI) OR (95% CI)
Sex
Men (Reference) –––––
Women 0.406 (0.1421.155) 2.232 (0.8835.642) 0.920 (0.4361.939) 0.624 (0.2521.543)
Age groups (in years)
1834 (Reference) –––––
3564 1.216 (0.4623.198) 2.139 (0.7066.482) 0.914 (0.4411.898) 0.841 (0.3651.935)
65 and over 0.551 (0.1322.298) 0.978 (0.1586.045) 0.709 (0.2232.251) 0.840 (0.1993.556)
Employment status
No paid job (Reference) –––––
Has a paid job 2.839 (0.77010.472) 1.374 (0.4903.850) 1.209 (0.5182.825) 0.689 (0.2811.687)
Literacy
Literate (Reference) –––––
Illiterate 2.591 (0.8667.748) 1.506 (0.4535.006) 0.615 (0.2901.307) 1.618 (0.6524.016)
Previous negative experience
No (Reference) –––––
Yes 3.865* (1.5559.607) 4.308* (1.66511.145) 2.156* (1.0134.589) 3.822* (1.7288.457)
Source: Authors.
Note: *P-value < 0.05; OR: Odds ratio; CI: Condence interval.
Society and Economy 9
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
differences were not statistically signicant. Older respondents (65 years old and over) were less
likely to report positive experience across all aspects of the care experience. Those who had a
paid job were more likely to have a positive experience of care across all attributes of the care
experience except that of being involved in decisionmaking about care and treatment (OR 5
0.689; 95% CI: 0.2811.687). In comparison with more educated respondents, those that were
illiterate were more likely to have positive experiences of care across all attributes of the care
experience except that of being given the opportunity to ask questions or raise concerns (OR:
0.615; 95% CI: 0.2901.307). In addition, those who have had a past negative experience at the
clinic were signicantly more likely to report a positive experience of care across all attributes.
4. DISCUSSION
To our knowledge, this is the first study to assess patient experiences of care in South Africa
using a set of standardised questions about PREMs endorsed by the OECD, commonly used for
cross-national comparisons. We assessed the determinants of positive experiences of care in a
public PHC facility (Sibasa Clinic) in Thulamela municipality, South Africa, by means of a
cross-sectional study, using a self- or interviewer-administered survey.
Our findings show that a greater proportion of respondents reported positive experiences of
care with a nurse providing easy-to-understand explanations (86.6%); conversely, the least
proportion of positive experiences was related to being given an opportunity to ask questions or
raise concerns (69.8%). These shares are aligned with those reported in the 2017 Patient
Experience of Care (PEC) survey conducted in 168 randomly selected PHC facilities, where
76.5% of those respondents reported positive experiences of care (Department of Health 2019b).
The comparability of these results is limited because of the differences between surveys (e.g. for
reporting results on the PEC survey, it was decided that an average score of 80% across all items
in the survey should be considered a positive patient experience).
Furthermore, our study revealed differences in positive care experiences across socio-
demographic groups. In general, women reported lower proportions of positive experiences
across all aspects of the care experience, except for that of a nurse giving easy-to-understand
explanations. This result might be partly explained by the fact that Sibasa Clinic is a female
nurse-led PHC facility. A different study in another nurse-led PHC facility highlighted the
importance of nurse communication to a patients satisfaction (and experience) (Nunu
Munyewende 2017). It could be that nurse training on communicational skills in South Africa is
lacking and failing to address the expectations and specic needs of female patients.
Although differences in sociodemographic groups were observed, these were not significant
except when literacy status was considered. The proportion of literate respondents that reported
positive experiences of care regarding a nurse spending enough time with a patient during
consultation was significantly greater than that of illiterate respondents. However, after
adjusting for other characteristics of the respondents, our results show that illiterate respondents
were 2.6 times more likely to report a positive experience compared with a literate respondent.
Studies have shown that more educated people (assuming literacy as a proxy for education)
place a higher degree of importance on their interaction with the clinician and are less likely to
report positive experiences than less educated patients (Rademakers et al. 2012). Our ndings
also suggest that illiterate populations may require special attention from the health care system.
10 Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
The adult literacy rate of South Africa is of 94.3%; however, Limpopos literacy rate (where
Thulamela Municipality is located) shows one of the lowest adult literacy rates: 89.9% (Myburgh
et al. 2005). This may require a diverse skill-set from health professionals, including nurses, at
these PHC facilities to adapt their communication style to the characteristics of a patient.
Our results show that a previous negative experience at the clinic is a determinant of future
positive experiences of care. Those who have had a previous negative experience at the clinic
were more likely to report a current positive experience compared with those who have never
had a negative experience at the clinic before. This could signal that ones expectations adjust
after a previous negative consultation at the same provider. In addition, such negative en-
counters have been shown to affect patientsbehaviour outside the clinical setting (Bayuo 2017;
Schwei et al. 2016). For example, patients in Ghana have reported opting-out of care in their
nearby and designated facilities due to negative experiences (Bayuo 2017). Other studies have
identied other determinants of negative patient experience such as age, with younger patients
being more likely to perceive a negative experience (Brito Fernandes et al. 2019; Xie et al. 2019).
There were no signicant results regarding this in our study.
The systematic measurement of patient experiences in South Africa is somewhat a novelty. The
national survey on patient experiences covers many domains and results are reported as an
average score (on a scale from 0 to 100%). However, there are many methodological aspects of that
survey that make results difficult to compare with those of other countries; hence, the importance
of the use of a standardized set of questions on patient experiences, as those suggested by the
OECD. To a limited extent, our results could be compared with those of the OECDs average of
1119 countries. Our data show that the experiences of patients at the Sibasa Clinic regarding a
nurse spending enough time in consultation (83.2 vs. 80.6%) or providing easy-to-understand
explanations (85.5 vs. 88.5%) were similar to those of the OECD average (Statistics South Africa
2017). Greater differences were noticed on a nurse giving opportunity to ask questions or raise
concerns (69.8 vs. 89.3%) and involving the patient in decisionmaking (77.1 vs. 83.6%) (Statistics
South Africa 2017), signalling where improvement is needed the most.
4.1. Strengths and limitations
Our study was strengthened by the use of OECDs standardised PREMs with ambulatory care.
Therefore, our results could be compared, to a limited extent, to those of other countries that
used the same set of questions. Notwithstanding, our results should be considered in light of
some limitations. The sample size and convenience sampling limited the ability to generalise
ndings to the Thulamela municipality, the country at large and our ability to contrast our
results with those of other OECD countries with national representative samples. Also, the
questions in our survey were presented as a binary response option, in contrast to the multi-
point Likert answers suggested in OECDs survey. This was done to mimic the South African
Department of Healths Patient Experience of Care standardised questionnaire and allow future
comparisons. Finally, recollection of past negative experiences may have created a recall bias and
affected respondentsresponses on their current experiences of care.
4.2. Policy implications and recommendations
This study highlights the complexities of the patient-nurse relationship and the challenges posed
by the sparse availability of data on patient experiences. These data can inform and support the
Society and Economy 11
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
decisions of clinic managers to strengthen patient-centred care. Our study identified that previous
negative experiences of care and literacy status are focal points that require further attention.
Notwithstanding, further studies are needed in South Africa, including more regions and larger
sample sizes to generate more accurate data about patient experiences with ambulatory care.
5. CONCLUSION
Our results suggested that respondents expect to be given the opportunity to ask questions or
raise concerns and be involved in decisionmaking about care and treatment. In general, re-
spondents that were women, older (65 and over), with no paid job, educated and without a
previous negative experience of care at the clinic were less likely to report a positive experience
of care. These results at this PHC facility can inform the decisions of key stakeholders on aspects
of the care experience that need greater improvement within the national framework for quality
and safety assurance and patient experience measurement.
ACKNOWLEDGEMENTS
The authors would like to extend their appreciation to Sibasa Clinic and its staff for their
cooperation. We are also grateful to the respondents in the study. The development and
execution of the survey was funded by the South African Department of Higher Education and
Training. The contribution of OBF, LG, NK and PB occurred within a Marie Skłodowska-Curie
Innovative Training Network (HealthPros Healthcare Performance Intelligence Professionals)
that has received funding from the European Unions Horizon 2020 research and innovation
programme under grant agreement Nr. 765141 (https://healthpros-h2020.eu). The funders had
no role in study design, data collection and analysis, decision to publish, or preparation of the
manuscript. Ethical clearance was obtained from the Limpopo Province Research and Ethics
Committee of the Premiersofce (REC-111513-038). Consent was obtained from all re-
spondents involved. The answers of respondents were anonymized before analysis.
REFERENCES
Agency for Healthcare Research & Quality [AHRQ] (2019): What is Patient Experience? https://www.ahrq.
gov/cahps/about-cahps/patient-experience/index.html, accessed 25/08/2019.
Ahmed, F. Burt, J. Roland, M. (2014): Measuring Patient Experience: Concepts and Methods. The
Patient 7(3): 235241.
Bao, Y. Fan, G. Zou, D. Wang, T. Xue, D. (2017): Patient Experience with Outpatient Encounters at
Public Hospitals in Shanghai: Examining Different Aspects of Physician Services and Implications of
Overcrowding. PLoS One 12(2): e0171684.
Barbazza, E. Kringos, D. Kruse, I. Klazinga, N., Tello, J. (2019): Creating Performance Intelligence
for Primary Health Care Strengthening in Europe. BMC Health Services Research 19: 1006.
Bayuo, J. (2017): Experiences with Out-patient Hospital Service Utilisation Among Older Persons in the
Asante Akyem North District- Ghana. BMC Health Services Research 17(1): 511.
12 Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
Bleich, S. Ozaltin, E. Murray, C. (2009): How Does Satisfaction with the Health-Care System Relate to
Patient Experience? Bulletin of the World Health Organization 87: 271278.
Bresick, G. Christians, F. Makwero, M. Besigye, I. Malope, S. Dullie, L. (2019a): Primary Health
Care Performance: A Scoping Review of the Current State of Measurement in Africa. BMJ Global
Health 4(Suppl. 8): e001496.
Bresick, G. Sayed, A. R. Le Grange, C. Bhagwan, S. Manga, N. (2015): Adaptation and Cross-
cultural Validation of the United States Primary Care Assessment Tool (expanded version) for Use in
South Africa. African Journal of Primary Health Care and Family Medicine 7: e1e11.
Bresick, G. F. Sayed, A. R. Le Grange, C. Bhagwan, S. Manga, N. Hellenberg, D. (2016): Western
Cape Primary Care Assessment Tool (PCAT) Study: Measuring primary care Organisation and Per-
formance in the Western Cape Province, South Africa (2013). African Journal of Primary Health Care
and Family Medicine 8: e1e12.
Bresick, G. von Pressentin, K. B. Mash, R. (2019b): Evaluating the Performance of South African
Primary cAre: A Cross-Sectional Descriptive Survey. South African Family Practice 61(3): 109116.
Brito Fernandes, Ó. Baji, P. Kringos, D. Klazinga, N. Gul
acsi, L. Lucevic A. Boncz, I. P
entek,
M. (2019): Patient Experiences with Outpatient Care in Hungary: Results of an Online Population
Survey. The European Journal of Health Economics 20: 79.
Coulter, A. (2017): Measuring What Matters to Patients. BMJ 356: j816.
De Rosis, S. Cerasuolo, D. Nuti, S. (2020): Using Patient-Reported Measured to Drive Change in
Healthcare: The Experience of the Digital, Continuous and Systematic PREMs Observatory in Italy.
BMC Health Services Research 20: 315.
Department of Health (2017): National Guideline on Conducting Patient Experience of Care Survey in
Public Health Establishments. Pretoria: Department of Health.
Department of Health (2019a): National Health Insurance Bill. Pretoria: Department of Health.
Department of Health (2019b): Health. South African Government.https://www.gov.za/about-sa/health,
accessed 03/12/2019.
Doyle, C. Lennox, L. Bell, D. (2013): A Systematic Review of Evidence on the Links Between Patient
Experience and Clinical Safety and Effectiveness. BMJ Open 3: e001570.
Dullie, L. Meland, E. Hetlevik, Ø.Mildestvedt, T. Gjesdal, S. (2018): Development and Validation of
a Malawian Version of the Primary Care Assessment Tool. BMC Family Practice 19: 6374.
Duschinsky, R. Paddison, C. (2018): The Final Arbiter of Everything: A Genealogy of Concern with
Patient Experience in Britain. Social Theory & Health 16: 94110.
Fujisawa, R. Klazinga, N. (2017): Measuring Patient Experiences (PREMS): Progress Made by the OECD
and Its Member Countries Between 2006 and 2016. OECD Health Working Paper 102.
Gilmore K. J. Pennucci, F. De Rosis, S. Passino, C. (2019): Value in Healthcare and the Role of the
Patient Voice. Healthcare Papers 18(4): 2835.
Gul
acsi, L. P
entek, M. (2014): HTA in Central and Eastern European Countries; The 2001: A Space
Odyssey and Efciency Gain. The European Journal of Health Economics 15: 675680.
Hunter, J. Chandran, T. Asmall, S. Tucker, J. Ntshengedzeni, R. (2017): South African Health
Review 2017. Durban: Health Systems Trust.
Ivankovic D. Poldrugovac, M. Garel, P. Klazinga, N. S. Kringos, D. S. (2020): Why, What and How
do European Healthcare Managers Use Performance Data? Results of a Survey and Workshop Among
Members of the European Hospital and Healthcare Federation. PLoS One 15(4): e0231345.
Kelly, G. Mrengqwa, L. Geffen, L et al. (2019): They Dont Care About Us: Older Peoples Experiences
of Primary Healthcare in Cape Town, South Africa. BMC Geriatrics 19: 98.
Society and Economy 13
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
Kingsley, C. Patel, S. (2017): Patient-reported Outcome Measures and Patient-reported Experience
Measures. BJA Education 17(4): 137144.
LaVela, S. Gallan, A. (2014): Evaluation and Measurement of Patient Experience. Patient Experience 1(1):
2836.
Llanwarne, N. Abel, G. Elliot, M. Paddison, C. Lyratzopoulos, G. Campbell, J. et al. (2013):
Relationship Between Clinical Quality and Patient Experience: Analysis of Data from the English
Quality and Outcomes Framework and the National GP Patient Survey. Annals of Family Medicine
11(5): 467472.
Lucevic, A. P
entek, M. Kringos, D. Klazinga, N. Gul
acsi, L. Brito Fernandes, Ó. Boncz, I. Baji,
P. (2019): Unmet Medical Needs in Ambulatory Care in Hungary: Forgone Visits and Medications
from a Representative Population Survey. European Journal of Health Economics 20: 7178.
Manga, N. Harding, R. De Sa, A. Murie, K. Namane, M. Raubenheimer, P. (2018): Development
and Validation of a Tool to Measure Patient Experience in Chronic Disease Care. African Journal of
Primary Health Care & Family Medicine 10: 6.
McLaren, Z. Ardington, C. Leibbrandt, M. (2014): Distance Decay and Persistent Health Care Dis-
parities in South Africa. BMC Health Services Research 14: 541.
Monson, J. (2006): South African Child Gauge 2006. Cape Town: Childrens Institute, University of Cape
Town.
Mukiapini, S. Bresick, G. Sayed, A. R. Le Grange, C. (2018): Baseline Measures of Primary Health
Care Team Functioning and Overall Primary Health Care Performance at Du Noon Community
Health Centre. African Journal of Primary Health Care & Family Medicine 10: 1458.
Myburgh, N. Solanki, G. Smith, M. Lalloo, R. (2005): Patient Satisfaction with Health Care Providers in
South Africa: The Inuences of Race and Socioeconomic Status. International Journal for Quality in
Health Care 17(6): 473477.
Nunu, W. Munyewende, P. (2017): Patient Satisfaction with Nurse-delivery Primary Health Care Services
in Free State and Gauteng Provinces, South Africa: A Comparative Study. African Journal of Primary
Health Care & Family Medicine 9(1): 18.
OECD (2014): OECD Health Statistics 2014: How Does South Africa Compare? Paris: OECD. https://www.
oecd.org/els/health-systems/Brieng-Note-SOUTH-AFRICA-2014.pdf, accessed 15/12/2019.
OECD (2017): Ministerial Statement. The Next Generation of Health Reforms. OECD Health Ministerial
Meeting. Paris.
OECD (2019a): Health Status: Infant Mortality Rates.https://data.oecd.org/healthstat/infant-mortality-
rates.htm, accessed 15/12/2019.
OECD (2019b): Hows life in South Africa. Paris: OECD. https://www.oecd.org/statistics/Better-Life-
Initiative-country-note-South-Africa.pdf, accessed 15/12/2019.
OECD (2019c): Health Status: Life Expectancy at Birth.https://data.oecd.org/healthstat/life-expectancy-at-
birth.htm, accessed 15/12/2019.
OECD European Commission (2019): Health at a Glance: Europe 2019. Paris: OECD Publishing.
Peltzer, K. (2009): Patient Experiences and Health System Responsiveness in South Africa. BMC Health
Services Research 9: 117.
Peltzer, K. Phaswana-Mafuya, N. (2012): Patient Experiences and Health System Responsiveness Among
Older Adults in South Africa. Global Health Action 5: 18545.
P
entek, M. (2019): Patient-reported Outcomes: Opportunities and Challenges in Central Europe. The
European Journal of Health Economics 20: 13.
14 Society and Economy
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
Presidents Cancer Panel (2018): Promoting Value, Affordability, and Innovation in Cancer Drug Treat-
ment. A Report to the President of the United States. Washington: Presidents Cancer Panel.
Price, R. Elliott, M. Zaslavsky, A. Hays, R. Lehrman, W. Rybowski, L. (2014): Examining the Role
of Patient Experience Surveys in Measuring Health Care Quality. Medical Care Research and Review
71(5): 522554.
Rademakers, J. Delnoij, D. Nijman, J. de Boer, D. (2012): Educational Inequalities in Patient-centred
Care: PatientsPreferences and Experiences. BMC Health Services Research 12(1): 2.
Sandager, M. Freil, M. Knudsen, J. (2016): Please Tick the Appropriate Box: Perspectives on Patient
Reported Experience. Patient Experience Journal 3: 6379.
Schwei, R. Johnson, T. Matthews, A. Jacobs, E. (2016): Perceptions of Negative Health-care Expe-
riences and Self-reported Health Behavior Change in Three Racial and Ethnic Groups. Ethnicity &
Health 22(2): 15168.
Statistics South Africa (2011): Thulamela Statistics.http://www.statssa.gov.za/?page_id5993&id5thulamela-
municipality, accessed 16/03/2019.
Statistics South Africa (2017): General Household Survey 2017. Pretoria: Statistics South Africa.
Wolfe, J. Niederhauser, V. Marshburn, D. LaVela, S. L. (2014): Dening Patient Experience. Patient
Experience Journal 1(1):719.
WHO (2018): Pricing of Cancer Medicines and Its Impacts. Geneva: WHO.
Xie, J. Hu, Y. Lu, C. Fu, Q. Carbone, J. Wang, L. et al. (2019): What Are the Risk Factors of
Negative Patient Experience? A Cross-Sectional Study in Chinese Public Hospitals. INQUIRY: The
Journal of Health Care Organization, Provision, and Financing 56: 17.
Xu, K. Evans, D. Carrin, G. Aguilar-Rivera, M. (2005): Designing Health Financing Systems to Reduce
Catastrophic Health Expenditure. Geneva: WHO.
Open Access. This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International
License (https://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any
medium, provided the original author and source are credited, a link to the CC License is provided, and changes if any are
indicated. (SID_1)
Society and Economy 15
Unauthenticated | Downloaded 08/01/20 12:23 PM UTC
... According to Fernandes et al. (2020), patients visiting a clinic in Makwarela in the Limpopo province of South Africa expressed different experiences with nurses' interactions. In the same study, literate patients reported positive experiences regarding the time spent with the nurse, unlike those that are less literate. ...
... According to Fernandes et al. (2020), patients visiting a clinic in Makwarela in the Limpopo province of South Africa expressed different experiences with nurses' interactions. In the same study, literate patients reported positive experiences regarding the time spent with the nurse, unlike those that are less literate. ...
... According to Fernandes et al. (2020), patients visiting a clinic in Makwarela in the Limpopo province of South Africa expressed different experiences with nurses' interactions. In the same study, literate patients reported positive experiences regarding the time spent with the nurse, unlike those that are less literate. ...
... According to Fernandes et al. (2020), patients visiting a clinic in Makwarela in the Limpopo province of South Africa expressed different experiences with nurses' interactions. In the same study, literate patients reported positive experiences regarding the time spent with the nurse, unlike those that are less literate. ...
... Creating a more patient-centered healthcare system that provides excellent responsiveness to patients' needs, expectations, and preferences has become the main agenda for improving the provision of health services in recent decades [25]. To create a patient-centered health system, the stakeholders need to know how patients experience current services and their expectations. ...
Article
Full-text available
Inadequate men’s engagement with health services may be influenced by unmet needs and demands of the local men’s community. This study aimed to explore men’s experiences with primary health services and their expectations of the characteristics of friendly primary health services, from the perspective of men in Kelantan, Malaysia. A qualitative study using in-depth interviews was conducted with 15 men from six primary health facilities in Kelantan, Malaysia, who were selected based on maximum variation sampling. The data were transcribed and analyzed using the thematic analysis method. The study found that experiences with the existing primary health services were categorized into four subthemes: provision of health services, health promotion delivery, attributes of healthcare providers, and the physical environment of the health facilities. Meanwhile, the expectations of the characteristics of friendly primary health services were categorized into four subthemes: meeting the needs of men in primary health services, approaching men through effective health promotion strategies, standards of a healthcare provider from the viewpoint of men, and a comfortable physical environment for men. Prior experiences hugely influenced men’s expectations of friendly primary health services. Men want these health service characteristics customized to meet their needs, allowing them to use health services with confidence and comfort. Thus, to strengthen primary health services for men, it is essential to comprehend their prior experiences with and expectations of the services.
... This evidence is one facet of the academic output relating to PREMs. There are additionally a large number of studies describing the development, validation and testing of PREM tools [15,[52][53][54][55][56], and other studies which include PREM scores in a bundle of other measures, or compare relationships between PREM scores and other outcomes (e.g. PROMs) [41,57,58]. ...
Article
Full-text available
Background Many governments have programmes collecting and reporting patient experience data, captured through Patient Reported Experience Measures (PREMs). Our study aims to capture and describe all the ways in which PREM data are used within healthcare systems, and explore the impacts of using PREMs at one level (e.g. national health system strategy) on other levels (e.g. providers). Methods We conducted a narrative review, underpinned by a systematic search of the literature. Results 1,711 unique entries were identified through the search process. After abstract screening, 142 articles were reviewed in full, resulting in 28 for final inclusion. A majority of papers describe uses of PREMs at the micro level, focussed on improving quality of front-line care. Meso-level uses were in quality-based financing or for performance improvement. Few macro-level uses were identified. We found limited evidence of the impact of meso- and macro- efforts to stimulate action to improve patient experience at the micro-level. Conclusions PREM data are used as performance information at all levels in health systems. The use of PREM data at macro- and meso- levels may have an effect in stimulating action at the micro-level, but there is a lack of systematic evidence, or evaluation of these micro-level actions. Longitudinal studies would help better understand how to improve patient experience, and interfaces between PREM scores and the wider associated positive outcomes.
Article
Full-text available
Background: The use of Patient Reported Experience Measures (PREMs) has great potential in healthcare service improvement, but a limited use. This paper presents an empirical case of PREMs innovation in Italy, to foster patient data use up to the ward level, by keeping strengths and addressing weaknesses of previous PREMs survey experiences. The paper reports key lessons learned in this ongoing experience of action research, directly involving practitioners. Methods: The aim of this paper is to present the results of an ongoing action research, encompassing the innovation of PREMs collection, reporting and use, currently adopted by 21 hospitals of two Italian regions. The continuous and systematic PREMs collection has been implemented between 2017 and 2019 and includes: a continuous web-based administration, using web-services; an augmented and positive questionnaire matching standard closed-ended questions with narrative sections; the inclusion and benchmarking of patient data within a shared performance evaluation system; public disclosure of aggregated anonymized data; a multi-level and real-time web-platform for reporting PREMs to professionals. The action research was carried out with practitioners in a real-life and complex context. The authors used multiple data sources and methods: observations, feedback of practitioners, collected during several workshops and meetings, and analysis of preliminary data on the survey implementation. Results: A continuous and systematic PREMs observatory was developed and adopted in two Italian regions. PREMs participation and response rates tend to increase over time, reaching stable percentages after the first months. Narrative feedback provide a 'positive narration' of episodes and behaviours that made the difference to patients and can inform quality improvement actions. Real-time reporting of quantitative and qualitative data is enabling a gratifying process of service improvement and people management at all the hospitals' levels. Conclusions: The PREMs presented in this paper has been recognized by healthcare professionals and managers as a strategic and positive tool for improving an actual use of PREMs at system and ward levels, by measuring and highlighting positive deviances, such as compassionate behaviours.
Article
Full-text available
Objective of this study was to better understand the use of performance data for evidence-based decision-making by managers in hospitals and other healthcare organisations in Europe in 2019. In order to explore why, what and how performance data is collected, reported and used, we conducted a cross-sectional study based on a self-reported online questionnaire and a follow-up interactive workshop. Our study population were participants of a pan-European professional Exchange Programme and their hosts (n = 125), mostly mid-level hospital managers. We found that a substantial amount of performance data is collected and reported, but could be utilised better for decision-making purposes. Motivation to collect and report performance data is equally internal and external, for improvement as well as for accountability purposes. Benchmarking between organisations is recognised as being important but is still underused. A plethora of different data sources are used, but more should be done on conceptualising, collecting, reporting and using patient-reported data. Managers working for privately owned organisations reported greater use of performance data than those working for public ones. Strategic levels of management use performance data more for justifying their decisions, while managers on operational and clinical levels use it more for day-to-day decision-making. Our study showed that, despite the substantial and increasing use of performance data for evidence-based management, there is room and need to further explore and expand its role in strategic decision-making and supporting a shift in healthcare from organisational accountability towards the model of learning organisations.
Article
Full-text available
A prevailing feature of recent healthcare delivery and reform initiatives is a focus on increasing the value provided by investment in services, alongside a more nuanced understanding of how such value should be considered. Effective measurement of this value remains an elusive goal for most health system performance assessment (HSPA) systems. A more prominent role for the patient voice can enable a better understanding of value at both patient and population levels. The Tuscan HSPA model has evolved over the past several years by adopting the perspective of service users, including multiple dimensions of performance, and illustrating the interactions of these elements. For the heart failure pathway, this approach has now been further developed to combine these dimensions with the systematic electronic collection of patient-reported outcome measures and patient-reported experience measures - initially in a specialist hospital. This enables a richer understanding of the value delivered by professionals as they operate in reality, as opposed to by organizational boundaries, and more timely and actionable insights into the drivers of that value. This commentary sets out the latest developments in the Tuscan HSPA and the lessons from implementation.
Article
Full-text available
Background: Primary health care and its strengthening through performance measurement is essential for sustainably working towards universal health coverage. Existing performance frameworks and indicators to measure primary health care capture system functions like governance, financing and resourcing but to a lesser extent the function of services delivery and its heterogeneous nature. Moreover, most frameworks have weak links with routine information systems and national health priorities, especially in the context of high- and middle-income countries. This paper presents the development of a tool that responds to this context with the aim to create primary health care performance intelligence for the 53 countries of the WHO European Region. Methods: The work builds-off of an existing systematic review on primary care and draws on priorities of current European health policies and available (inter)national information systems. Its development included: (i) reviewing and classifying features of primary care; (ii) constructing a set of tracer conditions; and (iii) mapping existing indicators in the framework resulting from (i). The analysis was validated through a series of reviews: in-person meetings with country-nominated focal points and primary care experts; at-distance expert reviews; and, preliminary testing with country informants. Results: The resulting framework applies a performance continuum in the classical approach of structures-processes-outcomes spanning 6 domains - primary care structures, model of primary care, care contact, primary care outputs, health system outcomes, and health outcomes - that are further classified by 26 subdomains and 63 features of primary care. A care continuum was developed using a set of 12 tracer conditions. A total of 139 indicators were mapped to the classification, each with an identified data source to safeguard measurability. Individual indicator passports and a glossary of terms were developed to support the standardization of the findings. Conclusion: The resulting framework and suite of indicators, coined the Primary Health Care Impact, Performance and Capacity Tool (PHC-IMPACT), has the potential to be applied in Europe, closing the gap on existing data collection, analysis and use of performance intelligence for decision-making towards primary health care strengthening.
Article
Full-text available
Introduction Countries with strong primary healthcare (PHC) report better health outcomes, fewer hospital admissions and lower expenditure. People-centred care that delivers essential elements of primary care (PC) leads to improved health outcomes and reduced costs and disparities. Such outcomes underscore the need for validated instruments that measure the extent to which essential, evidence-based features of PC are available and applied to users; and to ensure quality care and provider accountability. Methods A systematic scoping review method was used to identify peer-reviewed African studies and grey literature on PC performance measurement. The service delivery dimension in the Primary Healthcare Performance Initiative conceptual framework was used to identify key measurable components of PC. Results The review identified 19 African studies and reports that address measuring elements of PC performance. 13 studies included eight nationally validated performance measuring instruments. Of the eight, the South African and Malawian versions of Primary Care Assessment Tool measured service delivery comprehensively and involved PC user, provider and manager stakeholders. Conclusion 40 years after Alma Ata and despite strong evidence for people-centred care, significant gaps remain regarding use of validated instruments to measure PC performance in Africa; few validated instruments have been used. Agreement on indicators, fit-for-purpose validated instruments and harmonising existing instruments is needed. Rigorous performance-based research is necessary to inform policy, resource allocation, practice and health worker training; and to ensure access to high quality care in a universal health coverage (UHC) system—research with potential to promote socially responsive, accountable PHC in the true spirit of the Alma Ata and Astana Declarations.
Article
Full-text available
Introduction: In 2018 governments reaffirmed their commitment to implementing primary health care (PHC) in the Astana Declaration. South Africa has introduced a number of health reforms to strengthen PHC and enable universal health coverage (UHC). UHC requires access to quality primary care and progress needs to be measured. This study aimed to evaluate the quality of South African primary care using the Primary Care Assessment Tool (PCAT). Methods: A descriptive cross-sectional survey used data derived from a previous analytical observational study. Data from 413 patients, 136 health workers and 55 managers were analysed from 30 community health centres across four provinces of South Africa. Scores were obtained for 10 key domains and an overall primary care score. Scores were compared in terms of respondents, provinces and monthly headcount. Results: Patients rated first contact accessibility, ongoing care and community orientation as the poorest performing elements (< 50% scoring as ‘acceptable to good’); first contact utilisation, informational coordination and family-centredness as weaker elements (< 66% scoring as ‘acceptable to good’); and comprehensiveness, coordination, cultural competency and availability of the PHC team as stronger aspects of primary care (≥ 66% or more scoring as ‘acceptable or good’). Managers and providers were generally much more positive about the performance of PHC. Conclusion: Gaps exist between PHC users’ experience of care and what PHC staff believe they provide. Priorities to strengthen South African primary care include improving access, informational and relational continuity of care, and ensuring the implementation of community-orientated primary care. The PCAT is a useful tool to measure quality of primary care and progress with UHC.
Article
Full-text available
Background The objective of this paper is to explore unmet health care needs in Hungary in ambulatory care due to costs and difficulties in travelling, and to analyze how unmet needs relate to socio-demographic characteristics. Methods The quantitative analysis is based on a national, representative online survey carried out in Hungary on a sample of 1000 respondents in early 2019 using a proposed set of questions developed by the OECD. We present and compare unmet medical needs in different socio-demographic groups, and we use multivariate logistic regression analysis to identify the main determinants of unmet medical needs. Results Among responders who had medical problems in the last 12 months, 27.3% reported forgone medical visit due to difficulties in travelling, 24.2% had unfilled prescription for medicine due to costs, 21.4% reported forgone medical visit or follow-up visit due to costs and 16.6% reported skipped medical test, treatment or other follow-up due to costs. These shares are much higher than presented previously in international databases. The logistic model indicates that respondents were significantly more likely to report unmet needs if they were women, younger or belonged to first and second income quintiles. Conclusions Policy makers need to address the issue of high prevalence of forgone medical care among the Hungarian population to avoid deterioration of population health and inequalities in access. As a first step, policies should try to decrease financial burden of vulnerable groups to improve access.
Article
Full-text available
Background Health systems are undertaking efforts to make health care more patient centered and value based. To achieve this goal, the use of patient-reported experience measures (PREMs) is increasing, especially across OECD countries. However, in Hungary, data on patients’ experiences are still lacking. Thus, our aim was twofold: first, to collect data on outpatient experience in Hungary on patient–doctor communication and patient involvement in decision making and compare it with that of other OECD countries; second, to assess associations of outpatient experience with patients’ socioeconomic characteristics. Methods In early 2019, we conducted a cross-sectional, online, self-administered survey in a national representative sample of Hungary’s population (n = 1000). The sample was weighted considering gender, age, highest education level attained, type of settlement, and region of residence. The survey questions were based on a set of recommended questions by the OECD. Results Our findings show that the proportion of reported positive experiences is as follows: doctors providing easy-to-understand explanations (93.1%) followed by time spent on the consultation (87.5%), opportunities to raise questions (85.8%), and doctors involving patients in decision making about care and treatment (80.1%). The share of positive experiences falls behind OECD’s average regarding patient–doctor communication and patient involvement in decision making, which signals room for improvement in these areas. Conclusions Women, younger people, people with a paid job, and patients with consultations with allied health professionals reported significant lesser positive care experiences and, hence, more targeted policies can be initiated based on our findings.
Article
Full-text available
Hospitals are struggling to involve patients and learn from their experience. The risk factor of patient experience is increasingly recognized as a critical component in improving patient experience. Our study explored risk factors of negative patient experience in order to improve the health-service quality of public hospitals. We conducted a cross-sectional study in Hubei province, China. A total of 583 respondents were surveyed by the Outpatient Experience Questionnaire with good validity and reliability in July 2015. T-tests were conducted to compare the experience scores among different outpatient groups. Multiple linear regression was performed to determine the significant factors that influenced the outpatient experience. Outpatients between 18 and 44 years old had the lowest experience scores (65.89 ± 0.79), whereas outpatients completely paying out-of-pocket had the lowest experience scores (64.68 ± 0.81) among all participants. Outpatients with poor self-rated health status had the lowest experience scores (66.14 ± 1.61) among different self-rated health status groups. While age, type of payment, and self-rated health status were significantly risk factors that influenced outpatient experience in the multiple linear regression. Thus, health-care providers should pay more attention to outpatients who are young (age <45), completely out-of-pocket and poor health status, and provide precision health care to improve outpatient experience.