Access to this full-text is provided by Springer Nature.
Content available from Pilot and Feasibility Studies
This content is subject to copyright. Terms and conditions apply.
S T U D Y P R O T O C O L Open Access
Protocol for the STAR (Sheffield Treatments
for ADHD) project: an internal pilot study
assessing the feasibility of the Trials within
Cohorts (TwiCs) design to test the
effectiveness of interventions for children
with ADHD
Philippa Fibert
1*
, Clare Relton
1
, Tessa Peasgood
1
and David Daley
2
Abstract
Background: Attention deficit hyperactivity disorder (ADHD) is a common and growing problem and a leading
cause of child referrals to Child and Adult Mental Health Services (CAMHS). It is a drain on resources across nationally
funded support agencies and associated with negative outcomes such as early criminality, school disruption and
antisocial behaviour. Mainstream interventions (pharmacological and behavioural) demonstrate effectiveness whilst
implemented, but are costly, often have unwanted side effects and do not appear to be affecting long-term outcomes.
Development of a robust evidence base for the effectiveness of current and novel interventions and their impact over
the long term is required. The aim of the Sheffield Treatments for ADHD Research (STAR) project is to facilitate a
rigorous evidence base in order to provide information about the comparative (cost) effectiveness and acceptability of
multiple interventions to key stakeholders.
Methods: The Trials within Cohorts (TwiCs) design was used to build a cohort of children with a diagnosis of ADHD
and conduct a three-armed pilot trial of the clinical and cost effectiveness of two novel interventions: (a) treatment by
nutritional therapists and (b) treatment by homoeopaths, compared to (c) treatment as usual.
Participants are recruited to the STAR long-term observational cohort, and their outcomes of interest (ADHD
symptoms, health-related quality of life, school disruption, resource use and criminality) are measured every
6 months by carers and (blinded) teachers. Two promising interventions were identified for the first randomised
controlled trial embedded in the cohort. A random selection of eligible participants is offered treatments (a) and (b).
The outcomes of those offered treatment are compared to those not offered treatment using intention to treat
(ITT) analysis.
The feasibility of recruiting to the cohort and the trial, delivering the interventions, the effectiveness of the
interventions and the appropriateness, sensitivity and collectability of outcomes is trialled.
(Continued on next page)
* Correspondence: p.fibert@sheffield.ac.uk
1
School of Health and Related Research, University of Sheffield, Regent Court,
30 Regent Street, Sheffield S1 4DA, UK
Full list of author information is available at the end of the article
© The Author(s). 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0
International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and
reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to
the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver
(http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
Fibert et al. Pilot and Feasibility Studies (2018) 4:61
https://doi.org/10.1186/s40814-018-0250-3
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
(Continued from previous page)
Discussion: The results of this trial will provide information on the feasibility of the TwiCs design to facilitate
multiple trials of potential interventions for children with ADHD, and the acceptability, clinical and cost effectiveness
of two potential interventions for ADHD to ADHD stakeholders including service providers. Future stages of the STAR
project will test other treatments informed by the results in stage 1.
Trial registration: ISRCTN number 17723526. https://doi.org/10.1186/ISRCTN17723526. Date assigned 27/4/15.
Keywords: ADHD, Feasibility, TwiCs, Nutrition, Homoeopathy
Background
ADHD is a common and growing problem and a leading
cause of child referrals to Child and Adult Mental
Health Services (CAMHS). It accounts for a sizeable
amount of resource use, is a drain on resources across
nationally funded support agencies [1], and presents a
major, often unmet challenge to services [2]. There is a
need to improve outcomes, where the condition is asso-
ciated with negative outcomes such as early criminality,
school disruption and antisocial behaviour. Mainstream
interventions (pharmacological and behavioural) demon-
strate effectiveness whilst implemented, but are costly,
often have unwanted side effects and do not appear to
be affecting long-term outcomes.
ADHD is associated with a range of negative behav-
iours such as difficulties regulating emotions, particu-
larly anger [3], involvement with violent criminality and
at a young age [4], school disruption, exclusion and low
attainment [5,6]. Children often have few friends [7],
and their experience of school can be one of academic
failure, rejection by peers and low self-esteem [8]. Infor-
mation is required about cost-effective interventions
which can achieve positive changes over the long term.
Current interventions may only be effective whilst im-
plemented [9,10] over the short term [11–13] and com-
pliance with medication (the main intervention) can be
poor [14,15]. Furthermore, up to 25% of children may
not respond to stimulant medication [16–18] which is
associated with adverse events [19] particularly those
with concomitant ADHD and autism spectrum condi-
tions (ASCs) [20–22].
Whilst we have information about the efficacy of main-
stream interventions, it is unclear whether this translates
into real-world effectiveness, acceptability and improve-
ment in long-term outcomes. Pragmatic trials will be help-
ful for a variety of reasons [23]. Measurement of the
acceptability and (cost) effectiveness of interventions over
the long term can provide important information for
stakeholders. Heterogeneity is a feature of ADHD expres-
sion and children often have a wide range of other diagno-
ses such as ASCs [24], conduct disorders [25], sleep
disturbance [26], gut dysbiosis and tics [27]. Information
is required about whether efficacious interventions for
children with single ADHD diagnoses are effective in
populations with additional co-morbidities. Finally, chil-
dren with ADHD and their families can be hard to engage
and treat [28]; therefore, the acceptability of interventions
is an important consideration.
The Trials within Cohorts (TwiCs) design (also known
as the cohort multiple randomised controlled trial
(cmRCT) design) has been developed to help address
some of the limitations associated with existing RCT de-
signs [29]: for example, the tendency for potential treat-
ments to be trialled one at a time, in different populations
by different research teams, yielding trials with heteroge-
neous trial populations between trials and often short-
term and heterogeneous outcomes.
The TwiCs design recruits a large, long-term observa-
tional cohort of people with the condition of interest
and regularly measures their outcomes of interest. For
each trial embedded within this cohort, a proportion
meeting trial inclusion and exclusion criteria are offered
interventions. Those not randomly selected act as a vir-
tual treatment as usual (TAU) control group.
The STAR project aims to facilitate a rigorous evi-
dence base in order to provide information about the
comparative (cost) effectiveness and acceptability of
multiple interventions to key stakeholders about inter-
ventions which might address treatment gaps. This pilot
study addresses the research question: Is the TwiCs de-
sign feasible to assess the effectiveness of treatments for
ADHD? For the study, two interventions with prelimin-
ary indications of effectiveness, considered complemen-
tary and alternative medicine (CAM) [30], have been
selected. Parents of children with ADHD are trying these
interventions, paying for them out of pocket.
CAM use for ADHD has been found to range from
12% [31] to 71% [32]. Its use is increasing, especially
for conditions without effective recommended treat-
ments, where medical treatment is associated with ser-
ious adverse effects [33]andforchildrenwithchronic
conditions [34–36]. Patients are using CAM despite
physician’s concerns, and in addition to medication,
therefore, development of a robust evidence base is re-
quired. The CAM interventions being used by parents
of children with ADHD include acupuncture, aroma-
therapy, chiropractic, elimination diets, fatty acid sup-
plementation, herbal medicine, homoeopathy, massage,
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 2 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
speech, physical and occupational therapy, and vitamins
[31,32,36,37].
For this first RCT, we identified two interventions
showing indications of effectiveness and being used by
parents of children with ADHD. Since they are being
tested as experienced in real-life clinical practice as be-
fitting a pragmatic trial, we named them treatment by a
homoeopath and treatment by a nutritional therapist.
The published evidence for homoeopathic treatment
for ADHD consists of seven trials: two RCTs tested the
efficacy of specific homoeopathic formulas [38,39]; four
RCTs tested the efficacy of individualised homoeopathic
medicines [40–43]; and one within subjects trial of chil-
dren with ASCs measuring ADHD symptoms tested the
effectiveness of individualised homoeopathic treatment
[44]. All studies but one [42] of individualised homoeop-
athy found significant improvements, but effect size var-
ied, and quality is variable.
Although a healthy diet is recommended by NICE [2],
no trials assessing the effectiveness or acceptability of
this have yet been conducted. There are many studies
exploring the efficacy of individual nutrients, multiple
nutrients, and special diets for ADHD. Systematic re-
views concur that polyunsaturated fatty acids have small
effects on ADHD symptoms [45,46] and that restricted
elimination diets, artificial food colour elimination and
dietary supplements may be efficacious, but more stud-
ies are required before firm conclusions can be reached.
Improvements may be optimised by both eliminating ag-
gravating factors and boosting nutritional deficits in an
individualised way, since sensitivities are found in some
but not all children with ADHD. Treatment by nutri-
tional therapists provides advice about, and support
implementing, individually tailored exclusion, supple-
mentation, and healthy eating.
Aims and objectives
The aim of the STAR project is to provide a facility for
efficiently testing multiple interventions for children
with ADHD.
Stage 1 of the STAR project will test the feasibility of
the Trials within Cohorts (TwiCs) design and conduct a
three-armed pilot trial of the clinical and cost effective-
ness of two interventions: (a) the offer of a course of
treatment by homoeopaths and (b) the offer of a course
of treatment by a nutritional therapist, compared to (c)
treatment as usual.
Stage 1 will test the feasibility of the TwiCs design by
conducting a small-scale test of the methods and proce-
dures and assess the acceptability, deliverability, clinical
and cost effectiveness of treatment by homoeopaths and
nutritional therapists for children with ADHD.
The objectives of stage 1 are to assess the feasibility of
recruiting to time and target a cohort of children with a
diagnosis of ADHD, their carers and teachers; the feasi-
bility and acceptability of the study design; the feasibility,
deliverability, safety and acceptability of the interven-
tions; the suitability, acceptability and deliverability of
the outcome measures; and to inform sample size calcu-
lation for a full trial (stage 2).
Methods
Recruitment
At least 140 children aged 5–18 with a diagnosis of
ADHD and any accompanying co-morbidities are re-
cruited to an observational cohort and their consent to
participate in the cohort is sought by completion of a
questionnaire with embedded consent to be contacted
again. Their outcomes of interest are measured at re-
cruitment (baseline) and every 6 months, via these ques-
tionnaires, which are completed by carers and blinded
teachers. Carers of children with ADHD were involved
in the selection of items for, design and pilot testing of
the questionnaire, advised about recruitment and sat on
the steering committee.
Randomisation
After recruitment to the STAR cohort, a three-armed in-
ternal pilot trial is subsequently conducted whereby ran-
dom selections of eligible children are offered either
adjunctive treatment by homoeopaths (arm 1) or nutri-
tional therapists (arm 2). Randomisation is computer
generated by an independent statistician from the Uni-
versity of Sheffield and held in the locked drawer of a
different statistician from the University of Sheffield.
Stratifying factors are age (primary 5–11/secondary 12–
18), medication status (yes/no) and ADHD severity
(Conners global ADHD Tscore 80+/under 80) [47]. Par-
ticipants fulfilling inclusion and exclusion criteria who
consent to be contacted again are identified on recruit-
ment to the cohort. Stratifying factors are extracted and
emailed to the statistician holding the randomisation list,
who randomly assigns them to one of the three groups
and gives them a randomly generated three-digit code
by which they are subsequently identified.
Carer and child’s consent to try treatments is sought
at this stage. They are sent a letter of invitation for 1 year
of treatment, which includes a statement that partici-
pants can withdraw at any time; a brief description of
the treatment; requests the carer to ask their child if
they are happy to participate; a consent form to treat-
ment to be signed by carer and child and returned in a
pre-paid envelope; and an email address and telephone
number as an alternate means of contact. The PI then
rings the participants up and asks if they have any ques-
tions; if they wish to participate (if their form has not
yet been returned); and if they both consent, to their de-
tails being passed on to the therapist. In the absence of a
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 3 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
returned ‘consent to treatment’form, carer and child’s
wish to participate on the telephone is taken as verbal
consent. Consent forms are then signed at the first ap-
pointment with the therapist, who further explains what
treatment will constitute, as befits usual practice. Appro-
priate marks by young children are taken as signatures.
Those children not selected act as a treatment as usual
control (arm 3).
Sample size
Sample size for the pilot trial is calculated to recruit at
least 30 participants in each arm in order to estimate the
pooled standard deviation of the outcome with a reason-
able degree of precision for the full trial [48,49]. We
have estimated that attrition will be 20% based on a pre-
liminary feasibility-controlled case series [50] and that a
further 20% joining the STAR cohort will either not
meet the first trial inclusion criteria or not accept the
offer of treatment.
Sample size for the full trial will be based upon results
obtained in the pilot. The calculation will be based upon
the obtained effect size (SMD) for the primary outcome,
significance (alpha error) of 0.05 and power of 80% and
adjusted according to the levels of attrition observed. If
an effect size of .4 is obtained in the pilot, then the out-
comes of approximately 100 participants per group will
be required. If estimated attrition of 40% is correct, then
166 participants per group will need to be recruited to
the cohort.
Participants are recruited from registered charities,
schools, word of mouth and support groups. The major-
ity of participants are recruited from the city of Sheffield;
however, participants are also recruited nationally and
the feasibility of on-line treatments assessed.
Inclusion/exclusion criteria
Inclusion criteria for the STAR cohort are children aged
5–18 (inclusive) with a carer-reported diagnosis of
ADHD (date, venue and diagnosing physician) and a
carer-reported Conners Global Index (CGI) Tscore of at
least 55 (denoting mild atypicality (Table 1). Inclusion
criteria for the trial are a carer-reported CGI score of at
least 65 (indicating a significant problem) (Table 1).
Exclusion criteria to both cohort and trial are children
below the age of 5 or adults over 18; children with ter-
minal, severe, life-limiting conditions; and families where
English is not written or spoken (as the project does not
have funds to provide a translation service). Exclusion
criteria to the trial are children currently receiving treat-
ment by a homoeopath or a nutritional therapist and
children with CGI Tscores below 65.
Outcome measurement
Carers of children with ADHD are asked to complete
carer questionnaires (CQs) sent to them by post or com-
pleted on-line (www.starsheffield.com).The CQ includes
the 10-item Conners’Global Index (CGI) [47]; the 18-
item Swanson, Nolan and Pelham Teacher and Parent
Rating Scale (SNAP) [51]; the 9-item Child Health Util-
ity health-related quality of life (CHU-9) measure [52];
and questions about resource use. The last page asks for
consent from carers and children to be contacted again,
for their school to be contacted, personal and school
contact details.
Where consent is given, schools are sent a teacher’s
questionnaire (TQ) and an information letter. They are
not informed about treatment allocation. The TQ in-
cludes the CGI, SNAP, and questions about school-
specific resource use, attendance, disruption and exclu-
sion. Schools which do not want to participate are not
contacted again.
Control group participants are not informed that they
have not been selected for a treatment but continue to
be sent questionnaires at the same time intervals as
treatment groups. CQs and TQs are sent out every
6 months to all cohort participants. Those refusing the
offer of treatment are still asked to complete outcome
measures as usual every 6 months and considered mem-
bers of the offer group.
The interventions
Homoeopaths are registered with one of the four main
bodies representing homoeopaths in the UK. Nutritional
therapists are registered with the British Association of
Applied Nutrition and Nutritional Therapy and are mem-
bers of the Complementary and Natural Healthcare Coun-
cil. All therapists are CRB checked, complete an on-line
NSPCC child protection course (https://www.nspcc.or-
g.uk/what-you-can-do/get-expert-training), attend a 1-day
training course on risk and receive guidelines in manage-
ment of ADHD and serious adverse events.
Both interventions are offered to participants for a
maximum of 1 year consisting of a maximum of eight
appointments. Consultations take place at Complemen-
tary Medicine Centres, participant’s homes or on-line.
First consultations last for up to 1½ h and follow-ups
last up to 40 min approximately every 6 weeks for up to
Table 1 Interpretive guideline for Conners’Tscores and
percentiles
Tscore Percentile Guideline
70+ 98+ Markedly atypical (significant problem)
66–70 95–98 Moderately atypical (significant problem)
61–65 86–94 Mildly atypical (possible problem)
56–60 74–85 Slightly atypical (borderline)
<30–55 < 2–73 Average (typical: should not raise concern)
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 4 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
1 year resulting in a total of up to seven contact hours.
Homoeopaths conduct fact-finding consultations on the
basis of which they prescribe homoeopathic medicines,
guided by underlying basic homoeopathic principles
[53]. Treating ‘like with like’is the core principle: that
substances causing certain symptoms in healthy persons
may cure those same symptoms in those who are ill. Nu-
tritional therapists take an initial health history and dis-
cuss and agree with participants an appropriate range of
options such as elimination diets, healthy food and
menu options, reducing aggravators such as food colour-
ings or sugar; improving fluids intake, lifestyle issues
such as sleep; specific dietary intervention for symptoms;
and supplementation.
At each consultation, therapists ask participants and/
or their carer (dependent on age) to complete Measure
Your Own Medical Outcome Profile (MYMOP) [54].
This patient generated outcome measure consists of 4
self-chosen items measured using a Likert-type scale of
0 (as good as it could be) to 6 (as bad as it could be):
two symptoms considered most bothersome, an activity
ADHD limits participation in, and well-being. Dimin-
ution of scores represents improvement. This persona-
lised measure allows participants to select their key
concerns and document how they change over time. It is
a validated outcome measure considered appropriate to
capture non-specific effects.
Therapists also ask about any adverse events experi-
enced by participants which are recorded according
to the Common Terminology Criteria for Adverse
Events guidelines [55]. Therapists are instructed to re-
port adverse events of level 3 or more to the PI
within 24 h, who refers them immediately to the
study Data Management and Ethics Committee for
appropriate action.
Information regarding adverse events for children with
ADHD in response to homoeopathic treatment suggests
that there may be occasional mild transient increases in
symptoms, which are however usually associated with
overall feelings of well-being. Information in response to
nutritional therapy suggests that there may be occasional
minor side effects from supplementation.
Outcomes
Patient-centred outcomes
The primary outcome measured is ADHD symptomatol-
ogy measured using CGI, consisting of a 10-item total
score and two sub-scores measuring restlessness/impul-
sivity (7 items) and emotional lability (3 items). The out-
come is reported by carers (unblinded) and teachers
(blinded), and each intervention is compared to usual
care. Secondary outcomes are carer proxy health-related
quality of life (CHU-9) and sleep. Resource use is col-
lected by asking about medication use; further ADHD
interventions being used; hospital, GP, social worker and
police attendances; levels of absenteeism, exclusion and
criminality; and teaching assistant and other help in
school.
Resource use data is collected to enable an economic
evaluation alongside a clinical trial. Evaluation will include
health-related quality of life assessment, with utility mea-
sures based on the CHU-9D, the cost of consultations,
medications, remedies, supplements and room hire, to en-
able QALY and ICER calculation. The time horizon is
1 year, during which time resource use will be collected
from therapists, who complete therapist forms at each
consultation documenting the time spent, the venue, med-
ications or supplements given.
Feasibility outcomes (Table 2)
Key feasibility criteria are the ability to recruit a cohort
and to recruit to the interventions within the stated time
frame of 2 years, by measuring recruitment rates and
time taken. Numbers recruited in 2 years will be extrap-
olated to estimate the time needed to recruit to a full
trial, and longer than 4 years will not be considered feas-
ible. The feasibility of recruiting a representative cohort
will document ADHD severity, number and type of co-
morbidities, medications taken, resource usage, levels of
exclusion, and criminality, and recruiting from nationally
funded ADHD facilities such as special schools, secure
units, NHS facilities and support services.
Whether suitable homoeopaths and nutritional thera-
pists can be recruited will be assessed, with recruitment of
two therapists for each intervention considered the mini-
mum required. The uptake of treatment will measure the
number of appointments kept and missed; the taking of
homoeopathic medicines; and the implementation of ad-
vice, diets, and the taking of supplements. At least 30%
will need to have accessed treatment, and at least 70% of
those to have attended at least three consultations, to con-
tinue to the full trial. It is anticipated that there may be
high dropout rate and chaotic uptake. The percentage of
participants refusing treatment will be considered to de-
termine acceptable levels of refusal since too many re-
fusers may lead to high chance of a type II error and
inadequate information to estimate critical parameters for
a full trial with reasonable precision.
Adverse events will be documented to measure the
safety of the interventions using the Common Termin-
ology Criteria for Adverse Events (CTCAE, 2010). Any
severe adverse events as a result of treatment will mean
the intervention will not continue to full trial.
The acceptability of the outcome measurements will
assess rates of completion by parents and teachers at
each time point in the study. Collection methods will be
adjusted if necessary. Their suitability will also be
assessed by ascertaining whether information can be
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 5 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
accurately and usefully collected about ADHD symptoms,
health-related quality of life, criminality, school exclusion,
attendance, extra help, professional resource use, medica-
tion and other intervention use and adjusted as necessary.
Whether CGI and SNAP are appropriate and sensitive
enough to measure therapist- and participant-perceived
change will be assessed and measures adjusted accord-
ingly. The measure will be adjusted if any systematically
missing items are identified. The suitability and appropri-
ateness of statistical analyses to interpret results will also
be assessed.
Statistical analysis
Statistical testing is exploratory since the study is not pow-
ered to detect statistical differences. It will be used to en-
sure that a difference can be seen from the interventions
to proceed to the full trial, to inform sample size calcula-
tion, and to pilot test the statistical analyses selected. Ana-
lysis will focus on confidence interval estimation rather
than hypothesis testing. IBM SPSS 21 statistical software
[56] will be used. All statistical exploratory tests will be
two-tailed with significance level (alpha) set to 5%, and
95% confidence intervals presented. Outcomes will be
measured by parents and teachers at baseline, 6 months
and 1 year. Both interventions tested will be compared
with treatment as usual with parent and teacher measure-
ments reported.
Missing data: post hoc tests will be performed to iden-
tify any differences between groups regarding whether
data is missing completely at random or not at random.
6-month missing data will be imputed using Last Obser-
vation Carried Forward or mean substitution (for base-
line data) according to tool developer recommendations
[47].
‘Intention to Treat’(ITT) analysis is used whereby par-
ticipants offered treatment remain within the treatment
group regardless of whether they take up the offer of
treatment. The method used for statistical analysis of the
outcome data will be regression analysis, with outcome
change score as the dependent variable and group (hom-
oeopathic treatment or nutritional therapy, analysed sep-
arately) as the independent variable. Analysis will
control for the effects of gender, ADHD severity (CGI
baseline score) and age.
The acceptability of the offer of treatment will be re-
ported by presenting numbers for all patients offered
Table 2 Feasibility criteria
Criteria Measurement Criteria for continuation to a full trial
Recruitment to cohort rates Number recruited in 2 years % recruited/sample size estimation. Minimum acceptable to proceed
to a full-scale trial will consider the number of years needed to recruit
the required sample size. Numbers recruited in 2 years will be
extrapolated to determine how long a full trial would need to be. The
required sample size will be divided by the percentage recruited in
2 years. Duration of the full trial of more than 4 years will not be
considered feasible.
Recruitment to treatment rates Percentage accepting offer At least 30%. The percentage of participants refusing treatment will
be considered to determine acceptable levels of refusal. Too many
treatment refusers may lead to a high chance of a type II error and
inadequate information to estimate critical parameters for a full trial
with reasonable precision.
Treatment effects (statistical significance) Standard mean difference (SMD) CGI Mean = < .3. Since neither intervention has been tested in this form
previously, estimation of the effect size cannot consider previous
estimates. Since we need to know that therapies show some
evidence of being helpful, a SMD of 0.3 in those implementing the
therapies will be considered sufficient to proceed to full trial.
Treatment effects (clinical significance) CGI Tscore 5 percentiles. A Tscore change of 5 percentiles is considered
clinically significant, since the child has moved from one level of
severity to another according to Conners (2009) [47].
Attrition: cohort Number of PQs returned at 6 months At least 30%
Attrition: consultations Number of consultations attended Adjustment of intervention provision
Acceptability of TQ and CQ Number of TQs and CQs completed at
baseline and 6 months; number of email/
telephone/ paper responses
Adjustment of measure, collection methods and trial parameters.
Questions reworded or removed dependent on discussion with
carers and teachers, and optimum means of delivering questionnaires
explored
Adverse events Clinicians records No severe adverse events as defined by the Common Terminology
Criteria for Adverse Events guidelines
Appropriate outcome measurement Number of missing items Adjustment of measure
Recruitment of therapists Number recruited fulfilling criteria At least two for each therapy
Statistical analysis ANCOVA Meets assumptions
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 6 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
treatment. Statistical tests will be carried out to identify
characteristics of those who did and did not accept and
receive treatment. Sub group analysis will explore the ef-
fect of treatment on those accessing that treatment,
those taking/not taking ADHD medication and those
with co-occurring autism.
The clinical effect of treatment will be explored by cal-
culating standardised mean differences [57] for those of-
fered and taking up the offer of each treatment to obtain
sample size estimates.
Discussion
The results of this pilot trial will provide preliminary in-
formation on the feasibility of the TwiCs design to assess
the effectiveness of interventions for children with
ADHD to improve (long-term) outcomes. It will also
provide preliminary information about the acceptability,
clinical and cost-effectiveness of two potential interven-
tions for ADHD. If feasibility criteria are met, then the
study will continue to a full trial of these two interven-
tions subject to reviewer’s comments and obtaining fur-
ther funding.
Future plans are to develop the STAR cohort as a facil-
ity where interventions can be rigorously evaluated in a
timely and efficient manner. This will entail expanding
and ensuring the representativeness of the cohort and
offering random samples of eligible participants a variety
of mainstream and non-mainstream interventions. Re-
cruitment of a representative cohort will focus on
recruiting at-need populations such as teens, particularly
those involved in criminality; hard to reach families;
those with co-occurring autism; and those with multiple
co-morbidities.
Advantages of the TwiCs design are the speedy re-
cruitment of sufficient numbers. No deception is experi-
enced by participants compared with placebo controlled
trials. Trial conditions are similar to those patients could
expect if consulting therapists in clinical practice and
healthcare assessors might expect were they to commis-
sion treatments. All types of interventions, for example,
complex, therapist-led and/or pharmaceutical treatments
can be compared. Since the TwiCs design is designed to
test multiple interventions, potential biases are equally
distributed across groups.
As a pragmatic trial, a disadvantage is that there is inev-
itable variation (noise), such as participants trying other
interventions, changing medication dosage, or life events.
All interventions are equally subject to such noise. A fur-
ther potential disadvantage is that the offer of treatment,
i.e., its acceptability, is measured, since ITT analysis is the
primary analysis. The effectiveness of undertaking the
treatment (per protocol analysis) is a secondary analysis.
Measuring acceptability is an important issue in ADHD
research where non-compliance is common. However,
assessors may prioritise and require measurement of spe-
cific effects within treatments, such as effect due to ther-
apist, supplement, dietary advice, homoeopathic medicine,
etc. The real-life effectiveness of the two selected interven-
tions has remained untested until now.
The TwiCs approach can be a cheap way to generate
evidence regarding comparative effectiveness and poten-
tial to improve long term outcomes and can provide
useful information to ADHD stakeholders including ser-
vice providers. The current approach is inefficient, ex-
pensive, slow, difficult to compare, and not focused on
improving outcomes for all those with ADHD in the
longer term. If feasible, the STAR approach to testing in-
terventions has the potential to contribute to the re-
search canon and to patient outcomes.
Abbreviations
ADHD: Attention deficit hyperactivity disorder; ASCs: Autism spectrum
conditions; CAM: Complementary and alternative medicine; CAMHS: Child
and Adult Mental Health Services; CGI: Conners Global Index; CHU-9: Child
Health Utility Index (9 items); cmRCT: Cohort multiple randomised controlled
trial; CQ: Carer questionnaire; CTCAE: Common Terminology Criteria for
Adverse Events; ScHARR: School of Health and Related Research;
SNAP: Swanson, Nolan and Pelham Questionnaire; STAR: Sheffield Treatments
for ADHD Research; TAU: Treatment as usual; TQ: Teacher questionnaire;
TwiCs: Trials within Cohorts
Acknowledgements
We would like to acknowledge the contribution of all the families and
therapists involved in this project.
Funding
The STAR project has received funding from the Homeopathic Research
Institute (HRI). They had no role in the design of the study nor will have any
role in the collection, analysis or interpretation of data, or writing of any
manuscripts.
Availability of data and materials
Data storage and retention are in line with the Data Protection Act of 1998
and UK Common Law (duty of confidentiality). Data will be retained for a
period of 5 years after the project ends. Digital data is stored on an encrypted
University of Sheffield google drive accessible by the PI or administrative
assistant. Other patient identifiable information is stored in a locked filing
cabinet. Data is only stored for participants and schools who have given their
informed consent to participate in the project.
The datasets generated and/or analysed during the current study are not
publicly available due to confidentiality concerns, but anonymised data can
be made available from the corresponding author on reasonable request.
The STAR project is monitored by an independent Data Monitoring and
Ethics Committee (DMEC) since it involves a higher risk vulnerable population
of children and oversees safety and adverse event reporting. The following
will be immediately referred to the DMEC for appropriate action: any serious
adverse event, any child considered to be at risk, and any child suspected of
being abused.
Authors’contributions
PF is the principle investigator in the project and wrote the manuscript. CR is
a member of the Management Committee and Steering group and helped
devise the project. TP sits on the steering committee and advised on health
economics. DD chairs the steering committee. All authors read and approved
the final manuscript.
Ethics approval and consent to participate
The study was approved under the University of Sheffield’s Ethics Review
Procedure by the School of Health and Related Research (ScHARR) Research
Ethics committee (REC) on 30/4/15, application number 003424.
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 7 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
The University of Sheffield is the Research Governance Sponsor (University
Research Management System (UMRS) number: 143647). The project was
classified as a ‘human-interventional study’, under the University’s quality
assurance procedure for such studies, requiring it to be risk assessed, and
was considered to be low risk. They confirmed that a trial measuring
treatment by a homoeopath and a nutritionist did not constitute a Clinical
Trial of a Medicinal Product (CTIMP); therefore, Medicines Regulatory Health
Authority (MRHA) approval was not required.
The study was registered with the ISRCTN Registry (International Standard
Randomised Controlled Trials Number 17723526) on 27/4/2015.
The study is overseen by an independent Steering Committee of academics,
clinicians and patient representatives, who meet every 6 months for the
duration of the trial.
Consent for publication
All data are anonymised. Schools and participants are informed that their
data will be anonymised and kept in a secure location.
Competing interests
The authors declare that they have no competing interests.
Publisher’sNote
Springer Nature remains neutral with regard to jurisdictional claims in
published maps and institutional affiliations.
Author details
1
School of Health and Related Research, University of Sheffield, Regent Court,
30 Regent Street, Sheffield S1 4DA, UK.
2
Institute of Mental Health, Jubilee
Campus, University of Nottingham, Wollaton Road, Nottingham NG8 1BB, UK.
Received: 11 May 2017 Accepted: 2 February 2018
References
1. Scott S, Knapp M, Henderson J, Maughan B. Financial cost of social
exclusion: follow up study of antisocial children into adulthood. Br Med J.
2001;323:191–4.
2. NICE (National Institute for Health and Clinical Excellence) Updated Clinical
Guideline Number 72. (2013). http://guidance.nice.org.uk/CG72/NICEGuidance/
pdf. Accessed 9 Feb 2018.
3. Edwards G, Barkley RA, Laneri M, Fletcher K, Metevia L. Parent-adolescent
conflict in teenagers with ADHD and ODD. J Abnorm Child Psychol. 2001;
29:557–72.
4. Young S, Wells J, Gudjonsson G. Predictors of offending among prisoners:
the role of attention deficit hyperactivity disorder (ADHD) and substance
use. J Psychopharmacol. 2011;25(11):1524–32.
5. Greenhill LL, Posner K, Vaughan BS, Kratochvil CJ. Attention deficit
hyperactivity disorder in preschool children. Child Adolesc Psychiatr Clin N
Am. 2008;17:347–66.
6. Spira EG, Fischel JE. The impact of preschool inattention, hyperactivity, and
impulsivity on social and academic development: a review. J Child Psychol
Psychiatry. 2005;46(7):755–73.
7. Gresham FM, MacMillan DL, Bocian KM, Ward SL, Forness SR. Comorbidity of
hyperactivity-impulsivity-inattention and conduct problems: risk factors in
social, affective, and academic domains. J Abnorm Child Psychol. 1998;26(5):
393–406.
8. Harpin VA. The effect of ADHD on the life of an individual, their family, and
community from preschool to adult life. Arch Dis Child. 2005;90(Suppl
I):i2–7.
9. Barkley RA. Attention deficit hyperactivity disorder: a handbook for diagnosis
and treatment. 3. New York: Guilford Press; 2006.
10. Ingersoll B, Goldstein S. Attention deficit disorder and learning disabilities:
realities, myths, and controversial treatments. New York: Double Play; 1993.
11. Jensen PS, Garcia JA, Glied S, Crowe M, Foster M, Schlander M, Hinshaw S,
Vitiello B, Arnold LE, Elliott G, Hechtman L, Newcorn JH, Pelham WE,
Swanson J, Wells K. Cost-effectiveness of ADHD treatments: findings from
the multimodal treatment study of children with ADHD. Am J Psychiatry.
2005;162:1628–36.
12. van der Oord S, Prins PJM, Oosterlaan J, et al. The adolescent outcome of
children with attention deficit hyperactivity disorder treated with
methylphenidate or methylphenidate combined with multimodal behaviour
therapy: results of a naturalistic follow-up study. Clin Psychol Psychother.
2012;19(3):270–8.
13. Satterfield JH, Faller KJ, Crinella FM et al. A 30-year prospective follow-up
study of hyperactive boys with conduct problems: adult criminality. J Am
Acad Child Adolesc Psychiatry 2007; 46: 5: 601–610.
14. Schachar RJ, Tannock R, Cunningham C, et al. Behavioral, situational and
temporal effects of treatment of ADHD with methylphenidate. J Am Acad
Child Adolesc Psychiatry. 1997;36:754–63.
15. Hechtman L. Long-term treatment of children and adolescents with
attention-deficit/hyperactivity disorder (ADHD). Curr Psychiatry Rep. 2006;
8(5):398–408.
16. Safren SA, Otto MW, Sprich S, et al. Cognitive-behavioral therapy for ADHD
in medication-treated adults with continued symptoms. Behav Res Ther.
2005;43:831–42.
17. Swanson JM, McBurnett K, Christian DL, et al. Stimulant medication and
treatment of children with ADHD. Adv Clin Child Psychol. 1995;17:265–322.
18. Goldman LS, Genel M, Bezman RJ, et al. Diagnosis and treatment of
attention-deficit/hyperactivity disorder in children and adolescents. JAMA.
1998;279(14):1100–7.
19. Storebø OJ, Ramstad E, Krogh HB, Nilausen TD, Skoog M, Holmskov M,
Rosendal S, Groth C, Magnusson FL, Moreira-Maia CR, Gillies D, Buch
Rasmussen K, Gauci D, Zwi M, Kirubakaran R, Forsbøl B, Simonsen E, Gluud
C. Methylphenidate for children and adolescents with attention deficit
hyperactivity disorder (ADHD). Cochrane Database of Systematic Reviews
2015, Issue 11. Art. No.: CD009885. DOI: https://doi.org/10.1002/14651858.
CD009885.pub2.
20. Ghanizadeh A. Atamoxetine for treating ADHD symptoms in autism: a
systematic review. J Atten Disord. 2012;17:635.
21. Stigler KA, Desmond LA, Posey DJ, Wiegland RA, McDougle CJ. A naturalistic
retrospective analysis of psychostimulants in pervasive developmental
disorders. J Child Adolesc Psychopharmacol. 2004;14:49–56.
22. Troost PW, Steenhhuis MP, Tuynman-Qua HG, Kalverdiik LJ, Buitelar JK,
Minderaa RB, Hoekstra PJ. Atamoxetine for ADHD symprtoms in children
with pervasive developmental disorders. A pilot study. J Child Adolesc
Psychopharmacol. 2006;16:611–9.
23. Treweek S, Zwarenstein M. Making trials matter: pragmatic and explanatory
trials and the problem of applicability. Trials. 2009;10:37.
24. Aman MG, Farmer CA, Hollway J, Arnold LE. Treatment of inattention,
hyperactivity and impulsiveness in ASDs. Child Adolesc Psychiatr Clin N Am.
2008;17:713–38.
25. Maughan B, Rowe R, Messer J, Goodman R, Meltzer H. Conduct disorder
and oppositional defiant disorder in a national sample: developmental
epidemiology. J Child Psychol Psychiatry. 2004;45:609–21.
26. Peasgood T, Bhardwaj A, Biggs K, Brazier JE, Coghill D, Cooper CL, Daley D,
De Silva C, Harpin V, Hodgkins P, Nadkarni A, Setyawan J, Sonuga-Barke EJS.
The impact of ADHD on the health and well-being of ADHD children and
their siblings. Eur Child Adolesc Psychiatry. 2016;25(11):1217–31.
27. Gillberg C, Gillberg IC, Rasmussen P, et al. Co-existing disorders in
ADHD—implications for diagnosis and intervention. Eur Child Adolesc
Psychiatry. 2004;13(Suppl 1):I80–92.
28. Koerting J, Smith E, Knowles MM, et al. Barriers to, and facilitators of,
parenting programmes for childhood behaviour problems: a qualitative
synthesis of studies of parents’and professionals’perceptions. Eur Child
Adolesc Psychiatry. 2013;22(11):653–70.
29. Relton C, Torgerson D, O'Cathain A, Nicholl J. Rethinking pragmatic RCTs:
introducing the ‘cohort multiple RCT’design. BMJ. 2010;340:c1066.
30. Hall SE, Riccio CA. Complementary and alternative treatment use for autism
spectrum disorders. Complement Ther Clin Pract. 2012;18(3):159–63.
31. Bussing R, Zima BT, Gary FA, Garvan CW. Use of complementary and
alternative medicine for symptoms of attention-deficit hyperactivity
disorder. Psychiatr Serv. 2002;53(9):1096–102.
32. Concannon P, Tang Y. Management of attention deficit hyperactivity
disorder: a parental perspective. J Paediatr Child Healt h. 2005;41(12):
625–30.
33. Kemper KJ, Vohra S, Walls R. The use of complementary and alternative
medicine in pediatrics. Pediatrics. 2008;122(6):1374–86.
34. Davis R, Mohr C. The assessment and treatment of behavioural problems.
Aust Fam Physician. 2004;33(8):609–13.
35. Sanders H, Davis MF, Duncan B, et al. Use of complementary and alternative
medical therapies among children with special health care needs in
southern Arizona. Pediatrics. 2003;111:584–7.
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 8 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
36. Huang A, Seshadri K, Matthews T, Ostfeld BM. Parental perspectives on use,
benefits, and physician knowledge of complementary and alternative
medicine in children with autistic disorder and attention-deficit/
hyperactivity disorder. J Altern Complement Med. 2013;19(9):746–50.
37. Sinha D, Efron D. Complementary and alternative medicine use in children
with attention deficit hyperactivity disorder. J Paediatr Child Health. 2005;
41(1–2):23–6.
38. Strauss LC. The efficacy of a homeopathic preparation in the management
of Attention Deficit Hyperactivity Disorder. Biochemical Therapy. 2000;18(2):
197–201.
39. Razlog R, Pellow J, White SJ. A pilot study on the efficacy of Valeriana
officinalis mother tincture and Valeriana officinalis 3X in the treatment of
attention deficit. Health SA Gesondheid. 2012; http://www.hsag.co.za/index.
php/HSAG/article/view/603/779%3e. Accessed 9 Feb 2018.
40. Lamont J. Homeopathic treatment of attention deficit disorder. Br
Homeopath J. 1997;86:p196–200.
41. Frei H, Everts R, vonAmmon K, Kaufmann F, Walther D, Hsu Schmitz S,
Collenberg M, Fuhrer K, Hassink R, Steinlin M, Thurneysen A. Homeopathic
treatment of children with attention-deficit hyperactivity disorder: a
randomised, double blind, placebo controlled crossover trial. Eur J Paediatr.
2005;164:p758–67.
42. Jacobs J, Williams A-L, Girard C, Yanchou Njike V, Katz D. Homeopathy for
attention-deficit/hyperactivity disorder: a pilot randomised-controlled trial.
J Altern Complement Med. 2005;5:799–806.
43. Oberai P, Gopinadhan S, Varanasi GR, Mishra A, Singh V, Nayak C.
Homoeopathic management of attention deficit hyperactivity disorder: a
randomised placebo-controlled pilot trial. Indian J Res Homoeopathy.
2013;7:4.
44. Barvalia P, Piyush M, Oza AH, Daftary VS, Patil VS, Agarwal ARM.
Effectiveness of homoeopathic therapeutics in the management of
childhood autism disorder. Indian J Res Homoeopathy. 2014;8(3):147–59.
45. Stevenson J, Buitelaar J, Cortese S, et al. The role of diet in the treatment of
attention-deficit/hyperactivity disorder—an appraisal of the evidence on
efficacy and recommendations on the design of future studies. J Child
Psychol Psychiatry. 2014;55(5):416–27.
46. Cooper RE, Tye C, Kuntsi J, et al. The effect of omega-3 polyunsaturated
fatty acid supplementation on emotional dysregulation, oppositional
behaviour and conduct problems in ADHD: a systematic review and meta-
analysis. J Affect Disord. 2016;190:474–82.
47. Conners, CK. (2009). Manual, Conners 3rd Edition. Multi-Health Systems Inc.
New York, U.S.A.
48. Sim J, Lewis M. The size of a pilot study for a clinical trial should be
calculated in relation to considerations of precision and efficiency. J Clin
Epidemiol. 2011;65(3):301–8.
49. Hayman A, Shephard N, Dimairo M, Teare MD, Walters SJ. How big should a
pilot trial be? A case for continuous outcomes in randomised controlled
trials. Annual Conference of the Royal Statistical Society. Telford, UK. 2012.
50. Fibert P, Relton C, Heirs M, Bowden D. A comparative consecutive case
series of 20 children with a diagnosis of ADHD receiving homeopathic
treatment, compared with 10 children receiving usual care. Homeopathy.
2016;105(2):194–201.
51. Bussing R, Fernandez M, Harwood M, Hou W, Garvan CW, Eyberg SM. Parent
and teacher SNAP-IVratings of attention deficit hyperactivity disorder
symptoms psychometric properties and normative ratings from a school
district sample. Assessment. 2008;15(3):317–28.
52. Stevens K. Valuation of the Child Health Utility 9D Index.
PharmacoEconomics. 2012;30(8):729–47.
53. Becker-Witt C, Lüdtke R, Weishuhna TER, Willich SN. Diagnoses and
treatment in homeopathic medical practice. Forsch Komplementarmed
Klass Naturheilkd. 2004;11:98–103.
54. Paterson C. Measuring outcomes in primary care: a patient generated
measure, MYMOP, compared with the SF-36 health survey. Br Med J. 1996;
312:1016–20.
55. National Institutes of Health/National Cancer Institute (NCI). Common
Terminology Criteria for Adverse Events (CTCAE) Version 4.03. 2010.
Retreived from https://evs.nci.nih.gov/ftp1/CTCAE. Accessed 9 Feb 2018.
56. IBM Corp. Released 2013. IBM SPSS statistics for windows, version 22.0.
Armonk: IBM Corp.
57. Higgins J, Deeks J. Cochrane Handbook for Systematic Reviews of
Interventions Version 5.1.0. Retrieved from The Cochrane Collaboration:
2011. www.cochrane-handbook.org.
• We accept pre-submission inquiries
• Our selector tool helps you to find the most relevant journal
• We provide round the clock customer support
• Convenient online submission
• Thorough peer review
• Inclusion in PubMed and all major indexing services
• Maximum visibility for your research
Submit your manuscript at
www.biomedcentral.com/submit
Submit your next manuscript to BioMed Central
and we will help you at every step:
Fibert et al. Pilot and Feasibility Studies (2018) 4:61 Page 9 of 9
Content courtesy of Springer Nature, terms of use apply. Rights reserved.
1.
2.
3.
4.
5.
6.
Terms and Conditions
Springer Nature journal content, brought to you courtesy of Springer Nature Customer Service Center GmbH (“Springer Nature”).
Springer Nature supports a reasonable amount of sharing of research papers by authors, subscribers and authorised users (“Users”), for small-
scale personal, non-commercial use provided that all copyright, trade and service marks and other proprietary notices are maintained. By
accessing, sharing, receiving or otherwise using the Springer Nature journal content you agree to these terms of use (“Terms”). For these
purposes, Springer Nature considers academic use (by researchers and students) to be non-commercial.
These Terms are supplementary and will apply in addition to any applicable website terms and conditions, a relevant site licence or a personal
subscription. These Terms will prevail over any conflict or ambiguity with regards to the relevant terms, a site licence or a personal subscription
(to the extent of the conflict or ambiguity only). For Creative Commons-licensed articles, the terms of the Creative Commons license used will
apply.
We collect and use personal data to provide access to the Springer Nature journal content. We may also use these personal data internally within
ResearchGate and Springer Nature and as agreed share it, in an anonymised way, for purposes of tracking, analysis and reporting. We will not
otherwise disclose your personal data outside the ResearchGate or the Springer Nature group of companies unless we have your permission as
detailed in the Privacy Policy.
While Users may use the Springer Nature journal content for small scale, personal non-commercial use, it is important to note that Users may
not:
use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
use bots or other automated methods to access the content or redirect messages
override any security feature or exclusionary protocol; or
share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at
onlineservice@springernature.com
Available via license: CC BY
Content may be subject to copyright.