MethodPDF Available

Tool for Scoring the Quality of Non-Empirical Data Sources- E.G: Technical Reports

Authors:

Abstract

Find the most up to date version here: https://sites.google.com/view/sr-methods/home This tool is concerned with scoring the quality of non-empirical data sources (e.g. technical documents, non-experimental documents and/or documents not published in academic journals).
 
Aerospace Medicine Systematic Review
Group
Tool for Scoring Quality
of Non-Empirical Data
Sources- e.g. Technical
Reports



 !"#
$%& ''()
*+,%$-./"$+012
 

3,14-..5"6
6
%-..7"#
 6
%-..7"$
66
6  8'6//9"#
6
 33#1:0:6)60
3-." $-../";
-.""66
6'%-..7"8'6//9"
 
%8<-..7"=8'6//9"=33-."=
$-../"=;13-."
6  
What the tool should be used for:
 

>  
?">- 
$   
-
#
@

Part 1: Criteria*'AB)CAB:" Score Part 2: Criteria'$))
"
Score
@+

6
?6
9 @D
E


"
@-% 4
466
66
?6
F
@-D

E




"
@5G66
666
4
7
@5D

6E

"
@H@64


H
@7 6

6
5
@H#
66 
E



"
@F+I= -
@9)=
  "
  
!"#$% Total score:
Notes on use and interpretation:
>' 

>-' 

$ 6 '

6
Detailed notes on use and interpretation:
$
 6
%-..7"
$
DJ,B -.7"
&'  ()    *)        )+   
%  ,           
        -(     %  .
     /        
 0                
         '%  ' 
12.
  3  4   )0 )0  )
%5
#                          
 
  
$
2K-.9"
&,6!70"80+9$
    (    (      -    
0        %           :+";%
,67<=/<2/0+9<'/<>/0"8
</<?/:+";%6-((
@#0 (( 0(0
00ABC 'D,%*(
9"@@!$"7"E9!
  (    '  :++;$%  1    !.  F,9##  0  ?0
G$                  
%5
#
6
#--

 '

3
3-."
Glossary of Terms:
Meta-analysis: $=
6
?2/9F,2/L"$
?

6KK K3-.."
Randomized controlled trials: $
M  !
 6 
 !6;
6DK 
 ! 
 
6 !+,/LF"
Large-sample: $ 6
K??3?#6"
!4
4
@,;'-..L"
Small-sample: "4
4
or -"$
'?K@,;'-..L"
Meta-synthesis: $ ?
6;'-..-=@,;'-..L"
Non-randomized controlled prospective study: $"
 ! 
-" 
  6 
''6
 $3A
1-..."
Non-randomized controlled retrospective study: $"

-"  
  6 
''6 
$3A1-..."
Integrative Review: $?
 446
1'-..."66
6 
'613 6
66%,
8<-..7=-..7"#66
4 
+',>A6-..7"
Systematic Review:  !6
> //L"
'?
6
4?66
4 
6$-../=
+',>A6-..7=%,8<-..7"
Cohort Study: $ 6  
6"6"
 66
$
+  1
-..-"
Case-controlled study: $ 66
6"  6
"6
"1
-..-"
Non-controlled clinical series: $6 6
" 
"N///"I
Descriptive studies: $ 6'
 66"
6 N
///"
Case study: $6 6
 "
N///"
Consensus of Experts: A
6?
 0
//L"
Literature Review: $ 
 $-../"
66'
'$66
'
$-../=%,8<-..7"
Manufacturer’s Recommendation: 0
 I6
Anecdotes: $6 
#+% D-..5"
References
$1;$J+;1;)J)
-../"O$$33B(
66H  0E0H.7H./
$3A1-..-"3$6 
6P6
;'3-..-"+$6
H' 20"@0-H--
;@;11*,383-."66
6 .(
"E"5.7
3D-.." 
I$H
=0I0J220+#0H.H-.
30,14+*-..5"1+
QF2J1"8H"5--555
3:+,33)-."33#1:066:)0"
3 63#616:60
33#1:0"
D+J$,B B-.7"> 
6!
2K3*>:; D86O'68,2D$-.9"
K?M
+
+7..,)+"H.
22/9F"@*
F7!#$05L
22/L"');6J3$0
8'6+//9"#6R
6H
("77"/99/LH
+3),0/LF" KD0 0
AO6@BC'
+';+,>A6:-..7"*()B.2
J1KIB.@)%,
%'
+% D-..5"$6 
@D>,;'3-..L$%2K
(%@@$)%,
%'
18*-..-"*K%BC'AO6
@
03;+D1'0;03;>4*
28J6@,0:$-..L"O4
6662F0H"
/7-.F
1-..7"%#6)162
:1FD(F(095"057F5F9
%1,8<8-..7"66
H(7"7"7HF775
N+///"*(B'KI%$6 
6
 *)$% 
%-..7"$-../";-."
8'6//9"3-."
 K--.H
!
'K  
 K-/

6 ?> 
-./
',F(I
'
F>2L(020L?
%
 6
... There is no universally accepted model or method in use for assessing the validity and quality of 176 integrative review data, such as grey literature and technical documents (Russell, 2005). Accordingly 177 a tool developed by the Aerospace Medicine Systematic Review Group at Northumbria University 178 was used to assess the overall quality and rank of evidence compared to other sources of evidence, 179 and to assess the reported content in comparison to an "ideal design" (Laws & Winnard, 2019). The 180 design of the developed tool was based upon a pre-existing evidence levelling system (Cuenca & 181 Crawford, 2011), as well as guidance provided on the quality scoring of integrative literature 182 (Whittemore & Knafl, 2005). ...
Article
Background The constraints of the Orion Multi-Purpose Crew Vehicle present challenges to the use of current exercise countermeasures necessary to prevent severe deconditioning of physiological systems during microgravity exposure beyond Low Earth Orbit. The purpose of this qualitative systematic review was to determine the technical constraints of the Orion Multi-Purpose Crew Vehicle which may hinder astronauts’ capabilities to effectively exercise during long distance spaceflight. Methods Databases were searched from the start of their records to December 2018. Included documents were quality assessed with the AMSRG quality scoring tool and Thematic Analysis was used to analyse the included documents to assess technical constraints of the Orion Multi-Purpose Crew Vehicle. Results 19 studies were included in the final review. All identified constraints, other than data transmission limitations, were found to ultimately be a result of the volume and upload mass constraints of the Orion Multi-Purpose Crew Vehicle. There was a lack of detailed studies and lack of consistency in specifying spacecraft in the literature that limit the conclusions of this review. Conclusion Space agencies are advised to ensure that information on relevant spacecraft constraints is readily available to researchers. This information should be made accessible in an official published document as opposed to disparate and grey literature, and include quantitative information rather than qualitative summaries.
ResearchGate has not been able to resolve any references for this publication.