|
Six primary quality indicator |
PI score |
Six secondary quality indicator |
SI score |
|
Study |
PC |
IV |
DY |
BC |
VA |
EC |
Max.6 |
IOA |
Kp |
F |
BR |
GM |
SY |
Max.6 |
Quality Rating |
Becker-Cottrill (2003) |
1 |
1 |
1 |
0 |
0 |
0 |
3 |
0 |
0 |
0 |
0 |
1 |
1 |
2 |
Weak |
Binnendy (2009) |
1 |
1 |
1 |
1 |
1 |
0 |
5 |
1 |
0 |
0 |
0 |
1 |
1 |
3 |
Adequate |
Blair (2011) |
1 |
1 |
1 |
1 |
1 |
1 |
6 |
1 |
0 |
1 |
0 |
1 |
1 |
4 |
Strong |
Cheremsbynski (2013) |
1 |
1 |
1 |
1 |
1 |
1 |
6 |
1 |
0 |
1 |
0 |
1 |
1 |
4 |
Strong |
Dunlap (1999) |
1 |
1 |
1 |
1 |
1 |
0 |
5 |
1 |
0 |
0 |
0 |
0 |
|
2 |
Adequate |
Lee (2007) |
0 |
1 |
1 |
1 |
1 |
1 |
5 |
0 |
0 |
0 |
0 |
1 |
1 |
2 |
Adequate |
Lucyshyn (2007) |
1 |
1 |
1 |
1 |
1 |
0 |
5 |
1 |
0 |
0 |
0 |
1 |
1 |
3 |
Adequate |
Marshall (2002) |
1 |
1 |
1 |
0 |
0 |
0 |
3 |
0 |
0 |
0 |
0 |
1 |
1 |
2 |
Weak |
McClean (2012} |
1 |
1 |
1 |
0 |
1 |
1 |
5 |
0 |
0 |
1 |
0 |
1 |
1 |
3 |
Adequate |
Notes: Six primary quality indicators: PC participant characteristics, IV independent variable, DV dependent variable, BC baseline condition, VA visual analysis, EC experimental control, PI score: total score for the primary quality indicators. |
Six secondary quality indicators: IOA inter-observer agreement, Kp kappa, F fidelity, BR blind raters, GM generalization and/or maintenance, SV social validity, SJ score: total score for the secondary quality indicators. |
Quality rating criteria: Strong: scores on all six primary quality indicators and at least three secondary quality indicators; Adequate: scores on at least four primary quality indicators and at least two secondary quality indicators; Weak: scores on less than four primary quality indicators and less than two secondary quality indicators. |