Focus on Alternative and Complementary Therapies
www.pharmpress.com/fact
Focus Alternat Complement Ther©2005 Pharmaceutical Press
Focus Altern Complement Ther 2003; 8: 497–8
Randomised controlled trials are considered the best method to test treatment efficacy. Recently, the Standards for Reporting Interventions in Controlled Trials of Acupuncture (STRICTA) were published, which suggest information necessary in reports of acupuncture trials. These standards ensure reporting quality. There is currently no accepted methodological quality scale for controlled trials of acupuncture. The purpose of the present study was the development of a methodological quality scale that combines generic methodological quality items with the STRICTA items.
One individual isolated the most widely used methodological quality scale: the Jadad scale. Three individuals converted the STRICTA criteria the their operational definitions into methodological quality criteria and combined them with the Jadad criteria into a single scale. Five individuals independently assessed 14 controlled trials of acupuncture. Kappa scores were calculated for each item (P < 0.05). Ease of use was rated on an 11-point Likert scale.
The scale consisted of seven items. Items 1–3 reflect methodological quality and items 4–7 reflect treatment adequacy. Operational definitions were modified to clarify item operational definitions. The average score for ease of use of the preliminary scale was 7 (range: 4–8). Kappa scores for the individual criteria ranged from –0.1480 to 0.6208.
Inter-rater reliability was poor for five items and good for two others. Assessors require training in the use of methodological scales. This scale will prove useful in assessing randomised controlled trials of acupuncture for readers, editors and reviewers.