Inflammatory bowel disease: An evaluation of health information on the internet

Table 5 Summarizes the inter-rater agreement between evaluators calculated using Cohen kappa coefficient scores

DISCERN items	Mean score (95%CI of the difference)			Reviewer variability (κrange)
	Evaluator 1	Evaluator 2	Evaluator3
1. Are the aims clear?	1.7 (1.5-2.0)	1.7 (1.5-2.0)	1.8 (1.5-2.0)	0.885-0.953
2. Does it achieve its aims?	1.4 (0.9-1.8)	1.5 (1.0-1.9)	1.5 (1.0-1.9)	0.790-0.904
3. Is it relevant?	3.8 (3.6-4.0)	3.8 (3.6-4.0)	3.8 (3.6-4.0)	0.792-0.887
4. Is it clear what sources of information were used to compile the publication (other than the author or producer)?	2.5 (2.2-2.9)	2.5 (2.2-2.8)	2.5 (2.2-2.8)	0.879-0.880
5. Is it clear when the information used or reported in the publication was produced?	2.7 (2.4-3.1)	2.7 (2.3-3.0)	2.7 (2.3-3.0)	0.793-0.875
6. Is it balanced and unbiased?	3.7 (3.5-4.0)	3.8 (3.6-4.0)	3.7 (3.5-3.9)	0.796-0.890
7. Does it provide details of additional sources of support and information?	2.2 (1.9-2.5)	2.2 (1.9-2.5)	2.2 (1.9-2.5)	0.792-0.827
8. Does it refer to areas of uncertainty?	3.2 (3.0-3.4)	3.1 (3.0-3.3)	3.2 (3.0-3.3)	0.764-0.832
9. Does it describe how each treatment works?	3.1 (2.8-3.4)	3.1 (2.8-3.4)	3.1 (2.8-3.4)	0.859-0.874
10. Does it describe the benefits of each treatment?	2.4 (2.2-2.7)	2.4 (2.2-2.7)	2.5 (2.2-2.8)	0.782-0.841
11. Does it describe the risks of each treatment?	2.3 (2.0-2.6)	2.3 (2.0-2.6)	2.3 (2.0-2.7)	0.772-0.902
12. Does it describe what would happen if no treatment is used?	1.5 (1.3-1.7)	1.5 (1.3-1.7)	1.5 (1.3-1.8)	0.870-0.923
13. Does it describe how the treatment choices affect overall quality of life?	2.0 (1.8-2.2)	2.0 (1.8-2.2)	2.1 (1.9-2.3)	0.859-0.906
14. Is it clear that there may be more than one possible treatment choice?	3.6 (3.4-3.9)	3.6 (3.4-3.9)	3.6 (3.4-3.8)	0.773-0.849
15. Does it provide support for shared decision-making?	2.7 (2.4-2.9)	2.8 (2.6-3.0)	2.8 (2.5-3.0)	0.767-0.854
16. Based on the answers to all of the above questions, rate the overall quality of the publication as a source of information about treatment choices?	2.9 (2.7-3.2)	3.0 (2.7-3.2)	2.9 (2.6-3.2)	0.900-0.959