Evaluating large language models as patient education tools for inflammatory bowel disease: A comparative study

Table 2 Medical experts evaluation scores criteria

Evaluation dimension	Score	Scoring criteria
Accuracy	1	The answer contains serious errors or misleading information that may harm patients
	2	The answer contains some errors or inaccurate information, but it will not cause obvious harm to patients
	3	The information in the answer is mostly accurate, but there are a few ambiguous or uncertain statements
	4	The information in the answer is accurate, clearly stated, and without obvious errors
	5	The information in the answer is highly accurate, professionally and authoritatively stated, and fully consistent with current medical knowledge
Completeness	1	The answer is very brief, missing key information, and provides little to no help for the patient's actual question
	2	Although the answer mentions some relevant content, it lacks a significant amount of important information and provides limited help to the patient
	3	The answer covers the main relevant content but still omits some important information, making the guidance for the patient not comprehensive enough
	4	The answer covers most of the key content, and although it may omit a small amount of minor information, it is already very helpful to the patient
	5	The answer is very complete, covering all key information and providing a comprehensive answer to the patient's question
Correlation	1	The answer is almost completely unrelated to the patient's actual question, and the information lacks targeting
	2	Although some content in the answer is related to the question, most of the information deviates from the main topic and lacks targeting
	3	The main point of the answer is basically related to the patient's question, but there is a small amount of irrelevant or off-topic content
	4	The answer closely follows the patient's question, and almost all content is directly related, but there may be a few pieces of irrelevant information
	5	The answer is completely on-topic, and all content is highly relevant to the patient's question, making the information very targeted