Fig. 1: HumanELY. | npj Health Systems

Fig. 1: HumanELY.

From: Human evaluation of large language models in healthcare: gaps, challenges, and the need for standardization

Fig. 1: HumanELY.

We have proposed five major factors for conducting human evaluation: Relevance, Coverage, Coherence, Comparison, and Harm. We have developed a set of survey-based questions to evaluate these five categories. Additionally, we are providing a WebApp that allows for evaluation by simply uploading a file with reference text and human-generated text. The graphs and numbers in the figures are for illustrative purposes only and do not represent real data.

Back to article page