Fig. 4: Overview of the survey design for comparing user preferences between LLM-generated and human expert-designed motivational messages.
From: Fine-tuning LLMs in behavioral psychology for scalable health coaching
Users answered demographic questions and were asked to choose the prompt that they preferred on evaluation of 10 total message pairs, including 5 generally motivational messages and 5 pairs tailored to each user’s specific stage of change. TTM Stage of change was assigned based on the question shown in the bottom right, and the red text maps each response option to a corresponding stage of change.
