Fig. 1: Key steps and considerations when organizing a red teaming workshop for large language models (LLMs) in medicine.
From: Red teaming ChatGPT in medicine to yield real-world insights on model behavior
1Hyperparameters are settings that can be changed by the user (usually a machine learning engineer) to vary model output. These can include temperature, which varies the randomness of outputs, and max output tokens (length of response). 2An application programming interface (API) is a software interface that allows information to pass between two software applications. In the context of large language models (LLMs) and prompting, submitting prompts (user queries) through an API refers to writing code to submit prompts rather than submitting through a user interface. API submission can be preferred when batch submission of prompts is desired, or when it is desired to change settings (hyperparameters) that influence LLM responses. 3A field of study that focuses on varying the format of inputs to a language model in order to produce optimal outputs.
