Table 1 List of categories with associated definitions and examples
From: Uses of generative AI by non-clinician staff at an academic medical center
MedHELM Task Taxonomy | ||||
|---|---|---|---|---|
Description | Example | Category | Subcategory | Task *if there was a task that was not represented in MedHELM, a new task to be added to the framework was proposed. |
Generating code from a description or debugging existing code. | “Can you help me write a Python function that takes a list of numbers and returns the sum of all even numbers in the list?” | Administration & Workflow | Organizing Workflow Processes | *Coding |
Providing assistance with software installation, troubleshooting computer issues, and accessing systems or tools. | “I’m having trouble installing the latest version of Adobe Photoshop on my Windows 10 computer. Can you help me figure out what’s going wrong?” | Administration & Workflow | Organizing Workflow Processes | *Technical support and IT issues |
Assisting with writing, rewriting, or improving emails, documents, and other forms of written communication. | “Could you help me draft an email to my manager requesting time off next week?” | Administration & Workflow | Organizing Workflow Processes | *Email and document writing |
Handling inquiries related to communication with patients and families. | “Can you help me draft a MyChart message to inform a patient’s family about the upcoming surgery and what they should expect during the recovery process?” | Patient Communication & Education | Patient-Provider Messaging | — |
Assisting with medical or health information including answering questions about medical conditions, procedures, and pharmaceutical information. | “My patient has been diagnosed with high blood pressure, and there are two different recommended medications. List the side effect profile of each option so I can make an informed decision.” | Clinical Decision Support | Providing Clinical Knowledge Support | Answer medical knowledge questions |
Providing answers to general knowledge questions without referencing specific sources. | “What is the capital city of France?” | Administration & Workflow | Organizing Workflow Processes | Handle information requests |
Summarizing, interpreting, synthesizing or performing a specific task over a provided text. | “Can you summarize the main points of this article about climate change for me?” | Administration & Workflow | Organizing Workflow Processes | *Text Manipulation |
Translating non-clinical text from one language to another. | “Can you translate the following sentence into French: ‘The weather is beautiful today.’ ” | Administration & Workflow | Organizing Workflow Processes | Process referrals/documents |
Generating ideas and suggestions on a particular topic or goal or offering guidance on how to handle specific situations. | “[Generate] interviewee phone screening questions for Medical Assistant.” | Administration & Workflow | Care Coordination and Planning | *Brainstorming |
Creating images, infographics, and other visual content based on inquiries. | “Can you help me design a logo for my new bakery? I want it to have a vintage feel with pastel colors and maybe some floral elements.” | Patient Communication & Education | Enhancing Accessibility | Generate visual aids |
Anything that does not fall under the defined categories | “Create a 16 character password.” | Other | ||
