Table 2 List of LLMs studied
From: Benchmarking cell type and gene set annotation by large language models with AnnDictionary
Company | Provider | Endpoint | Knowledge Cutoff Date |
|---|---|---|---|
Meta | Bedrock | meta.llama3-1-8b-instruct-v1:0 | December 202329 |
Meta | Bedrock | meta.llama3-1-70b-instruct-v1:0 | December 202329 |
Meta | Bedrock | meta.llama3-1-405b-instruct-v1:0 | December 202329 |
Amazon | Bedrock | amazon.titan-text-express-v1 | Not defined30 |
Amazon | Bedrock | amazon.titan-text-lite-v1 | Not defined30 |
Cohere | Bedrock | cohere.command-r-plus-v1:0 | February 202331 * |
Mistral | Bedrock | mistral.mistral-large-2407-v1:0 | Released July 24th, 202432 |
gemini-1.5-pro-002 | September 202433 | ||
gemini-1.5-flash-002 | September 202433 | ||
OpenAI | OpenAI | gpt-4-0613 | November 30th, 202334 |
OpenAI | OpenAI | gpt-4o-2024-08-06 | September 30th, 202334 |
OpenAI | OpenAI | gpt-4o-mini-2024-07-18 | September 30th, 202334 |
Anthropic | Anthropic | claude-3-5-sonnet-20240620 | April 202435 |
Anthropic | Anthropic | claude-3-opus-20240229 | August 202335 |
Anthropic | Anthropic | claude-3-haiku-20240307 | August 202335 |
