Fig. 1: The trend and impact of the scale of artificial intelligence (AI) models.

a The trend of the total number of parameters of the state-of-the-art AI models over time, each data point refers to such a model (Epoch (2024) – with major processing by Our World in Data). b–d Different examples of emergent capabilities in large-scale language models. As the scale of these models trained on generic language datasets increases, they become able to perform tasks beyond those for which they are explicitly trained. b Accuracy on arithmetic operations task¹⁷. c Translation accuracy between International Phonetic Alphabet and English¹⁷ d Accuracy on multitask language understanding, a benchmark containing 57 tasks, ranging from computer science to law¹⁸