Fig. 1: Scaling laws.
From: Ubiquitous intelligence via wireless network-driven LLMs evolution
Scaling in terms of parameter size, training data, and compute time can be conceptualized as scaling the amount of compute resources. LLMs have progressed through three stages of scaling laws, culminating in their current advanced stage (Part A). We propose a new scaling paradigm, experience scaling (Part B), within the concept of ubiquitous intelligence, aiming to push scaling to a new dimension and further enhance LLMs' capabilities.
