The discovery of scaling laws has typically preceded a boomtime for the domain the scaling laws are discovered in; scaling laws for language modeling preceded things like GPT3, Claude, ChatGPT, etc; scaling laws for image and video modeling preceded Dall-E, Imagen, etc.
Fwd: Import AI 317: DeepMind speeds up language model sampling; voice cloning tech gets abused; more scaling laws for RL
from