Apr 11, 2026
Category

Ai Research

5 articles in this category

What Comes After Scaling Laws? Rethinking Foundation Model Architecture
AI Research

What Comes After Scaling Laws? Rethinking Foundation Model Architecture

For a few years, the field lived under a simple rule of thumb: if you make the model bigger, give it more data, and spend more compute, it gets better. The original scaling laws for language models turned this intuition into curves on a log–log plot. Loss fell in a smooth, almost comforting way as parameters, dataset size, and compute all went up together.

Emily CarterOct 29, 202512 min read