Sign In

Latest Articles

324 articles · Fresh posts aggregated from independent blogs across the directory.

LLil'LogLil'Log·Jun 24, 2026

Scaling Laws, Carefully

Scaling laws are one of the most critical empirical findings in deep learning. The observation is simple in form: the training loss $L$ decreases predictably as we scale up model size $N$, dataset size $D$, and compute $C$, following a power-law curve, which…

lilianweng.github.ioRead article

Page 10 of 18 · 324 articles