Publications

Scaling Laws in the Tiny Regime

Scaling behaviour for small models trained on large datasets.

Information Fusion, 2026.

Note

Examines whether the standard scaling relationships still hold when the model is small and the dataset is not, and where they break down.

Reference

Scaling Laws in the Tiny Regime
Information Fusion, 2026.
https://scholar.google.com/scholar?q=%22Scaling%20Laws%20in%20the%20Tiny%20Regime%22

The publisher record holds the author list.

Details

  • TypeJournal article
  • AreasFoundation models for biology and medicine

Find this title