i'm a bit surprised that many people don't believe this plot. @magicailabs literally reported ~same pretraining plot 2 months ago! 505x improvements in their case. and, yes, the Y-axis labels are 10x. https://magic.dev/blog/pretraining