Gary Marcus / Marcus on AI:
A skeptical look at the new AI scaling “laws”, including post-train duration and “inference time compute”, and why they may fail to predict AI model performance — Scaling laws ain’t what they used to be — “If anything we are seeing the emergence of a new scaling law …
A look at the rise of super clusters that use ~100K of Nvidia’s GPUs for training giant AI models and the new engineering challenges arising from such clusters (Asa Fitch/Wall Street Journal)
Asa Fitch / Wall Street Journal:
A look at the rise of super clusters that use ~100K of Nvidia’s GPUs for training giant AI models and the new engineering challenges arising from such clusters — Musk’s xAI and Meta are among firms building clusters of advanced chips — Tech titans have a new way to measure who is winning …
