Anima Anandkumar: We have foundation models for language, not for physics
Caltech professor Anima Anandkumar developed the open-source AI weather model FourCastNet, which rivals traditional physics-based simulations for short-term forecasts and runs on consumer GPUs. She highlights that modeling physical systems faces challenges like data scarcity and enormous context lengths, requiring structural inductive biases rather than mere scaling.