Karpathy believes this funnel is mainly driven by three factors. First, influence amplifies as ambition, problem scale, and task time horizon increase. If you only ask a question whose final answer is just one paragraph, it is almost impossible to truly squeeze the capabilities of these systems; you need to have a large number of truly important, very large-scale, and highly difficult problems in hand. This mainly determines the gap between ordinary consumers and professional users.
Second, system capabilities have obvious jagged characteristics. The capability peaks of LLMs are concentrated in domains that are digital, verifiable, and economically valuable. He says large model capabilities mainly come from reinforcement learning based on verifiable rewards, and the choice of training environments is itself driven by commercial value. This mainly determines the gap between different professional domains, such as why math and programming stand out in particular.
Third, access permissions are tiered. Free versions, paid versions, and internal systems are not at the same level of capability. Karpathy says this is the strangest part right now: the vast majority of ordinary people have not actually truly encountered these systems, and even if they have, what they see is often just a somewhat dumb chatbot; most professionals currently feel only relatively limited efficiency gains; while a small group of professionals has already begun to experience a kind of dizziness, as the capability curve before their eyes is suddenly becoming almost vertical.