The first layer is architectural judgment. Shazeer, Vinyals, and Le's representative works are structural innovations like Transformer, sparse MoE, MQA, and seq2seq. Such work cannot be measured by KPIs and relies on the intuition of the same group of people over more than a decade, making it hard to hand over. The second layer is the vertical chain. Google's complete self-developed stack from TPU to compiler to Pathways to models is an advantage over OpenAI and Anthropic. Hassabis called it 'the only company with a complete tech stack.' Dean and Ghemawat are among the few who can judge across layers.
The third layer is organizational gravity. Vinyals joined Google because of Dean's email, and now follows Dean out, which may prompt other senior researchers to reconsider their future. Discovery Loop's website describes the four founders as having 'full-stack depth across chips, hardware infrastructure, software infrastructure, ML models, and products,' which highly overlaps with Google's self-positioning.