An important new component of the new-generation Hexagon NPU is the Element Accelerator. Qualcomm explicitly states that it is designed for the Transformer workloads used by generative AI and agents, and will work with the existing vector compute units and scalar compute units to specifically accelerate key operations in large models—in other words, this generation of Hexagon is further tilting toward LLMs and agents at the architectural level. At the same time, large shared memory is expanded by up to 50%, which can keep context and KV-cache data inside the NPU, reducing the number of DDR accesses, lowering memory reads and latency, and freeing up memory bandwidth for other workloads.
For INT4 models, Qualcomm says prefill speed is improved by 50% to speed up prompt processing and context understanding. Beyond INT4, Qualcomm also retains precision options such as INT2, INT8, FP8 and FP16, allowing developers to balance performance, memory, model quality and power consumption. The goal of these designs is to ensure that even when on-device models need to handle longer context windows, more complex reasoning, more tool calls and concurrent tasks, the agent experience can still respond promptly.
On the ecosystem side, Qualcomm says it has worked with StepFun, Wulianghuo, Longsys and others to achieve complete on-device deployment of a 30-billion-parameter MoE model; the launch event also featured the overseas debut of the QwenBook tablet and the Doubao phone. It should be noted that 'complete on-device deployment of a 30-billion-parameter MoE' is a claim made by Qualcomm and its partners. The source did not provide specific operating metrics for this model on-device, so it can only be regarded as a manufacturer and partner claim, not a confirmed test result.