openJiuwen Collaborates with Ascend to Launch 'Compute Affinity' Technology, Cutting First-Token Latency in Half

The open-source agent platform openJiuwen, developed by Huawei teams, has partnered with Ascend to introduce 'Compute Affinity' technology. By using Agent Hint to synchronize task states with the inference engine, it enables proactive KV Cache management, reducing first-token latency by 50% and inference storage usage by 25%. This innovation bridges the semantic gap between agent frameworks and inference engines, promising improved efficiency for multi-agent tasks.