Back to feed
News Story
Simon Willison
1 sources

Qwen3.8 27B addition in words experiment

Colin Frasier shared a Bluesky experiment from two years ago where GPT-4o was tested on computing sums and returning answers in words. Inspired by this, the author reran the experiment on a DGX Spark using Qwen3.8-27B-Q4_K_M.gguf, finding that with reasoning enabled the model got 167 out of 169 one-shot attempts correct, while reasoning disabled produced a heatmap of 30 attempts per combination.

Primary report

Simon Willison

Primary source