Elorian and Scale AI Release Humanity's Sixth Sense Visual Reasoning Benchmark
Elorian and Scale AI have released Humanity's Sixth Sense, a benchmark designed to measure how AI models reason about information implied but not explicitly shown in visual scenes. The benchmark includes 522 questions across 288 images and 234 short video clips, where humans achieve an aggregate pass@1 of 93.1 while the best AI system, GPT 6 Astra, scores only 53.6. Chinese open-weight models perform even worse, with GLM-5.3-flash and Kimi K3 scoring 26.8 and 25.5 respectively, highlighting significant gaps in intuitive visual reasoning.