CoRL 2026 High-Score Acceptance: Sharpa Open-Sources World Synesthesia Model for Robust Real-World In-Hand Manipulation

Sharpa Robotics has introduced the World Synesthesia Model (WSM), which unifies visual geometry, tactile contact, proprioception, and action history into a reusable world-model state, enabling policies to continuously infer the hidden physical state of the hand-object system. The work was accepted with a high score at CoRL 2026 and achieves disturbance-robust, object-ID-agnostic general in-hand rotation on a human-sized 22-DoF five-fingered dexterous hand, supporting zero-shot unseen objects and real-platform disturbance recovery.

+4