Meta rilascia il benchmark TuringSpace che espone le lacune spaziali nei MLLM
La nuova suite TuringSpace di 125 CAPTCHA interattivi mostra GPT‑6 Astra con un'accuratezza del 74.1%, molto inferiore al 94.1% umano, e mette in evidenza i miglioramenti derivanti dal fine‑tuning dei modelli open.
Guarda su YouTube · Guarda il breve
Meta published TuringSpace, a synthetic web environment containing 125 interactive spatial CAPTCHAs that require click‑and‑drag actions.
The benchmark tests five spatial abilities and measures the loop of reading a 3D scene, acting, and adjusting after feedback.
GPT‑6 Astra achieved the highest score among evaluated models with 74.1% success, while humans solved 94.1% of the tasks.
The best open‑weight model, Kimi K3, failed 68.0% of the CAPTCHAs, and Qwen3.5‑9B rose from 1.6% to 33.1% after fine‑tuning on 55 K generated trajectories.
Fine‑tuning also improved performance on seven out‑of‑distribution benchmarks, adding 9.9 points on real‑world indoor videos from VSI‑Bench.
Cosa significa per te
The results reveal that current MLLMs still struggle with 3D spatial reasoning, especially when actions are required. For users, this means that AI assistants may misinterpret visual layouts in interactive settings. For developers of free or locally run models, the study shows that targeted fine‑tuning on spatial interaction data can substantially close the gap, offering a path to improve open models without relying on proprietary systems.
Su FreeLLMArena
From our rankings on 21 Nov 2026, based on Arena's blind votes:
- Kimi K3 (Max): #1 tra i modelli chat gratuiti
Fonti
- Meta paper: TuringSpace: Grounding Spatial Intelligence in Action with Interactive CAPTCHAs, Hugging Face Papers (official), 18 Nov 2026
Scritto automaticamente dalle fonti sopra, poi controllato dal nostro codice: ogni numero e nome deve comparire, e nessuna frase può copiare una fonte. Hai trovato un errore? Segnalalo.
Quale AI puoi usare gratis oggi?
Tutti i modelli AI gratuiti, classificati da voti umani anonimi, con la memoria e la velocità necessarie sulla tua GPU.