Free Arenaで投票

ニュース··読了時間 1分·データは自動更新

Meta releases TuringSpace benchmark exposing spatial gaps in MLLMs

The new TuringSpace suite of 125 interactive CAPTCHAs shows GPT‑6 Astra at 74.1% accuracy, far below human 94.1%, and highlights gains from fine‑tuning open models.

YouTubeで視聴 · ショートを見る

Meta published TuringSpace, a synthetic web environment containing 125 interactive spatial CAPTCHAs that require click‑and‑drag actions.

The benchmark tests five spatial abilities and measures the loop of reading a 3D scene, acting, and adjusting after feedback.

GPT‑6 Astra achieved the highest score among evaluated models with 74.1% success, while humans solved 94.1% of the tasks.

The best open‑weight model, Kimi K3, failed 68.0% of the CAPTCHAs, and Qwen3.5‑9B rose from 1.6% to 33.1% after fine‑tuning on 55 K generated trajectories.

Fine‑tuning also improved performance on seven out‑of‑distribution benchmarks, adding 9.9 points on real‑world indoor videos from VSI‑Bench.

あなたにとっての意味

The results reveal that current MLLMs still struggle with 3D spatial reasoning, especially when actions are required. For users, this means that AI assistants may misinterpret visual layouts in interactive settings. For developers of free or locally run models, the study shows that targeted fine‑tuning on spatial interaction data can substantially close the gap, offering a path to improve open models without relying on proprietary systems.

FreeLLMArena上

From our rankings on 21 Nov 2026, based on Arena's blind votes:

ソース

上記のソースから自動的に生成し、当社のコードでチェックしました:すべての数値と名前が含まれ、文がソースをコピーしてはいけません。間違いを見つけましたか?報告する。

無料ランキング

今日無料で使えるAIはどれですか?

すべての無料AIモデルをブラインドヒューマン投票で順位付けし、あなたのGPUで必要なメモリと速度を示します。

ランキングを開く →

このページを共有:XLinkedInRedditWhatsApp

どのページでも / または Ctrl+K で検索できます。