FreeLLMRL fine‑tuning boosts Qwen3.8‑27B repeatable success on ThinkingBox‑Bench
After 50 GRPO steps, Qwen3.8‑27B's observed‑20/20 rose from 7.5% to 21.1% on the 507‑task benchmark.
Microsoft and Hugging Face released ThinkingBox‑Training, a GitHub tool that turns executable database checks into rewards for post‑training agents.
They selected 507 tasks from ThinkingBox‑Bench, each providing a real backend and tool set, then built an offline policy‑relative difficulty pool for training.
Fine‑tuning Qwen3.8‑27B with GRPO for 50 steps raised pass@1 from 51.70% to 60.78% and increased tasks solved on every attempt (observed‑20/20) from 38 to 107.
The improvement came with a slight drop in pass@20 (tasks solved at least once) from 453 to 446, indicating higher repeatability but marginally less breadth.
Domain‑level results show gains across all five categories, with the largest observed‑20/20 increase in retail (+24.5 points) and the biggest pass@20 decline in auto insurance (‑7 points).
あなたにとっての意味
The higher repeatable success makes agents more reliable for production database operations, reducing risky “done” false positives. For users preferring free or locally run models, the results highlight that larger models like Qwen3.8‑27B can become more dependable through targeted RL fine‑tuning, though broader coverage may require additional strategies.
ソース
- Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox, Hugging Face (official), 22 Oct 2026
上記のソースから自動的に生成し、当社のコードでチェックしました：すべての数値と名前が含まれ、文がソースをコピーしてはいけません。間違いを見つけましたか？報告する。
今日無料で使えるAIはどれですか？
すべての無料AIモデルをブラインドヒューマン投票で順位付けし、あなたのGPUで必要なメモリと速度を示します。