granite-switch-4.1-8b：新機能、必要なハードウェア、無料での動かし方

Granite Switch 4.1 packs chat, decision-making and speech-to-text into a single 8 billion-parameter endpoint. It lets you switch functions with just a control token.

Granite Switch 4.1 8B is a modular large language model built by IBM-Granite. The core has eight billion parameters and can handle a context window of one hundred twenty-eight thousand tokens. It is released under the Apache 2.0 license, so you can download the weights from Hugging Face and run them yourself.

What makes this model stand out is its composition. Two LoRA adapters, decision and guardian-core, are activated by special control tokens, so you can ask the same endpoint for pure chat, probability-based decisions, or safety checks. It also bundles a 470-million-parameter English speech-to-text encoder, letting you transcribe audio without a separate server. All three capabilities share the same model checkpoint.

The model card reports a Decision Index v0.3 score of 42.9 overall. By domain, it scores 48.9 on language tasks, 49.8 on retrieval, 59.8 on tool use, 29.1 on knowledge, and 18.0 on arts. The hosted and local serving paths differ by only about 0.6 points, confirming consistent performance.

Granite Switch shines for quick English speech transcription and for returning calibrated probability distributions over option labels in a single forward pass. The guardian-core adapter adds safety detection for harmful content. However, the speech encoder works only in English, produces lowercase unpunctuated text, and is not jointly trained with the language model. The decision adapter can handle up to 128 option tokens per request; larger sets need manual chunking.

If you run models on a consumer GPU, say an RTX 4060 or RTX 3060, you can fit Granite Switch 8B in memory and get around forty tokens per second on a 3060. It’s ideal for hobbyists who want a single model that can chat, make decisions, and transcribe speech without managing multiple services. Developers building prototypes that need safety checks or decision probabilities will also find the built-in adapters convenient.

自宅で動かすには何が必要でしょうか。4ビットでは約8ギガバイトのメモリを使います。完全に収まる最小の家庭用マシンはRTX 4060です。RTX 3060 12 GBとRAM 32ギガバイトでは、毎秒約40トークンで書きます。RTX 4090とRAM 64ギガバイトでは、毎秒約104トークンで書きます。

まだ無料 API はありません。ウェイトはオープンで、Apache 2.0 ライセンスの下で Hugging Face からダウンロード可能です。Arena ではまだランキングされていません：投票が届き次第スコアを追加します。

Compare granite switch 4.1 8b with every free model, and check what your own GPU can run, on FreeLLMArena.