WeVisOne-VL-4B: Neuheiten, nötige Hardware, so nutzt du es kostenlos

WeVisOne-VL-4B is a single model that can detect objects, count them, read text, and even produce full-resolution alpha mattes. It does all that with 4.8 billion parameters and a tiny 9.6 M-parameter pixel decoder.

According to the model card, WeVisOne-VL-4B is a vision-language model built on Qwen3-VL. It can understand images at the level of objects, detecting, counting, pointing, and reading text, and also at the pixel level, providing segmentation and matting. The model uses a 256 K token context, which lets it handle long prompts and detailed visual information. All of this runs on a single 4.8 billion-parameter network, so you only need one set of weights to cover many visual tasks.

The model introduces dedicated coordinate tokens that encode normalized bounding boxes and points directly in the token stream. After each predicted box, it emits a special instance token (ID 152678) to separate dense predictions. A lightweight pixel decoder with 9,609,764 parameters handles the heavy lifting for segmentation and alpha matting, using a visual feature adapter, a box-guided query decoder, and an instance-conditioned dense head. These pieces let the model switch between object-level and pixel-level outputs without a separate network.

According to Tencent, the model excels at a range of visual grounding tasks: open-vocabulary object detection, referring localization, counting, pointing, OCR, referring segmentation, and promptable alpha matting. It generates structured outputs directly, which makes inference efficient for single-turn image perception. However, the card notes that fine alpha boundaries can be fragile when the image resolution is low, when there is severe occlusion, complex transparency, or when the prompt phrasing is ambiguous. Video grids are also rejected by the pixel decoder, limiting it to still images.

The data sheet lists token-generation speeds for several consumer GPUs. On an RTX 3060 with 12 GB VRAM and 32 GB RAM, the model runs at about 64 tokens per second when fully loaded into GPU memory. A higher-end RTX 4090 reaches roughly 160 tokens per second, and the newest RTX 5090 pushes that to about 253 tokens per second. These numbers give a sense of how quickly the model can respond to prompts on typical home machines.

The model is aimed at research in visual grounding, referring localization, counting, OCR, segmentation, and matting. Because it runs on a RTX 4060 as the smallest machine that can hold it fully, hobbyists with mid-range GPUs can experiment without expensive hardware. Anyone looking for a free, Apache-2.0 licensed vision-language model that covers many tasks in one package will find it a useful addition to their toolkit.

Was brauchst du, um es zu Hause auszuführen? Bei 4 Bit belegt es etwa 6 Gigabyte Speicher. Der kleinste Heimrechner, der es komplett fasst, ist ein RTX 4060. Auf einem RTX 3060 12 GB mit 32 Gigabyte RAM schreibt es etwa 64 Tokens pro Sekunde. Auf einem RTX 4090 mit 64 Gigabyte RAM schreibt es etwa 160 Tokens pro Sekunde.

Es gibt noch keine kostenlose API dafür. Die Gewichte sind offen: Du kannst sie von Hugging Face unter der Apache 2.0-Lizenz herunterladen. Arena hat es noch nicht bewertet: Wir fügen die Punktzahl hinzu, sobald die Stimmen eintreffen.

Compare WeVisOne VL 4B with every free model, and check what your own GPU can run, on FreeLLMArena.