FreeLLMTencent releases Youtu-Parsing-Omni, a 5B omni‑modal parsing model
The new compact model parses documents, images, charts, audio and video into a single JSON schema.
Tencent's research team published Youtu-Parsing-Omni, a 5‑billion‑parameter model that handles seven parsing families with a single encoder.
The model accepts a document page, natural image, chart, flowchart, geometry figure, audio clip or audio‑visual video and returns a structured JSON envelope covering perception (layout, text, tables, OCR, timestamps, acoustic events) and cognition (captions, narratives, reports).
A unified schema is driven by a task prompt, while the omni encoder processes image, audio and interleaved audio‑visual inputs in one network.
Youtu-Parsing-Omni achieves state‑of‑the‑art scores on OmniDocBench v1.6 (96.96 overall) and leads open‑weight results on OmniParsingBench (75.08 average), trailing only Gemini‑3‑Pro, and performs competitively on specialized tasks such as ChemOCR and PDMX‑Synth.
The authors provide a vLLM plugin with pinned serving settings, task prompts and inference examples to simplify deployment.
Ce que cela signifie pour vous
For developers, a single model that parses multiple modalities reduces the need for separate specialized systems, lowering integration complexity. For the free‑model community, the compact 5B size makes it feasible to run locally or on modest cloud instances, expanding access to advanced omni‑modal parsing without relying on large proprietary services.
Sources
- Tencent paper: Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities, Hugging Face Papers (official), 28 Oct 2026
Rédigé automatiquement à partir des sources ci‑dessus, puis vérifié par notre code : chaque nombre et chaque nom doivent y figurer, et aucune phrase ne doit copier une source. Une erreur ? Signalez‑la.
Quelle IA pouvez‑vous utiliser gratuitement aujourd’hui ?
Tous les modèles IA gratuits, classés par votes humains anonymes, avec la mémoire et la vitesse dont ils ont besoin sur votre propre GPU.