FreeLLMTencent releases Youtu-Parsing-Omni, a 5B omni‑modal parsing model
The new compact model parses documents, images, charts, audio and video into a single JSON schema.
Tencent's research team published Youtu-Parsing-Omni, a 5‑billion‑parameter model that handles seven parsing families with a single encoder.
The model accepts a document page, natural image, chart, flowchart, geometry figure, audio clip or audio‑visual video and returns a structured JSON envelope covering perception (layout, text, tables, OCR, timestamps, acoustic events) and cognition (captions, narratives, reports).
A unified schema is driven by a task prompt, while the omni encoder processes image, audio and interleaved audio‑visual inputs in one network.
Youtu-Parsing-Omni achieves state‑of‑the‑art scores on OmniDocBench v1.6 (96.96 overall) and leads open‑weight results on OmniParsingBench (75.08 average), trailing only Gemini‑3‑Pro, and performs competitively on specialized tasks such as ChemOCR and PDMX‑Synth.
The authors provide a vLLM plugin with pinned serving settings, task prompts and inference examples to simplify deployment.
Was das für dich bedeutet
For developers, a single model that parses multiple modalities reduces the need for separate specialized systems, lowering integration complexity. For the free‑model community, the compact 5B size makes it feasible to run locally or on modest cloud instances, expanding access to advanced omni‑modal parsing without relying on large proprietary services.
Quellen
- Tencent paper: Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities, Hugging Face Papers (official), 28 Oct 2026
Automatisch aus den obigen Quellen geschrieben, dann von unserem Code geprüft: Jede Zahl und jeder Name muss darin vorkommen, und kein Satz darf eine Quelle kopieren. Einen Fehler entdeckt? Melde ihn.
Welche KI kannst du heute kostenlos nutzen?
Jedes kostenlose KI‑Modell, bewertet durch blinde menschliche Stimmen, mit dem Speicher und der Geschwindigkeit, die es auf deiner eigenen GPU benötigt.