FreeLLMTencent releases Youtu-Parsing-Omni, a 5B omni‑modal parsing model
The new compact model parses documents, images, charts, audio and video into a single JSON schema.
Tencent's research team published Youtu-Parsing-Omni, a 5‑billion‑parameter model that handles seven parsing families with a single encoder.
The model accepts a document page, natural image, chart, flowchart, geometry figure, audio clip or audio‑visual video and returns a structured JSON envelope covering perception (layout, text, tables, OCR, timestamps, acoustic events) and cognition (captions, narratives, reports).
A unified schema is driven by a task prompt, while the omni encoder processes image, audio and interleaved audio‑visual inputs in one network.
Youtu-Parsing-Omni achieves state‑of‑the‑art scores on OmniDocBench v1.6 (96.96 overall) and leads open‑weight results on OmniParsingBench (75.08 average), trailing only Gemini‑3‑Pro, and performs competitively on specialized tasks such as ChemOCR and PDMX‑Synth.
The authors provide a vLLM plugin with pinned serving settings, task prompts and inference examples to simplify deployment.
Qué significa para ti
For developers, a single model that parses multiple modalities reduces the need for separate specialized systems, lowering integration complexity. For the free‑model community, the compact 5B size makes it feasible to run locally or on modest cloud instances, expanding access to advanced omni‑modal parsing without relying on large proprietary services.
Fuentes
- Tencent paper: Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities, Hugging Face Papers (official), 28 Oct 2026
Escrito automáticamente a partir de las fuentes anteriores, luego revisado por nuestro código: cada número y nombre debe aparecer en ellas, y ninguna oración puede copiar una fuente. ¿Detectaste un error? Infórmalo.
¿Qué IA puedes usar gratis hoy?
Todos los modelos de IA gratuitos, clasificados por votos humanos ciegos, con la memoria y velocidad que necesita tu GPU.