FreeLLMTencent releases Youtu-Parsing-Omni, a 5B omni‑modal parsing model
O novo modelo compacto analisa documentos, imagens, gráficos, áudio e vídeo em um único esquema JSON.
Tencent's research team published Youtu-Parsing-Omni, a 5‑billion‑parameter model that handles seven parsing families with a single encoder.
The model accepts a document page, natural image, chart, flowchart, geometry figure, audio clip or audio‑visual video and returns a structured JSON envelope covering perception (layout, text, tables, OCR, timestamps, acoustic events) and cognition (captions, narratives, reports).
A unified schema is driven by a task prompt, while the omni encoder processes image, audio and interleaved audio‑visual inputs in one network.
Youtu-Parsing-Omni achieves state‑of‑the‑art scores on OmniDocBench v1.6 (96.96 overall) and leads open‑weight results on OmniParsingBench (75.08 average), trailing only Gemini‑3‑Pro, and performs competitively on specialized tasks such as ChemOCR and PDMX‑Synth.
The authors provide a vLLM plugin with pinned serving settings, task prompts and inference examples to simplify deployment.
O que isso significa para você
For developers, a single model that parses multiple modalities reduces the need for separate specialized systems, lowering integration complexity. For the free‑model community, the compact 5B size makes it feasible to run locally or on modest cloud instances, expanding access to advanced omni‑modal parsing without relying on large proprietary services.
Fontes
- Tencent paper: Youtu-Parsing-Omni: One Encoder, One Schema, All Modalities, Hugging Face Papers (official), 28 Oct 2026
Escrito automaticamente a partir das fontes acima, depois verificado pelo nosso código: todo número e nome deve aparecer nelas, e nenhuma frase pode copiar uma fonte. Encontrou um erro? Reporte‑o.
Qual IA você pode usar grátis hoje?
Todo modelo de IA gratuito, classificado por votos humanos cegos, com a memória e velocidade que ele precisa na sua própria GPU.