Vota en Free Arena

Noticias··1 min de lectura·Datos actualizados automáticamente

Cmpnd launches dspy-wsp, a gradient‑free weight‑space optimizer for DSPy decision models

Cmpnd released dspy-wsp, a prototype DSPy optimizer that edits model weights directly using GPT‑6‑Astra, improving decision‑model accuracy without gradients.

The tool implements weight‑space programming, letting a frontier LLM such as GPT‑6‑Astra read and edit another model’s weights without gradients or training data. It is packaged as the WeightSpace optimizer, works with any DSPy program and metric, requires DSPy 3.5, and is available under an MIT license via pip.

In tests on five open decision models ranging from 0.6 B to 9 B parameters, each run used about $5–10 of GPT‑6‑Astra calls and 25 forward passes. All models improved; d1‑omni‑600M increased from 50.9 % to 69.1 % when WeightSpace was combined with ReAnchor, a gain of 18.3 points. The 9 B Clef‑Flash model saw a smaller rise of 1.9 points with WeightSpace alone and 6.5 points with ReAnchor.

The experiments ran on a single Mac, with 2 B models using roughly 6 GB of memory and the 600 M model needing at least 4 GB. Each optimization took between 78 and 167 minutes. Linux users can run the optimizer on PyTorch with an NVIDIA GPU.

The authors describe the tool as "very experimental" and note it is slower on larger models, while editing text‑generating LLMs remains costly.

Qué significa para ti

For developers, dspy-wsp provides a cheap, gradient‑free method to boost decision‑model accuracy while keeping the model on local hardware. For users who prefer free or self‑hosted models, the release shows that weight‑space edits can be applied on modest machines, but the technique is still early and may not work well for larger models.

Fuentes

Escrito automáticamente a partir de las fuentes anteriores, luego revisado por nuestro código: cada número y nombre debe aparecer en ellas, y ninguna oración puede copiar una fuente. ¿Detectaste un error? Infórmalo.

Clasificación gratuita

¿Qué IA puedes usar gratis hoy?

Todos los modelos de IA gratuitos, clasificados por votos humanos ciegos, con la memoria y velocidad que necesita tu GPU.

Abre la clasificación →

Comparte esta página:XLinkedInRedditWhatsApp

Pulsa / o Ctrl+K para buscar desde cualquier página.