Sentiment-Analysis-7B: Neuheiten, nötige Hardware, so nutzt du es kostenlos

Microsoft released a 7-billion-parameter model that labels sentiment in a single token. It improves accuracy over its base model by over ten points.

Sentiment-Analysis-7B is a causal language model that reads a user message and outputs a sentiment label followed by a short explanation. The label appears as the first token, so you can get just the classification by limiting the generation to three new tokens. It works for messages aimed at a service, product, or agent, which the system prompt defines as the "Target."

The model starts from the open source Mistral-7B-Instruct-v0.2 checkpoint. Microsoft fine-tuned it using reinforcement learning, where another large language model acted as a judge. The fine-tuning set is small, roughly three hundred examples, and no fixed sentiment labels were used during training. This approach lets the model learn the labeling task directly from the data.

According to the model card, the evaluation metric is accuracy. The original Mistral-7B-Instruct-v0.2 scores 62.0 percent, while the fine-tuned Sentiment-Analysis-7B reaches 72.8 percent. That is an improvement of more than ten percentage points, showing the benefit of the targeted fine-tuning.

The main strength is the higher accuracy for sentiment classification compared with the base model. Because the label is the first token, you can request just three new tokens and get a rapid, low-cost prediction. The model is limited to the three predefined labels and was trained on a small internal dataset, so its performance may vary on domains far from the training examples.

If you run AI models at home and need a free sentiment classifier, this model fits well. It runs on a RTX 4060 in 4-bit mode, and even a RTX 3060 can generate about 49 tokens per second, more than enough for single-token labels. The MIT license lets you download the weights from Hugging Face and integrate them into your own projects without cost.

Was brauchst du, um es zu Hause auszuführen? Bei 4 Bit belegt es etwa 7 Gigabyte Speicher. Der kleinste Heimrechner, der es komplett fasst, ist ein RTX 4060. Auf einem RTX 3060 12 GB mit 32 Gigabyte RAM schreibt es etwa 49 Tokens pro Sekunde. Auf einem RTX 4090 mit 64 Gigabyte RAM schreibt es etwa 126 Tokens pro Sekunde.

Eine kostenlose API gibt es dafür noch nicht. Die Gewichte sind offen: Du kannst sie unter der MIT-Lizenz von Hugging Face herunterladen. Die Arena hat es noch nicht bewertet: Wir tragen die Wertung nach, sobald die Stimmen eintreffen.

Compare Sentiment Analysis 7B with every free model, and check what your own GPU can run, on FreeLLMArena.