Tool Selection Quality on Representative guardrail dataset
95F1 ScoreChainPoll
Evaluation Results
| Method | Links | |
|---|---|---|
| ChainPollModel=GPT 4.12026.02 | 95 | |
| Luna-2Model=Llama 3.2 3B2026.02 | 94 | |
| Single tokenModel=Llama 3.2 3B2026.02 | 57 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| ChainPollModel=GPT 4.12026.02 | 95 | |
| Luna-2Model=Llama 3.2 3B2026.02 | 94 | |
| Single tokenModel=Llama 3.2 3B2026.02 | 57 |