OpenBook Evaluation on OpenBook
53.2AccuracyCache-to-Cache
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Cache-to-CacheSharer=Qwen3-4B-Base, Receiver=Qwen3-0.6B2025.10 | 53.2 | 0.34 | |
| Cache-to-CacheSharer=Qwen2.5-0.5B, Receiver=Qwen3-0.6B2025.10 | 52.6 | 0.3 | |
| Cache-to-CacheSharer=Llama3.2-1B, Receiver=Qwen3-0.6B2025.10 | 47.8 | 0.43 | |
| Text-to-TextSharer=Qwen3-4B-Base, Receiver=Qwen3-0.6B2025.10 | 46.4 | 5.08 | |
| SharerModel=Qwen2.5-0.5B, Receiver=Qwen3-0.6B2025.10 | 45.6 | 0.35 | |
| Text-to-TextSharer=Qwen2.5-0.5B, Receiver=Qwen3-0.6B2025.10 | 44 | 0.81 | |
| Text-to-TextSharer=Llama3.2-1B, Receiver=Qwen3-0.6B2025.10 | 41.2 | 0.7 | |
| RoutingSharer=Qwen2.5-0.5B, Receiver=Qwen3-0.6B2025.10 | 40.8 | 0.29 | |
| ReceiverModel=Qwen3-0.6B2025.10 | 39.2 | 0.27 | |
| RoutingSharer=Llama3.2-1B, Receiver=Qwen3-0.6B2025.10 | 36.4 | 0.17 | |
| SharerModel=Llama3.2-1B2025.10 | 32.6 | 0.07 | |
| RoutingSharer=Qwen3-4B-Base, Receiver=Qwen3-0.6B2025.10 | 22.2 | 0.27 | |
| SharerModel=Qwen3-4B-Base2025.10 | 2.2 | 1.98 |