Reasoning on ARC-E (Acc., Token, Speed)
99.4Accuracy (ARC-E)LatentMAS
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LatentMASBackbone=Qwen3-14B, Collaboration Method=Latent-based MAS, MAS Setting=Sequential2025.11 | 99.4 | 224 | 2,124 | |
| TextMASBackbone=Qwen3-8B, Collaboration Method=Text-based MAS, MAS Setting=Sequential2025.11 | 99.1 | 2,085 | 3,702 | |
| TextMASBackbone=Qwen3-14B, Collaboration Method=Text-based MAS, MAS Setting=Sequential2025.11 | 99 | 1,670 | 9,171 | |
| LatentMASBackbone=Qwen3-8B, Collaboration Method=Latent-based MAS, MAS Setting=Sequential2025.11 | 98.8 | 490 | 1,759 | |
| LatentMASBackbone=Qwen3-4B, Collaboration Method=Latent-based MAS, MAS Setting=Sequential2025.11 | 98.6 | 581 | 512 | |
| SingleBackbone=Qwen3-14B, Collaboration Method=Single-model, MAS Setting=Sequential2025.11 | 97.2 | 608 | 551 | |
| TextMASBackbone=Qwen3-4B, Collaboration Method=Text-based MAS, MAS Setting=Sequential2025.11 | 96.4 | 2,420 | 2,874 | |
| SingleBackbone=Qwen3-8B, Collaboration Method=Single-model, MAS Setting=Sequential2025.11 | 95.6 | 656 | 404 | |
| SingleBackbone=Qwen3-4B, Collaboration Method=Single-model, MAS Setting=Sequential2025.11 | 95.4 | 724 | 369 |