Few-shot Learning on SAMSum
41.62ScoreCoA
Evaluation results
| Method | Links | |
|---|---|---|
| CoABackbone=Phi-3-small-8k-instruct, Context Window=8K2026.01 | 41.62 | |
| VanillaBackbone=Qwen2.5-32B, Context Window=8K2026.01 | 36.78 | |
| LSTM-MASBackbone=Qwen2.5-7B, Context Window=8K2026.01 | 36.53 | |
| LSTM-MASBackbone=Phi-3-small-8k-instruct, Context Window=8K2026.01 | 35.4 | |
| LightRAGBackbone=Qwen2.5-1.5B2026.01 | 34.54 | |
| CoABackbone=Qwen2.5-7B, Context Window=8K2026.01 | 33.91 | |
| CoABackbone=Qwen2.5-14B, Context Window=8K2026.01 | 30.22 | |
| LSTM-MASBackbone=Qwen2.5-32B, Context Window=8K2026.01 | 29.27 | |
| LSTM-MASBackbone=Qwen2.5-14B, Context Window=8K2026.01 | 27.75 | |
| CoABackbone=Qwen2.5-1.5B, Context Window=8K2026.01 | 27.43 | |
| LSTM-MASBackbone=Qwen2.5-1.5B, Context Window=8K2026.01 | 27.39 | |
| CoABackbone=Qwen2.5-32B, Context Window=8K2026.01 | 26.51 | |
| LSTM-MASBackbone=Llama-3.1-8B-Instruct, Context Window=8K2026.01 | 25.99 | |
| LightRAGBackbone=Llama-3.1-8B-Instruct2026.01 | 21.91 | |
| LSTM-MASBackbone=Phi-3.5-mini-instruct, Context Window=8K2026.01 | 16.71 | |
| VanillaBackbone=Qwen2.5-7B, Context Window=8K2026.01 | 15.32 | |
| VanillaBackbone=Qwen2.5-14B, Context Window=8K2026.01 | 15.27 | |
| VanillaBackbone=Phi-3-small-8k-instruct, Context Window=8K2026.01 | 15.22 | |
| CoABackbone=Phi-3.5-mini-instruct, Context Window=8K2026.01 | 15.18 | |
| CoABackbone=Llama-3.1-8B-Instruct, Context Window=8K2026.01 | 14.97 | |
| VanillaBackbone=Llama-3.1-8B-Instruct, Context Window=8K2026.01 | 14.88 | |
| LONGAGENTBackbone=Phi-3.5-mini-instruct, Context Window=8K2026.01 | 12.75 | |
| VanillaBackbone=Qwen2.5-1.5B, Context Window=8K2026.01 | 11.19 | |
| VanillaBackbone=Phi-3.5-mini-instruct, Context Window=8K2026.01 | 10.09 | |
| LSTM-MASBackbone=Llama-3.2-3B-Instruct, Context Window=8K2026.01 | 9.01 | |
| CoABackbone=Llama-3.2-3B-Instruct, Context Window=8K2026.01 | 7.04 | |
| LSTM-MASBackbone=Qwen2.5-0.5B, Context Window=8K2026.01 | 6.11 | |
| VanillaBackbone=Llama-3.2-3B-Instruct, Context Window=8K2026.01 | 5.9 | |
| CoABackbone=Qwen2.5-0.5B, Context Window=8K2026.01 | 5.75 | |
| LightRAGBackbone=Qwen2.5-0.5B2026.01 | 4.68 | |
| LONGAGENTBackbone=Llama-3.1-8B-Instruct, Context Window=8K2026.01 | 2.04 | |
| VanillaBackbone=Qwen2.5-0.5B, Context Window=8K2026.01 | 1.83 | |
| LONGAGENTBackbone=Qwen2.5-32B, Context Window=8K2026.01 | 1.6 | |
| LONGAGENTBackbone=Qwen2.5-14B, Context Window=8K2026.01 | 1.54 | |
| LONGAGENTBackbone=Llama-3.2-3B-Instruct, Context Window=8K2026.01 | 1.19 | |
| LONGAGENTBackbone=Qwen2.5-0.5B, Context Window=8K2026.01 | 1.02 | |
| LightRAGBackbone=Llama-3.2-3B-Instruct2026.01 | 0.37 | |
| LONGAGENTBackbone=Phi-3-small-8k-instruct, Context Window=8K2026.01 | 0.23 | |
| LONGAGENTBackbone=Qwen2.5-7B, Context Window=8K2026.01 | 0.13 | |
| LONGAGENTBackbone=Qwen2.5-1.5B, Context Window=8K2026.01 | 0.04 |