Knowledge Retrieval on ARC Challenge
39.42Accuracy (30% Sparsity)Taylor-FO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Taylor-FOModel=LLaMA-3-8B, Hardware=Single NVIDIA GeForce RTX 4090, Evaluation Protocol=Zero-shot/Few-shot2026.05 | 39.42 | 34.9 | |
| Wanda-StructModel=LLaMA-3-8B, Hardware=Single NVIDIA GeForce RTX 4090, Evaluation Protocol=Zero-shot/Few-shot2026.05 | 38.31 | 31.4 | |
| RKUModel=LLaMA-3-8B, Hardware=Single NVIDIA GeForce RTX 4090, Evaluation Protocol=Zero-shot/Few-shot2026.05 | 36.6 | 30.03 | |
| FLAPModel=LLaMA-3-8B, Hardware=Single NVIDIA GeForce RTX 4090, Evaluation Protocol=Zero-shot/Few-shot2026.05 | 29.1 | 24.15 |