Science Question Answering on ARC (Accuracy)
25.8AccuracyTTT+CT-KV
Evaluation Results
| Method | Links | |
|---|---|---|
| TTT+CT-KVTraining time per task (s)=632025.07 | 25.8 | |
| TTTTraining time per task (s)=562025.07 | 23.8 | |
| CT-KVTraining time per task (s)=262025.07 | 23.8 | |
| CT-PromptTraining time per task (s)=522025.07 | 22.5 | |
| Prefix TuningTraining time per task (s)=24, m=# demo2025.07 | 20.5 | |
| Prompt TuningTraining time per task (s)=49, m=# demo2025.07 | 14.5 | |
| LoRATraining time per task (s)=142025.07 | 13.5 | |
| ICLTraining time per task (s)=0, Evaluation protocol=In-Context Learning2025.07 | 13.3 | |
| DoRATraining time per task (s)=152025.07 | 13 | |
| Rank-Stabilized LoRATraining time per task (s)=152025.07 | 12.8 | |
| Prompt TuningTraining time per task (s)=13, m=322025.07 | 12 | |
| Prefix TuningTraining time per task (s)=14, m=322025.07 | 9.3 | |
| Zero-ShotTraining time per task (s)=0, Evaluation protocol=Zero-Shot2025.07 | 1 |