Topic Classification on Yahoo Answers (test)
61.3F1 Score (Test)SPoT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SPoTSource tasks=DBPedia, Number of shots=100 shots2024.08 | 61.3 | — | — | — | — | — | — | — | |
| Task Prompt VectorsSource tasks=DBPedia + TREC, Number of shots=100 shots2024.08 | 61.1 | — | — | — | — | — | — | — | |
| SPoTSource tasks=DBPedia + TREC, Number of shots=100 shots2024.08 | 60.7 | — | — | — | — | — | — | — | |
| SPoTSource tasks=TREC, Number of shots=100 shots2024.08 | 36.5 | — | — | — | — | — | — | — | |
| RandomSource tasks=Random, Number of shots=100 shots2024.08 | 27.6 | — | — | — | — | — | — | — | |
| ATTEMPTSource tasks=DBPedia + TREC, Number of shots=100 shots2024.08 | 8.1 | — | — | — | — | — | — | — | |
| ATTEMPTSource tasks=DBPedia + TREC, Number of shots=0 shots2024.08 | 0.1 | — | — | — | — | — | — | — | |
| RandomSource tasks=Random, Number of shots=0 shots2024.08 | 0 | — | — | — | — | — | — | — | |
| SPoTSource tasks=DBPedia, Number of shots=0 shots2024.08 | 0 | — | — | — | — | — | — | — | |
| SPoTSource tasks=TREC, Number of shots=0 shots2024.08 | 0 | — | — | — | — | — | — | — | |
| SPoTSource tasks=DBPedia + TREC, Number of shots=0 shots2024.08 | 0 | — | — | — | — | — | — | — | |
| Task Prompt VectorsSource tasks=DBPedia + TREC, Number of shots=0 shots2024.08 | 0 | — | — | — | — | — | — | — | |
| AVGBackbone=BERT-tiny, Pre-training=Pretrained on Wikipedia and BookCorpus, Number of seeds=32025.09 | — | 49.61 | 55.78 | 56.39 | 58.94 | 61.17 | 61.92 | — | |
| sUWABackbone=BERT-tiny, Pre-training=Pretrained on Wikipedia and BookCorpus, Number of seeds=32025.09 | — | 56.66 | 59.61 | 58.81 | 60.03 | 61.55 | 62.08 | — | |
| UWABackbone=BERT-tiny, Pre-training=Pretrained on Wikipedia and BookCorpus, Number of seeds=32025.09 | — | 56.46 | 57.9 | 58.51 | 59.69 | 61.2 | 61.97 | 63.8 |