Topic Classification on Reuters-21578 (test)
0.923AccuracyFusion
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| FusionTraining Data=100% (5842)2025.12 | 0.923 | 0.96 | 0.967 | 0.961 | |
| FusionTraining Data=80% (4673)2025.12 | 0.902 | 0.954 | 0.954 | 0.965 | |
| RoBERTaTraining Data=100% (5842)2025.12 | 0.89 | 0.946 | 0.932 | 0.966 | |
| OpenAITraining Data=100% (5842)2025.12 | 0.889 | 0.939 | 0.963 | 0.927 | |
| RoBERTaTraining Data=80% (4673)2025.12 | 0.888 | 0.943 | 0.93 | 0.966 | |
| OpenAITraining Data=20% (1168)2025.12 | 0.886 | 0.928 | 0.951 | 0.923 | |
| OpenAITraining Data=60% (3505)2025.12 | 0.884 | 0.938 | 0.959 | 0.924 | |
| OpenAITraining Data=80% (4673)2025.12 | 0.88 | 0.934 | 0.951 | 0.918 | |
| OpenAITraining Data=40% (2336)2025.12 | 0.879 | 0.931 | 0.952 | 0.917 | |
| FusionTraining Data=60% (3505)2025.12 | 0.855 | 0.932 | 0.929 | 0.95 | |
| FusionTraining Data=40% (2336)2025.12 | 0.836 | 0.886 | 0.893 | 0.889 | |
| RoBERTaTraining Data=60% (3505)2025.12 | 0.834 | 0.907 | 0.906 | 0.945 | |
| RoBERTaTraining Data=40% (2336)2025.12 | 0.82 | 0.836 | 0.858 | 0.85 | |
| FusionTraining Data=20% (1168)2025.12 | 0.72 | 0.752 | 0.769 | 0.745 | |
| RoBERTaTraining Data=20% (1168)2025.12 | 0.673 | 0.534 | 0.465 | 0.643 | |
| PiNDAEvaluation Protocol=Softmax Regression (SR), mu=02024.08 | 0.4437 | — | — | — | |
| SimCLEvaluation Protocol=Softmax Regression (SR)2024.08 | 0.4434 | — | — | — | |
| Random NoiseEvaluation Protocol=Softmax Regression (SR)2024.08 | 0.4421 | — | — | — | |
| PiNDA + CLAEEvaluation Protocol=Softmax Regression (SR), mu=02024.08 | 0.4207 | — | — | — | |
| CLAEEvaluation Protocol=Softmax Regression (SR)2024.08 | 0.4191 | — | — | — | |
| PiNDA + CLAEEvaluation Protocol=kNN, mu=02024.08 | 0.3918 | — | — | — | |
| CLAEEvaluation Protocol=kNN2024.08 | 0.3895 | — | — | — | |
| PiNDAEvaluation Protocol=kNN, mu=02024.08 | 0.384 | — | — | — | |
| Random NoiseEvaluation Protocol=kNN2024.08 | 0.383 | — | — | — | |
| SimCLEvaluation Protocol=kNN2024.08 | 0.38 | — | — | — |