Reasoning on CoT-Collection Scenario 1
70AccuracyLaDa
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LaDaSetting=One-shot setting, Client=Client 22026.02 | 70 | 0.2 | |
| WASPSetting=One-shot setting, Client=Client 22026.02 | 69.8 | — | |
| FedMKTSetting=One-shot setting, Client=Client 22026.02 | 69.2 | — | |
| LaDaSetting=Zero-shot setting, Client=Client 22026.02 | 69 | 3.4 | |
| FedKDSetting=One-shot setting, Client=Client 22026.02 | 66.2 | — | |
| WASPSetting=Zero-shot setting, Client=Client 22026.02 | 65.6 | — | |
| StandaloneSetting=One-shot setting, Client=Client 22026.02 | 64.9 | — | |
| LaDaSetting=Zero-shot setting, Client=Client 32026.02 | 54 | 2 | |
| LaDaSetting=One-shot setting, Client=LLM2026.02 | 54 | 1.1 | |
| WASPSetting=One-shot setting, Client=LLM2026.02 | 52.9 | — | |
| FedMKTSetting=One-shot setting, Client=LLM2026.02 | 52.5 | — | |
| WASPSetting=Zero-shot setting, Client=Client 32026.02 | 52 | — | |
| FedKDSetting=One-shot setting, Client=LLM2026.02 | 51.3 | — | |
| LaDaSetting=One-shot setting, Client=Client 32026.02 | 51.2 | 1 | |
| StandaloneSetting=One-shot setting, Client=LLM2026.02 | 50.6 | — | |
| WASPSetting=One-shot setting, Client=Client 32026.02 | 50.2 | — | |
| LaDaSetting=Zero-shot setting, Client=Client 12026.02 | 49.6 | 2 | |
| FedKDSetting=Zero-shot setting, Client=Client 22026.02 | 48.6 | — | |
| FedMKTSetting=Zero-shot setting, Client=Client 22026.02 | 48.6 | — | |
| LaDaSetting=One-shot setting, Client=Client 12026.02 | 47.8 | 3.8 | |
| WASPSetting=Zero-shot setting, Client=Client 12026.02 | 47.6 | — | |
| StandaloneSetting=Zero-shot setting, Client=Client 22026.02 | 47 | — | |
| FedMKTSetting=Zero-shot setting, Client=Client 12026.02 | 45.2 | — | |
| StandaloneSetting=Zero-shot setting, Client=Client 12026.02 | 44.6 | — | |
| FedKDSetting=Zero-shot setting, Client=Client 12026.02 | 44.6 | — | |
| FedKDSetting=Zero-shot setting, Client=Client 32026.02 | 44.2 | — | |
| WASPSetting=One-shot setting, Client=Client 12026.02 | 44 | — | |
| FedKDSetting=One-shot setting, Client=Client 32026.02 | 43.8 | — | |
| FedMKTSetting=Zero-shot setting, Client=Client 32026.02 | 43.6 | — | |
| LaDaSetting=Zero-shot setting, Client=LLM2026.02 | 43.5 | 0.8 | |
| StandaloneSetting=Zero-shot setting, Client=Client 32026.02 | 43.2 | — | |
| FedMKTSetting=One-shot setting, Client=Client 12026.02 | 42.8 | — | |
| WASPSetting=Zero-shot setting, Client=LLM2026.02 | 42.7 | — | |
| FedMKTSetting=Zero-shot setting, Client=LLM2026.02 | 41.9 | — | |
| FedKDSetting=One-shot setting, Client=Client 12026.02 | 41.6 | — | |
| FedMKTSetting=One-shot setting, Client=Client 32026.02 | 41.6 | — | |
| StandaloneSetting=One-shot setting, Client=Client 32026.02 | 41 | — | |
| StandaloneSetting=One-shot setting, Client=Client 12026.02 | 40.8 | — | |
| FedKDSetting=Zero-shot setting, Client=LLM2026.02 | 40.1 | — | |
| StandaloneSetting=Zero-shot setting, Client=LLM2026.02 | 39.6 | — |