Commonsense Reasoning on CSQA (Custom Metrics)
91.5AccuracyUDPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| UDPON Agents in MAD=52026.02 | 91.5 | 0.058 | 0.032 | 0.052 | |
| UDPON Agents in MAD=102026.02 | 88.2 | 0.064 | 0.045 | 0.065 | |
| UDPON Agents in MAD=32026.02 | 86.8 | 0.062 | 0.048 | 0.072 | |
| RMAACN Agents in MAD=52026.02 | 79.8 | 0.142 | 0.108 | 0.178 | |
| MAPPON Agents in MAD=52026.02 | 78.2 | 0.148 | 0.112 | 0.188 | |
| RMAACN Agents in MAD=102026.02 | 77.2 | 0.148 | 0.118 | 0.192 | |
| MAPPON Agents in MAD=102026.02 | 76.5 | 0.155 | 0.125 | 0.202 | |
| Standard MADN Agents in MAD=52026.02 | 75.4 | 0.198 | 0.135 | 0.225 | |
| RMAACN Agents in MAD=32026.02 | 74.1 | 0.168 | 0.132 | 0.212 | |
| Standard MADN Agents in MAD=102026.02 | 73.8 | 0.202 | 0.148 | 0.238 | |
| MAPPON Agents in MAD=32026.02 | 72.5 | 0.172 | 0.138 | 0.222 | |
| Standard MADN Agents in MAD=32026.02 | 68.2 | 0.205 | 0.162 | 0.258 |