Question Answering on ARC-C (Accuracy, Acc Drop)
87.04AccuracyNVFP4+PTS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NVFP4+PTSBackbone=LongCat 560B2026.02 | 87.04 | 2.66 | |
| HiF4Backbone=LongCat 560B2026.02 | 84.98 | 0.6 | |
| NVFP4Backbone=LongCat 560B2026.02 | 84.72 | 0.34 | |
| BF16Backbone=LongCat 560B2026.02 | 84.38 | — | |
| NVFP4Backbone=DeepSeek-V3.1 671B2026.02 | 82.83 | 2.92 | |
| NVFP4+PTSBackbone=DeepSeek-V3.1 671B2026.02 | 81.55 | 1.64 | |
| HiF4Backbone=DeepSeek-V3.1 671B2026.02 | 80.86 | 0.95 | |
| BF16Backbone=DeepSeek-V3.1 671B2026.02 | 79.91 | — |