Suffix Ranking on Extraction Challenge Dataset
51MP (%)S-ReCaLL
Evaluation results
| Method | Links | ||
|---|---|---|---|
| S-ReCaLLGeneration Method=Temperature, Number of Trials=52025.12 | 51 | 15.5 | |
| Min-K%Generation Method=Composite, Number of Trials=52025.12 | 51 | 15.67 | |
| S-ReCaLLGeneration Method=Composite, Number of Trials=52025.12 | 50.9 | 15.49 | |
| Min-K%Generation Method=Temperature, Number of Trials=52025.12 | 50.9 | 15.73 | |
| LikelihoodGeneration Method=Temperature, Number of Trials=52025.12 | 50.8 | 15.81 | |
| LikelihoodGeneration Method=Composite, Number of Trials=52025.12 | 50.8 | 15.75 | |
| ReCaLLGeneration Method=Composite, Number of Trials=52025.12 | 50.8 | 15.64 | |
| ReCaLLGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 50.7 | 15.78 | |
| ReCaLLGeneration Method=Temperature, Number of Trials=52025.12 | 50.6 | 15.68 | |
| Min-K%Generation Method=Nucleus (top-p), Number of Trials=52025.12 | 50.6 | 15.88 | |
| LikelihoodGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 50.5 | 15.91 | |
| S-ReCaLLGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 50.5 | 15.77 | |
| ZlibGeneration Method=Temperature, Number of Trials=52025.12 | 50.4 | 15.85 | |
| High ConfidenceGeneration Method=Temperature, Number of Trials=52025.12 | 50.4 | 15.85 | |
| High ConfidenceGeneration Method=Composite, Number of Trials=52025.12 | 50.4 | 15.92 | |
| CON-ReCaLLGeneration Method=Composite, Number of Trials=52025.12 | 50.4 | 15.72 | |
| ReCaLLGeneration Method=Typical, Number of Trials=52025.12 | 50.3 | 15.77 | |
| Min-K%Generation Method=Typical, Number of Trials=52025.12 | 50.3 | 15.86 | |
| LikelihoodGeneration Method=Typical, Number of Trials=52025.12 | 50.2 | 15.95 | |
| High ConfidenceGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 50.2 | 16.03 | |
| S-ReCaLLGeneration Method=Typical, Number of Trials=52025.12 | 50.2 | 15.87 | |
| CON-ReCaLLGeneration Method=Temperature, Number of Trials=52025.12 | 50.2 | 15.76 | |
| ZlibGeneration Method=Composite, Number of Trials=52025.12 | 50.1 | 16.01 | |
| CON-ReCaLLGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 50 | 15.89 | |
| High ConfidenceGeneration Method=Typical, Number of Trials=52025.12 | 49.9 | 16.04 | |
| CON-ReCaLLGeneration Method=Typical, Number of Trials=52025.12 | 49.9 | 15.94 | |
| ZlibGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 49.8 | 16.17 | |
| ZlibGeneration Method=Typical, Number of Trials=52025.12 | 49.6 | 16.16 | |
| SURPGeneration Method=Temperature, Number of Trials=52025.12 | 49.4 | 16.29 | |
| OutlierGeneration Method=Temperature, Number of Trials=52025.12 | 49.2 | 16.11 | |
| OutlierGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 49.1 | 16.24 | |
| SURPGeneration Method=Composite, Number of Trials=52025.12 | 49.1 | 16.45 | |
| OutlierGeneration Method=Composite, Number of Trials=52025.12 | 49 | 16.14 | |
| SURPGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 48.4 | 16.7 | |
| OutlierGeneration Method=Typical, Number of Trials=52025.12 | 48.2 | 16.66 | |
| SURPGeneration Method=Typical, Number of Trials=52025.12 | 47.8 | 16.93 | |
| Min-K%++Generation Method=Nucleus (top-p), Number of Trials=52025.12 | 47.6 | 17.04 | |
| Min-K%++Generation Method=Temperature, Number of Trials=52025.12 | 47.3 | 16.85 | |
| Min-K%++Generation Method=Composite, Number of Trials=52025.12 | 47.3 | 16.94 | |
| LikelihoodGeneration Method=Top-k, Number of Trials=52025.12 | 46.5 | 17.32 | |
| High ConfidenceGeneration Method=Top-k, Number of Trials=52025.12 | 46.5 | 17.29 | |
| Min-K%Generation Method=Top-k, Number of Trials=52025.12 | 46.5 | 17.27 | |
| ZlibGeneration Method=Top-k, Number of Trials=52025.12 | 46.4 | 17.38 | |
| ReCaLLGeneration Method=Top-k, Number of Trials=52025.12 | 46.3 | 17.2 | |
| S-ReCaLLGeneration Method=Top-k, Number of Trials=52025.12 | 46.3 | 17.35 | |
| Min-K%++Generation Method=Typical, Number of Trials=52025.12 | 46.1 | 17.42 | |
| CON-ReCaLLGeneration Method=Top-k, Number of Trials=52025.12 | 45.6 | 17.64 | |
| SURPGeneration Method=Top-k, Number of Trials=52025.12 | 45.2 | 17.8 | |
| Min-K%Generation Method=Rep. Penalty, Number of Trials=52025.12 | 45.1 | 17.84 | |
| LikelihoodGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 45 | 17.84 | |
| ZlibGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 45 | 17.85 | |
| High ConfidenceGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 45 | 17.84 | |
| S-ReCaLLGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 45 | 17.89 | |
| ReCaLLGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 44.8 | 17.77 | |
| LowercaseGeneration Method=Nucleus (top-p), Number of Trials=52025.12 | 44.4 | 18.06 | |
| CON-ReCaLLGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 44 | 18.32 | |
| LowercaseGeneration Method=Composite, Number of Trials=52025.12 | 43.7 | 17.99 | |
| OutlierGeneration Method=Top-k, Number of Trials=52025.12 | 43.6 | 18.24 | |
| SURPGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 43.6 | 18.26 | |
| LowercaseGeneration Method=Temperature, Number of Trials=52025.12 | 43 | 18.29 | |
| OutlierGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 42.3 | 18.61 | |
| LowercaseGeneration Method=Typical, Number of Trials=52025.12 | 41.7 | 19.09 | |
| Min-K%++Generation Method=Top-k, Number of Trials=52025.12 | 36.6 | 20.44 | |
| Min-K%++Generation Method=Rep. Penalty, Number of Trials=52025.12 | 35.5 | 20.9 | |
| LowercaseGeneration Method=Top-k, Number of Trials=52025.12 | 27.2 | 24.43 | |
| LowercaseGeneration Method=Rep. Penalty, Number of Trials=52025.12 | 27.1 | 24.4 |