Relevance Ranking on set.mm (val)
53.2Top-1 AccuracyMetaGen-IL
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MetaGen-ILHuman proofs=21786 (100%), Synthetic proofs=10M, Generator=MetaGen-IL2020.02 | 53.2 | 78.73 | 93.13 | 0.6474 | |
| MetaGen-RandHuman proofs=21786 (100%), Synthetic proofs=10M, Generator=MetaGen-Rand2020.02 | 52.08 | 77.76 | 92.83 | 0.6375 | |
| RELEVANCEHuman proofs=21786 (100%), Synthetic proofs=02020.02 | 51.52 | 78.56 | 93.41 | 0.6367 | |
| RELEVANCEHuman proofs=4358 (20%), Synthetic proofs=02020.02 | 47.02 | 72.45 | 89.48 | 0.587 | |
| MetaGen-ILHuman proofs=2179 (10%), Synthetic proofs=1M, Generator=MetaGen-IL2020.02 | 46.1 | 71.12 | 89.38 | 0.5772 | |
| MetaGen-RandHuman proofs=2179 (10%), Synthetic proofs=1M, Generator=MetaGen-Rand2020.02 | 45.44 | 70.13 | 88.33 | 0.5692 | |
| RELEVANCEHuman proofs=2179 (10%), Synthetic proofs=02020.02 | 41.24 | 67.56 | 86.84 | 0.5356 | |
| MetaGen-RL-AdvHuman proofs=0, Synthetic proofs=300K, Generator=MetaGen-RL-Adv2020.02 | 25.07 | 39.33 | 50.23 | 0.3242 | |
| MetaGen-RL-LMHuman proofs=0, Synthetic proofs=300K, Generator=MetaGen-RL-LM2020.02 | 24.74 | 37.66 | 54.22 | 0.3182 | |
| MetaGen-RandHuman proofs=0, Synthetic proofs=300K, Generator=MetaGen-Rand2020.02 | 24.22 | 37.27 | 49.92 | 0.3093 | |
| TF-IDFHuman proofs=0, Synthetic proofs=02020.02 | 14.28 | 21.13 | 32.55 | 0.1877 | |
| RELEVANCEHuman proofs=0, Synthetic proofs=02020.02 | 0.96 | 5.33 | 15.67 | 0.0445 |