# Few-shot Relation Classification on FewRel 2.0 Source: [Few-shot Relation Classification on FewRel 2.0]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:34:02.705Z Evaluation of Few-shot Relation Classification performance on the FewRel 2.0 dataset, measured using N-way K-shot accuracies. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Few-shot Relation Classification | | Dataset (including any stated split) | FewRel 2.0 | | Metric | Accuracy (5-way 1-shot) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy (5-way 1-shot)](): Higher is better; unit: SCALAR. - [Accuracy (5-way 5-shot)](): Higher is better; unit: SCALAR. - [Accuracy (10-way 1-shot)](): Higher is better; unit: SCALAR. - [Accuracy (10-way 5-shot)](): Higher is better; unit: SCALAR. ## Recorded results | Method | Accuracy (5-way 1-shot) | Result date | Report paper | | --- | --- | --- | --- | | BERT | 0.6741 | Not recorded | 68fa68c01e209131cea1e0eb | | KEPLER-Wiki | 0.6723 | Not recorded | 68fa68c01e209131cea1e0eb | | RoBERTa | 0.6678 | Not recorded | 68fa68c01e209131cea1e0eb | | KEPLER-Wiki | 0.6641 | Not recorded | 68fa68c01e209131cea1e0eb | | KnowBert-BERT | 0.6605 | Not recorded | 68fa68c01e209131cea1e0eb | | RoBERTa | 0.6465 | Not recorded | 68fa68c01e209131cea1e0eb | | KnowBert-BERT | 0.644 | Not recorded | 68fa68c01e209131cea1e0eb | | Our RoBERTa | 0.6322 | Not recorded | 68fa68c01e209131cea1e0eb | | Our RoBERTa | 0.6198 | Not recorded | 68fa68c01e209131cea1e0eb | | ERNIE-RoBERTa | 0.5929 | Not recorded | 68fa68c01e209131cea1e0eb | | ERNIE-BERT | 0.5618 | Not recorded | 68fa68c01e209131cea1e0eb | | KnowBert-RoBERTa | 0.5568 | Not recorded | 68fa68c01e209131cea1e0eb | | ERNIE-RoBERTa | 0.5443 | Not recorded | 68fa68c01e209131cea1e0eb | | MTB | 0.5213 | Not recorded | 68fa68c01e209131cea1e0eb | | KnowBert-RoBERTa | 0.5068 | Not recorded | 68fa68c01e209131cea1e0eb | | ERNIE-BERT | 0.494 | Not recorded | 68fa68c01e209131cea1e0eb | | MTB | 0.4618 | Not recorded | 68fa68c01e209131cea1e0eb | | BERT | 0.4012 | Not recorded | 68fa68c01e209131cea1e0eb | ### BERT Accuracy (5-way 1-shot): 0.6741. Result ID: 698d82c28b517eb433220c31. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. ### KEPLER-Wiki Accuracy (5-way 1-shot): 0.6723. Result ID: 698d82c28b517eb433220c39. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"KEPLER","Model Size":"BASE"}. This record does not assert independent reproduction. ### RoBERTa Accuracy (5-way 1-shot): 0.6678. Result ID: 698d82c28b517eb433220c35. [Reporting paper]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### KEPLER-Wiki Accuracy (5-way 1-shot): 0.6641. Result ID: 698d82c28b517eb433220c30. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"KEPLER","Model Size":"BASE"}. This record does not assert independent reproduction. ### KnowBert-BERT Accuracy (5-way 1-shot): 0.6605. Result ID: 698d82c28b517eb433220c34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. ### RoBERTa Accuracy (5-way 1-shot): 0.6465. Result ID: 698d82c28b517eb433220c2c. [Reporting paper]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### KnowBert-BERT Accuracy (5-way 1-shot): 0.644. Result ID: 698d82c28b517eb433220c2b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. ### Our RoBERTa Accuracy (5-way 1-shot): 0.6322. Result ID: 698d82c28b517eb433220c36. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### Our RoBERTa Accuracy (5-way 1-shot): 0.6198. Result ID: 698d82c28b517eb433220c2d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### ERNIE-RoBERTa Accuracy (5-way 1-shot): 0.5929. Result ID: 698d82c28b517eb433220c37. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### ERNIE-BERT Accuracy (5-way 1-shot): 0.5618. Result ID: 698d82c28b517eb433220c33. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. ### KnowBert-RoBERTa Accuracy (5-way 1-shot): 0.5568. Result ID: 698d82c28b517eb433220c2f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### ERNIE-RoBERTa Accuracy (5-way 1-shot): 0.5443. Result ID: 698d82c28b517eb433220c2e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### MTB Accuracy (5-way 1-shot): 0.5213. Result ID: 698d82c28b517eb433220c29. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"MTB","Model Size":"BASE"}. This record does not assert independent reproduction. ### KnowBert-RoBERTa Accuracy (5-way 1-shot): 0.5068. Result ID: 698d82c28b517eb433220c38. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"RoBERTa","Model Size":"BASE"}. This record does not assert independent reproduction. ### ERNIE-BERT Accuracy (5-way 1-shot): 0.494. Result ID: 698d82c28b517eb433220c2a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. ### MTB Accuracy (5-way 1-shot): 0.4618. Result ID: 698d82c28b517eb433220c32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Framework":"PAIR","Backbone":"MTB","Model Size":"BASE"}. This record does not assert independent reproduction. ### BERT Accuracy (5-way 1-shot): 0.4012. Result ID: 698d82c28b517eb433220c28. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Framework":"Proto","Backbone":"BERT","Model Size":"BASE"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.