# Law Retrieval on Austrian-law 5,000-query (test) Source: [Law Retrieval on Austrian-law 5,000-query (test)]() Collection index: [llms.txt]() Data updated: 2026-05-06T07:05:01.648Z Evaluation of Law Retrieval performance on the test split of the Austrian-law 5,000-query dataset, measured using MRR, Hit Rate, and Top-1 accuracy. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Law Retrieval | | Dataset (including any stated split) | Austrian-law 5,000-query (test) | | Metric | Top-1 Accuracy | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 30 of 30 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Top-1 Accuracy](): Higher is better; unit: SCALAR. - [MRR](): Higher is better; unit: SCALAR. - [Hit Rate](): Higher is better; unit: SCALAR. ## Recorded results | Method | Top-1 Accuracy | Result date | Report paper | | --- | --- | --- | --- | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | KAHM | 0.411 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | Mixedbread | 0.378 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | | IDF–SVD | 0.287 | Not recorded | 69facae7c0f56ed84308a223 | ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51a3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51a9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### KAHM Top-1 Accuracy: 0.411. Result ID: 69fae7bf47f34ce924dd51ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51a4. [Reporting paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51a7. [Reporting paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51aa. [Reporting paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51ad. [Reporting paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51b0. [Reporting paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51bb. [Reporting paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51bc. [Reporting paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51bd. [Reporting paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51be. [Reporting paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### Mixedbread Top-1 Accuracy: 0.378. Result ID: 69fae7bf47f34ce924dd51bf. [Reporting paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51a2. [Reporting paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51a5. [Reporting paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51a8. [Reporting paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51ab. [Reporting paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51ae. [Reporting paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51b1. [Reporting paper]() Recorded evaluation configuration: {"k":"3"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51b2. [Reporting paper]() Recorded evaluation configuration: {"k":"5"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51b3. [Reporting paper]() Recorded evaluation configuration: {"k":"10"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51b4. [Reporting paper]() Recorded evaluation configuration: {"k":"15"}. This record does not assert independent reproduction. ### IDF–SVD Top-1 Accuracy: 0.287. Result ID: 69fae7bf47f34ce924dd51b5. [Reporting paper]() Recorded evaluation configuration: {"k":"20"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.