# Text-to-NoSQL on MultiTEND average of 6 languages (test) Source: [Text-to-NoSQL on MultiTEND average of 6 languages (test)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:42:30.041Z Evaluation of Text-to-NoSQL performance on the test split of the MultiTEND dataset, averaged across 6 languages. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Text-to-NoSQL | | Dataset (including any stated split) | MultiTEND average of 6 languages (test) | | Metric | Exact Match (EM) | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 6 of 6 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Exact Match (EM)](): Higher is better; unit: PERCENT. - [Query Structure Match (QSM)](): Higher is better; unit: PERCENT. - [Query Form Correctness (QFC)](): Higher is better; unit: PERCENT. - [Execution Accuracy (EX)](): Higher is better; unit: PERCENT. - [Execution F1 Score (EFM)](): Higher is better; unit: PERCENT. - [Execution Value Match (EVM)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Exact Match (EM) | Result date | Report paper | | --- | --- | --- | --- | | MultiLink | 25.54 | Not recorded | 68fa76fd1e209131cea70476 | | SMART | 17.23 | Not recorded | 68fa76fd1e209131cea70476 | | Fine-tuned Llama | 15.64 | Not recorded | 68fa76fd1e209131cea70476 | | RAG for LLM | 14.32 | Not recorded | 68fa76fd1e209131cea70476 | | Few-shot LLM | 10.82 | Not recorded | 68fa76fd1e209131cea70476 | | Zero-shot LLM | 0.48 | Not recorded | 68fa76fd1e209131cea70476 | ### MultiLink Exact Match (EM): 25.54. Result ID: 699468623a6c3148491d0975. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### SMART Exact Match (EM): 17.23. Result ID: 699468623a6c3148491d0974. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### Fine-tuned Llama Exact Match (EM): 15.64. Result ID: 699468623a6c3148491d0970. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"learning\_strategy":"fine-tuned","backbone":"Llama"}. This record does not assert independent reproduction. ### RAG for LLM Exact Match (EM): 14.32. Result ID: 699468623a6c3148491d0973. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"retrieval":"RAG"}. This record does not assert independent reproduction. ### Few-shot LLM Exact Match (EM): 10.82. Result ID: 699468623a6c3148491d0972. [Reporting paper]() Recorded evaluation configuration: {"prompting\_strategy":"few-shot"}. This record does not assert independent reproduction. ### Zero-shot LLM Exact Match (EM): 0.48. Result ID: 699468623a6c3148491d0971. [Reporting paper]() Recorded evaluation configuration: {"prompting\_strategy":"zero-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.