# Aspect Sentiment Quad Prediction on Czech monolingual Source: [Aspect Sentiment Quad Prediction on Czech monolingual]() Collection index: [llms.txt]() Data updated: 2026-03-05T08:43:23.111Z Evaluation of Aspect Sentiment Quad Prediction performance on the Czech monolingual dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Aspect Sentiment Quad Prediction (ASQP) | | Dataset (including any stated split) | Czech monolingual | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 26 of 26 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | mT5 | 64.09 | Not recorded | 69a124eb2d603e6de3e3c32a | | Aya 23 8B | 61.85 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.1 8B | 60.25 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 12B | 58.56 | Not recorded | 69a124eb2d603e6de3e3c32a | | Orca 2 13B | 57.93 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 4B | 48.9 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 27B | 46.91 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.3 70B | 44.36 | Not recorded | 69a124eb2d603e6de3e3c32a | | GPT-4o mini | 42.12 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 27B | 41.27 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.1 70B | 40.99 | Not recorded | 69a124eb2d603e6de3e3c32a | | GPT-4o mini | 40.68 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 12B | 40.17 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.3 70B | 38.29 | Not recorded | 69a124eb2d603e6de3e3c32a | | Aya 23 35B | 37.1 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 4B | 33.37 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.1 70B | 31.86 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 12B | 31.75 | Not recorded | 69a124eb2d603e6de3e3c32a | | Orca 2 13B | 28.83 | Not recorded | 69a124eb2d603e6de3e3c32a | | Aya 23 8B | 28.37 | Not recorded | 69a124eb2d603e6de3e3c32a | | Aya 23 35B | 26 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.1 8B | 17.02 | Not recorded | 69a124eb2d603e6de3e3c32a | | Gemma 3 4B | 15.2 | Not recorded | 69a124eb2d603e6de3e3c32a | | Orca 2 13B | 10.21 | Not recorded | 69a124eb2d603e6de3e3c32a | | Aya 23 8B | 8.76 | Not recorded | 69a124eb2d603e6de3e3c32a | | LLaMA 3.1 8B | 7.37 | Not recorded | 69a124eb2d603e6de3e3c32a | ### mT5 F1 Score: 64.09. Result ID: 69a942176dbb7075b952c6cc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### Aya 23 8B F1 Score: 61.85. Result ID: 69a942176dbb7075b952c6cd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### LLaMA 3.1 8B F1 Score: 60.25. Result ID: 69a942176dbb7075b952c6d0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### Gemma 3 12B F1 Score: 58.56. Result ID: 69a942176dbb7075b952c6cf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### Orca 2 13B F1 Score: 57.93. Result ID: 69a942176dbb7075b952c6d1. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### Gemma 3 4B F1 Score: 48.9. Result ID: 69a942176dbb7075b952c6ce. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Fine-tuning"}. This record does not assert independent reproduction. ### Gemma 3 27B F1 Score: 46.91. Result ID: 69a942176dbb7075b952c6c6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### LLaMA 3.3 70B F1 Score: 44.36. Result ID: 69a942176dbb7075b952c6c9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### GPT-4o mini F1 Score: 42.12. Result ID: 69a942176dbb7075b952c6c1. [Reporting paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Gemma 3 27B F1 Score: 41.27. Result ID: 69a942176dbb7075b952c6bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### LLaMA 3.1 70B F1 Score: 40.99. Result ID: 69a942176dbb7075b952c6c8. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### GPT-4o mini F1 Score: 40.68. Result ID: 69a942176dbb7075b952c6cb. [Reporting paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### Gemma 3 12B F1 Score: 40.17. Result ID: 69a942176dbb7075b952c6c5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### LLaMA 3.3 70B F1 Score: 38.29. Result ID: 69a942176dbb7075b952c6bf. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Aya 23 35B F1 Score: 37.1. Result ID: 69a942176dbb7075b952c6c3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### Gemma 3 4B F1 Score: 33.37. Result ID: 69a942176dbb7075b952c6c4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### LLaMA 3.1 70B F1 Score: 31.86. Result ID: 69a942176dbb7075b952c6be. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Gemma 3 12B F1 Score: 31.75. Result ID: 69a942176dbb7075b952c6bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Orca 2 13B F1 Score: 28.83. Result ID: 69a942176dbb7075b952c6ca. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### Aya 23 8B F1 Score: 28.37. Result ID: 69a942176dbb7075b952c6c2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### Aya 23 35B F1 Score: 26. Result ID: 69a942176dbb7075b952c6b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### LLaMA 3.1 8B F1 Score: 17.02. Result ID: 69a942176dbb7075b952c6c7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Few-shot"}. This record does not assert independent reproduction. ### Gemma 3 4B F1 Score: 15.2. Result ID: 69a942176dbb7075b952c6ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Orca 2 13B F1 Score: 10.21. Result ID: 69a942176dbb7075b952c6c0. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### Aya 23 8B F1 Score: 8.76. Result ID: 69a942176dbb7075b952c6b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. ### LLaMA 3.1 8B F1 Score: 7.37. Result ID: 69a942176dbb7075b952c6bd. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Type":"Zero-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.