Word Sense Disambiguation on FEWS
81Noun WSD AccuracyGemma 3 4B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Gemma 3 4BReasoning Approach=CoT based Neighbour words analysis, Epochs=22026.03 | 81 | 71 | 72 | 76 | 75 | |
| Gemma 3 4BReasoning Approach=CoT based Neighbour words analysis, Epochs=12026.03 | 79 | 65 | 70 | 80 | 72 | |
| Qwen 3 4BReasoning Approach=CoT based Neighbour words analysis, Epochs=22026.03 | 79 | 67 | 75 | 68 | 74 | |
| Qwen 2.5 3BReasoning Approach=CoT based Neighbour words analysis, Epochs=12026.03 | 71 | 64 | 71 | 74 | 69 | |
| Gemma-2 2BReasoning Approach=CoT based Neighbour words analysis, Epochs=12026.03 | 70 | 61 | 68 | 66 | 67 | |
| Qwen 3 4BCategory=Current Baseline2026.03 | 69 | 54 | 58 | 48 | 61 | |
| Yi - 34BCategory=Current Baseline2026.03 | 65 | 51 | 57 | 52 | 58 | |
| Gemma 3 4BCategory=Current Baseline2026.03 | 62 | 48 | 52 | 48 | 54 | |
| SmolLM 3BReasoning Approach=CoT based Neighbour words analysis, Epochs=12026.03 | 52 | 35 | 50 | 54 | 47 | |
| Gemma 7BCategory=Current Baseline2026.03 | 49 | 41 | 51 | 46 | 47 | |
| Mixtral 7BCategory=Current Baseline2026.03 | 43 | 32 | 46 | 42 | 41 | |
| GPT 4o-miniCategory=Current Baseline2026.03 | 37 | 30 | 31 | 32 | 33 |