Tactile Reasoning on TouchThinker-Bench (unseen sensor and object)
68.3Hardness ScoreTouchThinker-7B
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| TouchThinker-7BParameters=7B2026.06 | 68.3 | 69.7 | 70.6 | 51.7 | 37.2 | 68.2 | 52.1 | 47.2 | 62 | 58.6 | |
| VTV-LLM-7BParameters=7B2026.06 | 59.2 | 60.1 | 62.8 | 46.5 | 28.4 | 51.6 | 43.5 | 39.7 | 52 | 49.3 | |
| Octopi-13BParameters=13B2026.06 | 44.8 | 46.5 | 41.9 | 36.1 | 22.1 | 35.5 | 38.7 | 30.6 | 56 | 38 | |
| Octopi-7BParameters=7B2026.06 | 43.2 | 47.1 | 39.5 | 32.6 | 13.9 | 31.4 | 33.9 | 22.4 | 48 | 34.7 |