Reading Recognition on RiTW Columbus
82.9AccuracyFlexible Multimodal Transformer
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Flexible Multimodal TransformerGaze modality=true, RGB modality=true, IMU modality=true, Fusion capability=true, Number of parameters=130k, Sensing cost (power)=low, RGB requirements=foveated patch (5° FoV) (optional), Real-time=true, Inference time (ms)=0.545, Zero-shot capability=true2025.05 | 82.9 | 88.8 | |
| VLMGaze modality=false, RGB modality=true, IMU modality=false, Fusion capability=true, Number of parameters=11B, Sensing cost (power)=high, RGB requirements=full RGB, Real-time=false, Inference time (ms)=567.410, Zero-shot capability=true2025.05 | 76.7 | 65.6 |