Tool Retrieval on G1
95.7Rc@50TG
Evaluation Results
| Method | Links | |
|---|---|---|
| TGBackbone=Gemma3-4B, Tuning=Full, Stage=S22026.06 | 95.7 | |
| TG-3FMBackbone=Gemma3-4B, Tuning=Full, Stage=S22026.06 | 95.3 | |
| TG-SPBackbone=Gemma3-4B, Stage=S22026.06 | 94.5 | |
| TG-3FMBackbone=Gemma3-4B, Tuning=LoRA, Stage=S22026.06 | 93 | |
| TG-5FMBackbone=Gemma3-4B, Tuning=LoRA, Stage=S22026.06 | 92.5 | |
| TG-5FMBackbone=Gemma3-4B, Tuning=Full, Stage=S22026.06 | 92.3 | |
| TG-HBackbone=Gemma3-4B, Stage=S22026.06 | 90.8 | |
| TGBackbone=Gemma3-4B, Tuning=LoRA, Stage=S22026.06 | 90.4 | |
| TG-5FMBackbone=Gemma3-4B, Tuning=LoRA, Stage=S12026.06 | 48.5 | |
| TGBackbone=Gemma3-4B, Tuning=Full, Stage=S12026.06 | 47 | |
| te3lStage=S22026.06 | 47 | |
| TG-3FMBackbone=Gemma3-4B, Tuning=Full, Stage=S12026.06 | 43.1 | |
| TG-3FMBackbone=Gemma3-4B, Tuning=LoRA, Stage=S12026.06 | 42.5 | |
| TGBackbone=Gemma3-4B, Tuning=LoRA, Stage=S12026.06 | 38.8 | |
| TG-SPBackbone=Gemma3-4B, Stage=S12026.06 | 38.6 | |
| TG-5FMBackbone=Gemma3-4B, Tuning=Full, Stage=S12026.06 | 37.8 | |
| BM25Stage=S22026.06 | 27.8 | |
| TG-HBackbone=Gemma3-4B, Stage=S12026.06 | 23.8 |