# Tool Activation Probing on τ-bench airline (80/20 stratified split) Source: [Tool Activation Probing on τ-bench airline (80/20 stratified split)]() Collection index: [llms.txt]() Data updated: 2026-05-11T10:41:59.844Z Evaluation of model performance on Tool Activation Probing using the 80/20 stratified split of the τ-bench airline dataset, reporting TOP-1, TOP-5, and RATIO metrics. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Tool Activation Probing | | Dataset (including any stated split) | τ-bench airline (80/20 stratified split) | | Metric | Top-1 Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 5 of 5 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Top-1 Accuracy](): Higher is better; unit: PERCENT. - [Top-5 Accuracy](): Higher is better; unit: PERCENT. - [Ratio Factor](): Higher is better; unit: SCALAR. ## Recorded results | Method | Top-1 Accuracy | Result date | Report paper | | --- | --- | --- | --- | | Qwen 3 14B | 89 | Not recorded | 6a01629edbc836b87d8231af | | Qwen 3 8B | 72 | Not recorded | 6a01629edbc836b87d8231af | | Qwen 3 4B | 71 | Not recorded | 6a01629edbc836b87d8231af | | Gemma 3 12B IT | 66 | Not recorded | 6a01629edbc836b87d8231af | | Gemma 3 4B IT | 61 | Not recorded | 6a01629edbc836b87d8231af | ### Qwen 3 14B Top-1 Accuracy: 89. Result ID: 6a01b27447f34ce924e451f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5","CHANCE":"20.0%","Probe Type":"multinomial logistic-regression","Feature Source":"residual stream","Regularization":"l2, C=1"}. This record does not assert independent reproduction. ### Qwen 3 8B Top-1 Accuracy: 72. Result ID: 6a01b27447f34ce924e451f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"6","CHANCE":"16.7%","Probe Type":"multinomial logistic-regression","Feature Source":"residual stream","Regularization":"l2, C=1"}. This record does not assert independent reproduction. ### Qwen 3 4B Top-1 Accuracy: 71. Result ID: 6a01b27447f34ce924e451f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"5","CHANCE":"20.0%","Probe Type":"multinomial logistic-regression","Feature Source":"residual stream","Regularization":"l2, C=1"}. This record does not assert independent reproduction. ### Gemma 3 12B IT Top-1 Accuracy: 66. Result ID: 6a01b27447f34ce924e451f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"9","CHANCE":"11.1%","Probe Type":"multinomial logistic-regression","Feature Source":"residual stream","Regularization":"l2, C=1"}. This record does not assert independent reproduction. ### Gemma 3 4B IT Top-1 Accuracy: 61. Result ID: 6a01b27447f34ce924e451f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"K":"8","CHANCE":"12.5%","Probe Type":"multinomial logistic-regression","Feature Source":"residual stream","Regularization":"l2, C=1"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.