Downstream Classification on LLM Function Activation Dataset v1 (test)
82.36AccuracyIterD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 82.36 | 82.38 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 82.36 | 82.36 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 82.14 | 82.1 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 82.07 | 82.06 | |
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 82 | 82 | |
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 81.79 | 81.81 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 81.79 | 81.75 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 81.71 | 81.71 | |
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 81.57 | 81.58 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 81.5 | 81.55 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 81.5 | 81.51 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 81.43 | 81.43 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 80.36 | 80.33 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 80 | 79.96 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 79.93 | 79.87 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 79.86 | 79.84 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 79.86 | 79.85 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 79.43 | 79.43 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 79.29 | 79.24 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 79.07 | 79.08 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 79.07 | 79 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 79.07 | 79.01 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.93 | 78.86 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 78.93 | 78.84 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 78.86 | 78.81 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.86 | 78.89 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.79 | 78.76 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.79 | 78.75 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.64 | 78.62 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.5 | 78.49 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 78.43 | 78.39 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 78.43 | 78.43 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 78.43 | 78.44 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 78.36 | 78.27 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 78.29 | 78.28 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 78.14 | 78.15 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 77.93 | 77.92 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 77.79 | 77.79 | |
| Spectral Co-ClusteringLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 77.79 | 77.74 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 77.71 | 77.7 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 77.5 | 77.5 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 77.5 | 77.51 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 77.5 | 77.43 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 77.5 | 77.42 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 77.43 | 77.45 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 77.29 | 77.24 | |
| SpectralLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 77.29 | 77.25 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 76.71 | 76.66 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 76.64 | 76.62 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 76.64 | 76.6 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 76.5 | 76.34 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 76.43 | 76.37 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 76.43 | 76.38 | |
| Spectral Co-ClusteringLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 76.21 | 76.2 | |
| Spectral Co-ClusteringLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 76.21 | 76.2 | |
| SpectralLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 76.07 | 75.93 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 75.93 | 75.86 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 75.86 | 75.7 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 75.64 | 75.52 | |
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 75.36 | 75.29 | |
| Spectral Co-ClusteringLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 75.36 | 75.31 | |
| IterDLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 75.36 | 75.27 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 75.29 | 75.19 | |
| Spectral Co-ClusteringLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 74.93 | 74.84 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 74.86 | 74.74 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 74.79 | 74.65 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 74.79 | 74.67 | |
| IterDLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 74.29 | 74.24 | |
| Spectral Co-ClusteringLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 74.29 | 74.19 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 74.21 | 74.07 | |
| SpectralLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 73.64 | 73.53 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 73.57 | 73.35 | |
| Mini-Batch K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 73.36 | 73.17 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 73.07 | 72.9 | |
| AgglomerativeLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 73 | 72.91 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 72.64 | 72.6 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 72.64 | 72.6 | |
| IterDLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 72.57 | 72.59 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 72.36 | 72.07 | |
| SpectralLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=202026.03 | 72.36 | 72.29 | |
| AgglomerativeLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 72.29 | 72.25 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 71.93 | 71.99 | |
| K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 71.86 | 71.73 | |
| SpectralLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 71.5 | 71.5 | |
| SpectralLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 71.29 | 71.16 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 71.07 | 70.89 | |
| Spectral Co-ClusteringLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=152026.03 | 70.93 | 70.93 | |
| K-MeansLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 70.71 | 70.49 | |
| SpectralLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=202026.03 | 70.64 | 70.65 | |
| AgglomerativeLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 70.57 | 70.39 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 69.86 | 69.87 | |
| Mini-Batch K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 69.64 | 69.65 | |
| Spectral Co-ClusteringLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 69.57 | 69.59 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=152026.03 | 69.5 | 69.5 | |
| Mini-Batch K-MeansLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 69.29 | 69.27 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 69.29 | 69.09 | |
| K-MeansLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 69.07 | 68.72 | |
| Spectral Co-ClusteringLLM=Qwen2.5-1.5B-Instruct, Classifier (Cls.)=LR, Number of clusters (K)=102026.03 | 67.93 | 67.64 | |
| Spectral Co-ClusteringLLM=Qwen2.5-7B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 66.5 | 66.48 | |
| Spectral Co-ClusteringLLM=Qwen2.5-3B-Instruct, Classifier (Cls.)=SVC, Number of clusters (K)=102026.03 | 66.21 | 66.23 |