Semantic Identity Recovery on Semantic Section Exemplars Layer 16
100Section Recoverysemantic section
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| semantic sectionModel=Llama 3.2 3B Instruct, Layer=16, Type=Globalizable, Seed=(12, 11), Support=6, Cycles=1, Pairs=152026.03 | 100 | 26.67 | 0 | 0 | 21.39 | 7.96 | |
| semantic sectionModel=Llama 3.2 3B Instruct, Layer=16, Type=Twisted, Seed=(15, 0), Support=4, Cycles=1, Pairs=62026.03 | 100 | 33.33 | 16.67 | 0 | 24.75 | 6.15 | |
| semantic sectionModel=Llama 3.2 3B Instruct, Layer=16, Type=Tree-local, Seed=(11, 9), Support=5, Cycles=0, Pairs=102026.03 | 100 | 50 | 30 | 0 | 30.28 | 7.01 | |
| semantic sectionModel=Llama 3.2 3B Instruct, Layer=16, Type=Tree-local, Seed=(0, 5), Support=4, Cycles=0, Pairs=62026.03 | 100 | 16.67 | 16.67 | 0 | 12.46 | 2.84 | |
| semantic sectionModel=Qwen 2.5 3B Instruct, Layer=16, Type=Tree-local, Seed=(5, 0), Support=15, Cycles=0, Pairs=1052026.03 | 100 | 56.19 | 31.43 | 5.71 | 34.83 | 0.55 | |
| semantic sectionModel=Qwen 2.5 3B Instruct, Layer=16, Type=Globalizable, Seed=(14, 10), Support=9, Cycles=1, Pairs=362026.03 | 100 | 25 | 0 | 0 | 18.14 | 0.69 | |
| semantic sectionModel=Qwen 2.5 3B Instruct, Layer=16, Type=Twisted, Seed=(14, 17), Support=9, Cycles=2, Pairs=362026.03 | 100 | 13.89 | 0 | 0 | 15.36 | 0.05 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Globalizable, Seed=(14, 4), Support=23, Cycles=9, Pairs=2532026.03 | 100 | 30.83 | 4.74 | 0 | 23.09 | 0.37 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Globalizable, Seed=(5, 1), Support=21, Cycles=8, Pairs=2102026.03 | 100 | 19.52 | 4.29 | 0 | 19.21 | 0.06 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Twisted, Seed=(13, 9), Support=14, Cycles=4, Pairs=912026.03 | 100 | 12.09 | 1.1 | 0 | 15.65 | 1 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Twisted, Seed=(10, 10), Support=10, Cycles=1, Pairs=452026.03 | 100 | 17.78 | 0 | 0 | 15.55 | 0.36 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Tree-local, Seed=(3, 13), Support=8, Cycles=0, Pairs=282026.03 | 100 | 10.71 | 0 | 0 | 16.93 | 0.74 | |
| semantic sectionModel=Gemma 2 2B IT, Layer=16, Type=Tree-local, Seed=(13, 2), Support=5, Cycles=0, Pairs=102026.03 | 100 | 20 | 10 | 0 | 19.74 | 2.48 |