Knowledge Insertion on WikiData recent (test)
100Edit Success RateFT-M
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FT-MBackbone=Llama2-7b-chat2024.06 | 100 | 59.28 | 41.54 | 587.17 | 70.64 | |
| ICEBackbone=Llama2-7b-chat2024.06 | 100 | 61.02 | 46.39 | 585.58 | 34.08 | |
| ROMEBackbone=Llama2-7b-chat2024.06 | 97.25 | 36.58 | 30.4 | 581 | 107.47 | |
| MEMITBackbone=Llama2-7b-chat2024.06 | 97.03 | 37 | 29.28 | 573.06 | 87.17 | |
| FT-LBackbone=Llama2-7b-chat2024.06 | 45.63 | 34.73 | 34.8 | 558.91 | 68.92 |