Instruction Awareness on IntEmo (test)
0.9107Spearman CorrelationINBEDDER
Evaluation Results
| Method | Links | |
|---|---|---|
| INBEDDERBackbone=roberta-large, Encoding Method=avg-gen2024.02 | 0.9107 | |
| AlpacaBackbone=roberta-large, Encoding Method=avg-gen2024.02 | 0.9034 | |
| INBEDDERBackbone=opt-1.3b, Encoding Method=1st-gen2024.02 | 0.8996 | |
| INBEDDERBackbone=llama-2-7b, Encoding Method=1st-gen2024.02 | 0.8968 | |
| INBEDDERBackbone=opt-2.7b, Encoding Method=1st-gen2024.02 | 0.8454 | |
| llama-2-7bProcessing=without, Encoding Method=1st-gen2024.02 | 0.8364 | |
| llama-2-7b-chatInference Protocol=re-enc2024.02 | 0.7932 | |
| AlpacaBackbone=opt-2.7b, Encoding Method=avg-gen2024.02 | 0.7509 | |
| llama-2-13b-chatInference Protocol=re-enc2024.02 | 0.736 | |
| AlpacaBackbone=opt-1.3b, Encoding Method=avg-gen2024.02 | 0.7151 | |
| instructor-large2024.02 | 0.4796 | |
| e5-large-v2instruction=without2024.02 | 0.3024 |