Email Writing on Email Writing
1,851Edit DistanceOracle Preference
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Oracle PreferenceDescription=Uses true user preference2024.04 | 1,851 | 100 | 1.62 | |
| CIPHER-5-BERTk=5, Encoder model=BERT2024.04 | 8,391 | 36.3 | 2.22 | |
| CIPHER-5-MPNETk=5, Encoder model=MPNET2024.04 | 10,058 | 46.7 | 2.09 | |
| CIPHER-1-MPNETk=1, Encoder model=MPNET2024.04 | 10,781 | 43.5 | 1.94 | |
| CIPHER-1-BERTk=1, Encoder model=BERT2024.04 | 12,634 | 48.7 | 1.99 | |
| CoT-edit-5-MPNETk=5, Encoder model=MPNET2024.04 | 24,292 | 30 | 8.74 | |
| CoT-edit-5-BERTk=5, Encoder model=BERT2024.04 | 24,301 | 26.3 | 8.26 | |
| E-then-e LPIProtocol=Learn context-agnostic preferences2024.04 | 24,562 | 26.3 | 1.73 | |
| Continual LPIProtocol=Learn context-agnostic preferences2024.04 | 26,852 | 24.3 | 8.63 | |
| ICL-edit-5-BERTk=5, Encoder model=BERT2024.04 | 30,949 | — | 11.55 | |
| No Learning2024.04 | 31,103 | — | 1.65 | |
| ICL-edit-5-MPNETk=5, Encoder model=MPNET2024.04 | 32,405 | — | 12.12 |