Text Classification on Call Playbook (test)
72.6Macro F1Description-Ex
Evaluation results
| Method | Links | |
|---|---|---|
| Description-ExN Shots=1002026.06 | 72.6 | |
| Description-ExN Shots=502026.06 | 72.5 | |
| Description-ExN Shots=752026.06 | 72.3 | |
| Description-ExN Shots=Avg2026.06 | 72.1 | |
| Description-ExN Shots=252026.06 | 72 | |
| Criteria-ExN Shots=252026.06 | 71.9 | |
| Description-ExN Shots=102026.06 | 71.9 | |
| Description-ExN Shots=02026.06 | 71.5 | |
| Selective Context (SC)N Shots=0, Compression Rate=50%2026.06 | 71.4 | |
| Criteria-ExN Shots=102026.06 | 71.2 | |
| Criteria-ExN Shots=502026.06 | 70.6 | |
| Criteria-ExN Shots=Avg2026.06 | 70.6 | |
| Criteria-ExN Shots=752026.06 | 70.4 | |
| Criteria-ExN Shots=1002026.06 | 70.3 | |
| Selective Context (SC)N Shots=10, Compression Rate=50%2026.06 | 69.8 | |
| Criteria-ExN Shots=02026.06 | 69.3 | |
| Selective Context (SC)N Shots=25, Compression Rate=50%2026.06 | 67.4 | |
| Selective Context (SC)N Shots=Avg, Compression Rate=50%2026.06 | 66.5 | |
| Selective Context (SC)N Shots=50, Compression Rate=50%2026.06 | 64.7 | |
| Selective Context (SC)N Shots=75, Compression Rate=50%2026.06 | 63.8 | |
| Selective Context (SC)N Shots=100, Compression Rate=50%2026.06 | 62.1 | |
| LLMLingua-2N Shots=10, Compression Rate=50%2026.06 | 49.1 | |
| LLMLingua-2N Shots=50, Compression Rate=50%2026.06 | 49 | |
| LLMLingua-2N Shots=25, Compression Rate=50%2026.06 | 48.9 | |
| LLMLingua-2N Shots=Avg, Compression Rate=50%2026.06 | 48 | |
| LLMLingua-2N Shots=100, Compression Rate=50%2026.06 | 47.6 | |
| LLMLingua-2N Shots=75, Compression Rate=50%2026.06 | 46.8 | |
| LLMLingua-2N Shots=0, Compression Rate=50%2026.06 | 46.4 |