Binary Classification on LIAR Closed
79.15AccuracyTELLER
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TELLERLLM=GPT-3.5-turbo2024.02 | 79.15 | 78.9 | |
| w/ InterventionLLM=Llama2 (13B)2024.02 | 67.73 | 66.97 | |
| w/ InterventionLLM=FLAN-T5-xxl (11B)2024.02 | 67.03 | 66.19 | |
| TELLERLLM=FLAN-T5-large (780M)2024.02 | 66.83 | 66.33 | |
| TELLERLLM=FLAN-T5-xxl (11B)2024.02 | 66.63 | 65.91 | |
| TELLERLLM=Llama2 (13B)2024.02 | 66.04 | 66.03 | |
| w/ InterventionLLM=FLAN-T5-large (780M)2024.02 | 65.64 | 65.12 | |
| w/ InterventionLLM=Llama2 (7B)2024.02 | 64.15 | 62.77 | |
| w/ InterventionLLM=FLAN-T5-xl (3B)2024.02 | 63.65 | 61.82 | |
| TELLERLLM=Llama2 (7B)2024.02 | 62.46 | 62.45 | |
| TELLERLLM=FLAN-T5-xl (3B)2024.02 | 62.36 | 60.18 | |
| Few-shotLLM=GPT-3.5-turbo2024.02 | 61.67 | 64.05 | |
| DirectLLM=Llama2 (7B)2024.02 | 59.88 | 59.19 | |
| DirectLLM=FLAN-T5-xl (3B)2024.02 | 58.89 | 58.62 | |
| DirectLLM=FLAN-T5-large (780M)2024.02 | 57.3 | 52.2 | |
| DirectLLM=Llama2 (13B)2024.02 | 56.9 | 56.9 | |
| DirectLLM=FLAN-T5-xxl (11B)2024.02 | 56.41 | 56.08 | |
| DirectLLM=FLAN-T5-base (250M)2024.02 | 54.02 | 50.79 | |
| Few-shot COTLLM=GPT-3.5-turbo2024.02 | 52.04 | 56.15 | |
| Few-shot LogicLLM=GPT-3.5-turbo2024.02 | 49.26 | 48.85 | |
| DirectLLM=FLAN-T5-small (80M)2024.02 | 44.99 | 31.63 | |
| DirectLLM=GPT-3.5-turbo2024.02 | 42.4 | 51.48 | |
| Zero-shot COTLLM=GPT-3.5-turbo2024.02 | 30.88 | 41.87 |