Conversation Summarization on Bitcoin
85.71QAGSarg-graph
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| arg-graphLLM Backbone=GPT-42026.04 | 85.71 | 57.86 | 4.96 | |
| ThreadSummLLM Backbone=CLAUDE2026.04 | 85.71 | 63.72 | 22.16 | |
| VanillaLLM Backbone=GPT-42026.04 | 71.43 | 48.17 | 5.44 | |
| CHRONOSLLM Backbone=GPT-42026.04 | 71.43 | 46.26 | 6 | |
| CHRONOSLLM Backbone=CLAUDE2026.04 | 71.43 | 67.73 | 4.96 | |
| ThreadSummLLM Backbone=LLAMA2026.04 | 71.43 | 59.36 | 20.08 | |
| ThreadSummLLM Backbone=GPT-42026.04 | 57.14 | 40.07 | 15.28 | |
| mRedditSummLLM Backbone=CLAUDE2026.04 | 57.14 | 62.28 | 5.2 | |
| VanillaLLM Backbone=LLAMA2026.04 | 57.14 | 41.33 | 6.08 | |
| CHRONOSLLM Backbone=LLAMA2026.04 | 42.86 | 31.67 | 5.2 | |
| mRedditSummLLM Backbone=GPT-42026.04 | 28.57 | 61.08 | 5.92 | |
| VanillaLLM Backbone=CLAUDE2026.04 | 28.57 | 45.54 | 4.56 | |
| arg-graphLLM Backbone=CLAUDE2026.04 | 28.57 | 57.44 | 6.72 | |
| arg-graphLLM Backbone=LLAMA2026.04 | 28.57 | 49.8 | 6.16 | |
| mRedditSummLLM Backbone=LLAMA2026.04 | 28.57 | 45.52 | 6.24 | |
| ThreadSummevaluation=LLM-as-a-judge2026.04 | 10 | 10 | 9 | |
| mRedditSummevaluation=LLM-as-a-judge2026.04 | 9 | 8 | 8 | |
| ThreadSummevaluation=LLM-as-a-judge2026.04 | 9 | 9 | 8 | |
| Vanillaevaluation=LLM-as-a-judge2026.04 | 8 | 8 | 8 | |
| CHRONOSevaluation=LLM-as-a-judge2026.04 | 8 | 9 | 8 | |
| mRedditSummevaluation=LLM-as-a-judge2026.04 | 8 | 8 | 8 | |
| Vanillaevaluation=LLM-as-a-judge2026.04 | 7 | 8 | 6 | |
| arg-graphevaluation=LLM-as-a-judge2026.04 | 7 | 7 | 7 | |
| CHRONOSevaluation=LLM-as-a-judge2026.04 | 7 | 8 | 7 | |
| arg-graphevaluation=LLM-as-a-judge2026.04 | 6 | 8 | 7 |