Meeting Summarization on SamSum
6.4347HPIGemma 7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Gemma 7BFramework=Adaptive HPF, Threshold=0.202024.06 | 6.4347 | — | |
| Phi-3 3.8BFramework=Adaptive HPF, Threshold=0.202024.06 | 5.7778 | — | |
| Gemma 7BFramework=Adaptive HPF, Threshold=0.152024.06 | 5.7229 | — | |
| Llama-3 8BFramework=Adaptive HPF, Threshold=0.202024.06 | 5.5756 | — | |
| Mistral 7BFramework=Adaptive HPF, Threshold=0.202024.06 | 5.1336 | — | |
| Phi-3 3.8BFramework=Adaptive HPF, Threshold=0.152024.06 | 5.0961 | — | |
| Llama-3 8BFramework=Adaptive HPF, Threshold=0.152024.06 | 5.0316 | — | |
| Gemma 7BThreshold=0.202024.06 | 5.03 | 10 | |
| Mistral 7BFramework=Adaptive HPF, Threshold=0.152024.06 | 4.7423 | — | |
| Gemma 7BThreshold=0.152024.06 | 3.31 | 11 | |
| Gemma-2 9BThreshold=0.202024.06 | 1.86 | 22 | |
| Llama-3 8BThreshold=0.202024.06 | 1.72 | 22 | |
| Mistral 7BThreshold=0.202024.06 | 1.68 | 22 | |
| Claude 3.5 SonnetThreshold=0.202024.06 | 1.6 | 23 | |
| Mistral-Nemo 12BThreshold=0.202024.06 | 1.47 | 24 | |
| Gemma-2 9BThreshold=0.152024.06 | 1.3 | 22 | |
| Llama-3 8BThreshold=0.152024.06 | 1.3 | 22 | |
| Mistral 7BThreshold=0.152024.06 | 1.26 | 21 | |
| Claude 3.5 SonnetThreshold=0.152024.06 | 1.25 | 23 | |
| GPT-4oThreshold=0.202024.06 | 1.21 | 29 | |
| Mistral-Nemo 12BThreshold=0.152024.06 | 1.19 | 23 | |
| GPT-4oThreshold=0.152024.06 | 1.11 | 30 | |
| OmniVecModality=Text2025.07 | — | 54.6 | |
| OmniVec2Modality=Text2025.07 | — | 55.4 |