Response correctness and completeness evaluation on Medical Q.
88F1 ScoreRandomTrim
Evaluation results
| Method | Links | |
|---|---|---|
| RandomTrimLLM=Llama-3-70B, n_desired=n_capable2025.06 | 88 | |
| HALTLLM=Llama-3-70B, n_desired=n_capable2025.06 | 88 | |
| UnchangedLLM=Llama-3-70B, n_desired=n_capable2025.06 | 87 | |
| HALTLLM=Gemma-2-9B, n_desired=n_capable2025.06 | 86 | |
| RandomTrimLLM=Llama-3-8B, n_desired=n_capable2025.06 | 82 | |
| RandomTrimLLM=Llama-3-70B, n_desired=n_all2025.06 | 82 | |
| Abstain (IDK)LLM=Llama-3-70B, n_desired=n_capable2025.06 | 82 | |
| UnchangedLLM=Gemma-2-9B, n_desired=n_capable2025.06 | 82 | |
| RandomTrimLLM=Gemma-2-9B, n_desired=n_capable2025.06 | 82 | |
| UnchangedLLM=Llama-3-8B, n_desired=n_capable2025.06 | 81 | |
| HALTLLM=Llama-3-8B, n_desired=n_capable2025.06 | 81 | |
| HALTLLM=Llama-3-70B, n_desired=n_all2025.06 | 81 | |
| UnchangedLLM=Mistral-7B, n_desired=n_capable2025.06 | 81 | |
| HALTLLM=Mistral-7B, n_desired=n_capable2025.06 | 81 | |
| UnchangedLLM=Llama-3-70B, n_desired=n_all2025.06 | 80 | |
| RandomTrimLLM=Mistral-7B, n_desired=n_capable2025.06 | 80 | |
| Abstain (IDK)LLM=Gemma-2-9B, n_desired=n_capable2025.06 | 79 | |
| Abstain (IDK)LLM=Llama-3-70B, n_desired=n_all2025.06 | 75 | |
| HALTLLM=Gemma-2-9B, n_desired=n_all2025.06 | 74 | |
| Abstain (IDK)LLM=Mistral-7B, n_desired=n_capable2025.06 | 73 | |
| RandomTrimLLM=Gemma-2-9B, n_desired=n_all2025.06 | 72 | |
| UnchangedLLM=Gemma-2-9B, n_desired=n_all2025.06 | 71 | |
| UnchangedLLM=Llama-3-8B, n_desired=n_all2025.06 | 70 | |
| RandomTrimLLM=Llama-3-8B, n_desired=n_all2025.06 | 70 | |
| Abstain (IDK)LLM=Llama-3-8B, n_desired=n_capable2025.06 | 69 | |
| UnchangedLLM=Mistral-7B, n_desired=n_all2025.06 | 69 | |
| HALTLLM=Llama-3-8B, n_desired=n_all2025.06 | 68 | |
| Abstain (IDK)LLM=Gemma-2-9B, n_desired=n_all2025.06 | 67 | |
| HALTLLM=Mistral-7B, n_desired=n_all2025.06 | 66 | |
| RandomTrimLLM=Mistral-7B, n_desired=n_all2025.06 | 64 | |
| Abstain (IDK)LLM=Llama-3-8B, n_desired=n_all2025.06 | 58 | |
| Abstain (IDK)LLM=Mistral-7B, n_desired=n_all2025.06 | 56 |