Text Generation on MedQA
0.944DiversityInferDPT + RANTEXT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| InferDPT + RANTEXTε=10.02023.10 | 0.944 | 0.664 | 0.68 | |
| Claude-3.5-haiku2023.10 | 0.942 | 0.733 | 0.753 | |
| InferDPT + RANTEXTε=6.02023.10 | 0.939 | 0.643 | 0.676 | |
| InferDPT + RANTEXTε=2.02023.10 | 0.938 | 0.633 | 0.661 | |
| InferDPT + SANTEXT+ε=2.02023.10 | 0.937 | 0.562 | 0.525 | |
| InferDPT + SANTEXT+ε=6.02023.10 | 0.936 | 0.576 | 0.552 | |
| InferDPT + SANTEXT+ε=10.02023.10 | 0.933 | 0.582 | 0.576 | |
| InferDPT + CUSTEXT+ε=6.02023.10 | 0.925 | 0.649 | 0.668 | |
| InferDPT + CUSTEXT+ε=2.02023.10 | 0.923 | 0.631 | 0.641 | |
| InferDPT + CUSTEXT+ε=10.02023.10 | 0.92 | 0.656 | 0.69 | |
| Llama3.1-8b-4bit (4.9GB)2023.10 | 0.678 | 0.562 | 0.55 |