Hallucination Evaluation on LaMini-Hallucination 1.0 (test)
40TotalAlpaca-7B
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Alpaca-7BParameters=7B2023.04 | 40 | 10 | 10 | 10 | 10 | |
| LaMini-GPT-124MParameters=124M, Backbone=GPT2023.04 | 40 | 10 | 10 | 10 | 10 | |
| LaMini-GPT-774MParameters=774M, Backbone=GPT2023.04 | 38 | 9 | 10 | 9 | 10 | |
| LaMini-Flan-T5-77MParameters=77M, Backbone=Flan-T52023.04 | 36 | 10 | 9 | 10 | 7 | |
| LaMini-GPT-1.5BParameters=1.5B, Backbone=GPT2023.04 | 35 | 10 | 9 | 9 | 7 | |
| LaMini-Flan-T5-248MParameters=248M, Backbone=Flan-T52023.04 | 34 | 10 | 7 | 10 | 7 | |
| LaMini-Flan-T5-783MParameters=783M, Backbone=Flan-T52023.04 | 32 | 10 | 8 | 8 | 6 | |
| LaMini-GPT-J-6BParameters=6B, Backbone=GPT-J2023.04 | 26 | 9 | 8 | 5 | 4 | |
| LaMini-LLAMA-7BParameters=7B, Backbone=LLAMA2023.04 | 12 | 4 | 5 | 2 | 1 | |
| gpt-3.5-turbo2023.04 | 1 | 1 | 0 | 0 | 0 |