Table Fact Verification on TabFact full (test)
90.09Simple AccuracyTab-PoT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Tab-PoTLLM=DeepSeek-67B2024.06 | 90.09 | 78.91 | 82.58 | |
| COTLLM=DeepSeek-67B2024.06 | 87.44 | 78 | 81.1 | |
| Tab-PoTLLM=Mixtral-8x7B2024.06 | 86.49 | 76.06 | 79.49 | |
| DirectLLM=DeepSeek-67B2024.06 | 84.36 | 74.19 | 77.53 | |
| COTLLM=Mixtral-8x7B2024.06 | 83.53 | 74.94 | 77.77 | |
| DirectLLM=Mixtral-8x7B2024.06 | 80.59 | 69.98 | 73.47 | |
| Tab-PoTLLM=Mixtral-7B2024.06 | 77.48 | 66.83 | 69.75 | |
| POTLLM=DeepSeek-67B2024.06 | 74.43 | 71.79 | 72.65 | |
| DirectLLM=Mixtral-7B2024.06 | 73.57 | 64.83 | 67.7 | |
| POTLLM=Mixtral-8x7B2024.06 | 73.33 | 69.07 | 70.47 | |
| COTLLM=Mixtral-7B2024.06 | 73.31 | 67.52 | 69.43 | |
| Tab-PoTLLM=DeepSeek-7B2024.06 | 70.42 | 62.13 | 64.86 | |
| COTLLM=DeepSeek-7B2024.06 | 69.31 | 61.18 | 63.85 | |
| POTLLM=Mixtral-7B2024.06 | 66.11 | 63.58 | 64.41 | |
| POTLLM=DeepSeek-7B2024.06 | 63.71 | 58.26 | 60.06 | |
| DirectLLM=DeepSeek-7B2024.06 | 59.16 | 55.42 | 56.65 |