Relational Reasoning on Chinese Kinship
71.2AccuracyPoT-LLM
Evaluation Results
| Method | Links | |
|---|---|---|
| PoT-LLMLLM=GPT-4o, Category=Prompting-based2024.12 | 71.2 | |
| CoTLLM=GPT-4o, Category=Prompting-based2024.12 | 68.5 | |
| CoT-SCLLM=GPT-4o, Category=Prompting-based2024.12 | 68.5 | |
| Zero-shotLLM=GPT-4o, Category=Prompting-based2024.12 | 67.1 | |
| Few-shotLLM=GPT-4o, Category=Prompting-based2024.12 | 65.8 | |
| PoT-LLMLLM=GPT-4-turbo, Category=Prompting-based2024.12 | 53.4 | |
| CoT-SCLLM=GPT-4-turbo, Category=Prompting-based2024.12 | 46.6 | |
| Zero-shotLLM=GPT-4-turbo, Category=Prompting-based2024.12 | 45.2 | |
| CoTLLM=GPT-4-turbo, Category=Prompting-based2024.12 | 39.7 | |
| Few-shotLLM=GPT-4-turbo, Category=Prompting-based2024.12 | 37 | |
| Few-shotLLM=Llama3-70B, Category=Prompting-based2024.12 | 35.6 | |
| PoT-LLMLLM=Llama3-70B, Category=Prompting-based2024.12 | 35.6 | |
| Zero-shotLLM=Llama3-70B, Category=Prompting-based2024.12 | 31.5 | |
| PoT-LLMLLM=GPT-3.5-turbo, Category=Prompting-based2024.12 | 27.4 | |
| CoTLLM=Llama3-70B, Category=Prompting-based2024.12 | 27.4 | |
| CoT-SCLLM=Llama3-70B, Category=Prompting-based2024.12 | 27.4 | |
| CoT-SCLLM=GPT-3.5-turbo, Category=Prompting-based2024.12 | 24.7 | |
| Few-shotLLM=GPT-3.5-turbo, Category=Prompting-based2024.12 | 23.3 | |
| CoTLLM=GPT-3.5-turbo, Category=Prompting-based2024.12 | 21.9 | |
| Zero-shotLLM=GPT-3.5-turbo, Category=Prompting-based2024.12 | 20.5 |