List your company

Dialogue State Transition Prediction on PFDial OOD 1.0 (test)

97.29AccLLaMA-3.1-8B
9.836432.540755.24577.9493Mar 9, 2025

Evaluation results

MethodLinks
LLaMA-3.1-8BTraining Setting=Fine-tuned on PFDial2025.0397.2996.8897.35
Qwen2.5-7BTraining Setting=Fine-tuned on PFDial2025.0396.5190.6597.47
LLaMA-3.2-3BTraining Setting=Fine-tuned on PFDial2025.0395.8191.3796.53
Qwen2.5-3BTraining Setting=Fine-tuned on PFDial2025.0394.9789.6995.84
Qwen2.5-1.5BTraining Setting=Fine-tuned on PFDial2025.039488.9794.82
LLaMA-3.2-1BTraining Setting=Fine-tuned on PFDial2025.0393.5787.0594.62
Qwen2.5-0.5BTraining Setting=Fine-tuned on PFDial2025.0391.3589.4591.66
GPT-4oTraining Setting=Instruction-tuned baseline2025.0386.2951.891.9
GPT-3.5-TurboTraining Setting=Instruction-tuned baseline2025.0379.7639.5786.29
DeepSeek-v3Training Setting=Instruction-tuned baseline2025.0379.0247.7284.11
Gemini-2.0-Flash-ExpTraining Setting=Instruction-tuned baseline2025.0375.1747.4879.66
Qwen2.5-7B-InstructTraining Setting=Instruction-tuned baseline2025.0365.8737.8871.34
Claude-3.5-SonnetTraining Setting=Instruction-tuned baseline2025.0362.7422.0669.4
LLaMA-3.1-8B-InstructTraining Setting=Instruction-tuned baseline2025.0313.22.1615