List your company
ResearchFormerly WizWand

Dialogue Agent Interaction on DEMO Average

8.14Goal Achievement ScoreLlama3.1-8B-Instruct w/ AMPO
7.58887.73197.8758.0181May 4, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Llama3.1-8B-Instruct w/ AMPOInteraction Partner=GPT-4o, Base Model=Llama3.1-8B-Instruct2025.058.14
Llama3.1-8B-Instruct w/ GRPOInteraction Partner=GPT-4o, Base Model=Llama3.1-8B-Instruct2025.058.06
Llama3.1-8B-Instruct w/ AMPOInteraction Partner=Claude-3.5-Sonnet, Base Model=Llama3.1-8B-Instruct2025.058.05
Llama3.1-8B-InstructInteraction Partner=GPT-4o, Base Model=Llama3.1-8B-Instruct2025.057.92
Llama3.1-8B-Instruct w/ GRPOInteraction Partner=Claude-3.5-Sonnet, Base Model=Llama3.1-8B-Instruct2025.057.89
Qwen2.5-7B-Instruct w/ AMPOInteraction Partner=Claude-3.5-Sonnet, Base Model=Qwen2.5-7B-Instruct2025.057.86
Qwen2.5-7B-Instruct w/ GRPOInteraction Partner=Claude-3.5-Sonnet, Base Model=Qwen2.5-7B-Instruct2025.057.83
Qwen2.5-7B-Instruct w/ AMPOInteraction Partner=GPT-4o, Base Model=Qwen2.5-7B-Instruct2025.057.81
Qwen2.5-7B-Instruct w/ GRPOInteraction Partner=GPT-4o, Base Model=Qwen2.5-7B-Instruct2025.057.72
Qwen2.5-7B-InstructInteraction Partner=GPT-4o, Base Model=Qwen2.5-7B-Instruct2025.057.65
Llama3.1-8B-InstructInteraction Partner=Claude-3.5-Sonnet, Base Model=Llama3.1-8B-Instruct2025.057.63
Qwen2.5-7B-InstructInteraction Partner=Claude-3.5-Sonnet, Base Model=Qwen2.5-7B-Instruct2025.057.61