Movie Recommendation on BIG-bench Hard Movie Recommendation (test)
79Test AccuracyPE2
Evaluation Results
| Method | Links | |
|---|---|---|
| PE2Final Prompt=Considering factors such as genre, director, actors, release period, audience target, animation style, and humor, analyze the similarities among the given movies and identify the movie from the options that shares the most similarities., Task Model=gpt-3.5-turbo-instruct, Prompt Proposal Model=gpt-42023.11 | 79 | |
| APOFinal Prompt=Identify the movie that shares the most significant themes and narrative structure with the given movies. Prioritize these factors over tone and pacing. Choose the most similar movie from the options, explaining your choice., Task Model=gpt-3.5-turbo-instruct, Prompt Proposal Model=gpt-42023.11 | 75 | |
| Iterative APEFinal Prompt=Let's dissect it and consider every step in order., Task Model=gpt-3.5-turbo-instruct, Prompt Proposal Model=gpt-42023.11 | 67.3 | |
| Zero-shot CoTFinal Prompt=Let's think step by step., Task Model=gpt-3.5-turbo-instruct, Prompt Proposal Model=gpt-42023.11 | 57 |