List your company
ResearchFormerly WizWand

Action Planning on Mind2Web high-level setting new

49.08AccuracyWebNaviX +R (our)
26.116832.078438.0444.0016Sep 3, 2024
Updated 8mo ago

Evaluation results

MethodLinks
WebNaviX +R (our)Learning Protocol=In-Context Learning, Model=GPT-4o, Vision=Y, PU=Our-PU2024.0949.08
WebNaviX (our)Learning Protocol=In-Context Learning, Model=GPT-4o, Vision=Y, PU=Our-PU2024.0947.37
MindActLearning Protocol=Supervised Fine-Tuning, Model=Flan-T5XL, Vision=N, PU=DeBERTa2024.0946.75
MindActLearning Protocol=Supervised Fine-Tuning, Model=Flan-T5L, Vision=N, PU=DeBERTa2024.0944.1
SeeActLearning Protocol=In-Context Learning, Model=GPT-4o, Vision=Y, PU=DeBERTa2024.0943.1
WebNaviX (our)Learning Protocol=In-Context Learning, Model=GPT-4o, Vision=N, PU=Our-PU2024.0940.68
MindActLearning Protocol=In-Context Learning, Model=GPT-4o, Vision=N, PU=DeBERTa2024.0936.27
WebNaviX (our)Learning Protocol=In-Context Learning, Model=Lamma3 70B, Vision=N, PU=Our-PU2024.0935.13
WebVoyLearning Protocol=In-Context Learning, Model=GPT-4o, Vision=Y, PU=JS2024.0932.86
WebVoyLearning Protocol=In-Context Learning, Model=GPT-4o, Vision=N, PU=JS2024.0927