Role-playing performance on Role-playing Artifacts Minor characters 1.0 benchmark leaderboard · SOTA2 Research

Role-playing performance on Role-playing Artifacts Minor characters 1.0

83.26Score (K-On!)Codified FSM

Evaluation Results

Method	Links
Codified FSM2026.02		83.26	—	80.92	85.74	89.16	83.94	84.6
Plot Summary2026.02		82.34	—	80.61	85.1	88.76	82.79	83.92
PromptTrans2026.02		82.17	—	81.72	83.16	86.88	82.61	83.31
Character Updating2026.02		82.13	—	80.39	85.49	89.13	82.57	83.59
Codified Profile2026.02		81.54	—	80.58	85.91	88.91	82.16	83.82
Textual Profile2026.02		81.31	—	78.14	83.33	86.96	86.34	83.22
Vanilla (No Profile)2026.02		80.17	—	78.64	83.15	87.44	82.46	82.37