Binary Classification (Assistive vs Creative) on IMDb
1AUCRole-Aware AI
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Role-Aware AIGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 1 | 98 | |
| LogLikelihoodGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 0.95 | 92 | |
| Role-Aware AIGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.9 | 85 | |
| LogLikelihoodGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.89 | 82 | |
| CurvatureGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 0.82 | 78 | |
| RoBERTaGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 0.75 | 69 | |
| CurvatureGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.61 | 58 | |
| RoBERTaGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.58 | 56 | |
| EntropyGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.32 | 51 | |
| LogRankGenerator Model=GPT-2, Generator Parameters=124 million2026.05 | 0.13 | 51 | |
| EntropyGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 0.09 | 50 | |
| LogRankGenerator Model=LLaMA-3-Instruct, Generator Parameters=3 billion2026.05 | 0.04 | 50 |