Synthetic Text Evaluation on Yelp non-IID
0.3751MAUVE ScoreFederated Controllable Text Generation
Evaluation results
| Method | Links | |
|---|---|---|
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.3751 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.3702 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.3658 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.364 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.352 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.3487 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.3465 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.3381 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2912 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2808 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2785 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2675 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2674 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.26 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2586 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2543 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.251 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2474 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2463 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2425 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2414 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.241 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2374 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2372 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2312 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2298 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.2266 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2258 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2204 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.2174 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.2128 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2122 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.211 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.2092 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.2047 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.2016 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.1988 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1987 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1982 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1975 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.1969 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1952 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1946 | |
| Federated Controllable Text GenerationRating classes=1, 3, & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.1924 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.1921 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1915 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1911 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=∞, Refinement=true, Embedding Model=GPT-22026.03 | 0.1907 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1907 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.1808 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.1634 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.1617 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-2-l2026.03 | 0.1552 | |
| Federated Controllable Text GenerationRating classes=3 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1501 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=8, Refinement=true, Embedding Model=GPT-22026.03 | 0.1493 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=8 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1457 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=4 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1456 | |
| Federated Controllable Text GenerationRating classes=1 & 5 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1444 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.143 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=6 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1426 | |
| Federated Controllable Text GenerationRating classes=All, Category classes=2 Categories, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1414 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=∞, Refinement=false, Embedding Model=GPT-22026.03 | 0.1404 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-2-l2026.03 | 0.118 | |
| Federated Controllable Text GenerationRating classes=1 & 3 stars, Category classes=All, Epsilon (ε)=8, Refinement=false, Embedding Model=GPT-22026.03 | 0.1105 |