Text Completion on OpenGen (test)
95.88Bit Accuracy (BA)XMARK
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| XMARKmessage length (b)=16, available tokens (T)=3002026.04 | 95.88 | 4.67 | — | — | |
| XMARKmessage length (b)=16, available tokens (T)=2502026.04 | 95.25 | 4.66 | — | — | |
| MPACmessage length (b)=16, available tokens (T)=3002026.04 | 92.62 | 4.84 | — | — | |
| XMARKmessage length (b)=16, available tokens (T)=2002026.04 | 91.12 | 4.68 | — | — | |
| XMARKmessage length (b)=16, available tokens (T)=1502026.04 | 90.62 | 4.7 | — | — | |
| MPACmessage length (b)=16, available tokens (T)=2502026.04 | 90.38 | 4.97 | — | — | |
| MPACmessage length (b)=16, available tokens (T)=2002026.04 | 89.25 | 4.98 | — | — | |
| RSBHmessage length (b)=16, available tokens (T)=2502026.04 | 88.25 | 4.72 | — | — | |
| RSBHmessage length (b)=16, available tokens (T)=3002026.04 | 87.12 | 4.56 | — | — | |
| MPACmessage length (b)=16, available tokens (T)=1502026.04 | 84.88 | 5.01 | — | — | |
| RSBHmessage length (b)=16, available tokens (T)=2002026.04 | 81.75 | 4.75 | — | — | |
| StealthInkmessage length (b)=16, available tokens (T)=3002026.04 | 80.12 | 3.85 | — | — | |
| StealthInkmessage length (b)=16, available tokens (T)=2502026.04 | 77.88 | 4.04 | — | — | |
| RSBHmessage length (b)=16, available tokens (T)=1502026.04 | 77 | 4.73 | — | — | |
| StealthInkmessage length (b)=16, available tokens (T)=2002026.04 | 75.75 | 3.98 | — | — | |
| StealthInkmessage length (b)=16, available tokens (T)=1502026.04 | 72.75 | 4.11 | — | — | |
| MPACmessage length (b)=16, available tokens (T)=Average2026.04 | — | — | 89.28 | 4.95 | |
| RSBHmessage length (b)=16, available tokens (T)=Average2026.04 | — | — | 83.53 | 4.69 | |
| StealthInkmessage length (b)=16, available tokens (T)=Average2026.04 | — | — | 76.63 | 3.99 | |
| XMARKmessage length (b)=16, available tokens (T)=Average2026.04 | — | — | 93.22 | 4.68 |