LTP (Long-term Temporal Profile) 10 profiles (800 judged probes) (Full)
100Bank CoexistAtomMem
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| AtomMemModeled Level: Bank=✗, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 53.9 | 38.1 | 52.2 | 24 | 31.1 | 8.14 | |
| MemoryLLMModeled Level: Bank=✗, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 51.1 | 40 | 48.7 | 31.2 | 33.9 | 8.43 | |
| M+Modeled Level: Bank=✗, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 52.7 | 40.9 | 49 | 32.8 | 34.7 | 7.71 | |
| AriadneMemModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 65.6 | 45.3 | 51.2 | 39.3 | 38.1 | 6.86 | |
| A-MemModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✗, N=8002026.07 | 100 | 56.8 | 91.6 | 78.7 | 81.2 | 76.2 | 70 | 2.36 | |
| A-Mem+A-TMAModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✓, N=8002026.07 | 100 | 82.5 | 92.5 | 81.8 | 86 | 77.5 | 69.8 | 1.79 | |
| Graphiti/ZepModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 71.1 | 52.4 | 48 | 56.8 | 47.3 | 6.57 | |
| Graphiti/Zep +A-TMAModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✓, N=8002026.07 | 100 | 77.5 | 80.9 | 63.5 | 72 | 55 | 55.9 | 5.43 | |
| InsideOutModeled Level: Bank=✓, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 100 | 0 | 23.9 | 11.7 | 17.5 | 6 | 11.5 | 10.43 | |
| InsideOut+A-TMAModeled Level: Bank=✓, Modeled Level: Ret.=✓, Modeled Level: QA=✓, N=8002026.07 | 100 | 64.2 | 84.8 | 66.2 | 68 | 64.5 | 56.1 | 4.57 | |
| SeComModeled Level: Bank=✗, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 99 | 0 | 86.4 | 65.5 | 73.3 | 57.8 | 56.4 | 5.07 | |
| Mem0Modeled Level: Bank=✗, Modeled Level: Ret.=✗, Modeled Level: QA=✗, N=8002026.07 | 0.7 | 0 | 30.2 | 18.8 | 25.8 | 11.7 | 17.4 | 10.64 |