Sentiment Analysis on CARMA PRTG-level
0.39Min ValueTest(12)
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Test(12)variant=52026.06 | 0.39 | 0.19 | 0.05 | 0.79 | 0.56 | 0.08 | 0.7 | 4.96 | |
| Test(1)2026.06 | 0.26 | 0.06 | 0.01 | 0.9 | 0.7 | 0.17 | 0.97 | -1.48 | |
| Test(4)2026.06 | 0.22 | 0.07 | 0.01 | 0.9 | 0.7 | 0.19 | 0.76 | -1.48 | |
| Test(2)2026.06 | 0.2 | 0.05 | 0.01 | 0.95 | 0.67 | 0.22 | 0.95 | 1.37 | |
| Test(9)2026.06 | 0.18 | 0.16 | 0.04 | 0.9 | 0.55 | 0.14 | 0.85 | 7.39 | |
| Test(6)Model=GPT-4o, Runs=32026.06 | 0.14 | 0.07 | 0.01 | 0.96 | 0.68 | 0.24 | 0.94 | 0.06 | |
| Gold Standard2026.06 | 0.13 | — | — | 0.93 | 0.68 | 0.23 | — | — | |
| Test(3)2026.06 | 0.13 | 0.05 | 0 | 0.94 | 0.67 | 0.23 | 0.97 | 0.85 | |
| Test(5)Model=GPT-4o, Runs=32026.06 | 0.08 | 0.06 | 0.01 | 0.94 | 0.66 | 0.27 | 0.96 | 6.25 | |
| Test(11)2026.06 | 0.06 | 0.16 | 0.05 | 0.99 | 0.76 | 0.28 | 0.71 | -2.9 | |
| Test(7)Model=GPT-4o-mini, Runs=32026.06 | 0.05 | 0.07 | 0.01 | 0.95 | 0.66 | 0.28 | 0.96 | 5.98 | |
| Test(10)2026.06 | 0.03 | 0.13 | 0.03 | 0.98 | 0.62 | 0.32 | 0.89 | 2.79 | |
| Test(8)Model=GPT-4o-mini, Runs=32026.06 | 0 | 0.09 | 0.01 | 1 | 0.64 | 0.29 | 0.93 | 3.05 |