MEP-Lobby link discovery on Meetings
78AUCSS
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SSDocument set=D4 (Summaries), Source type=Sp. (Speeches/Speech Summaries), Summary model=ChatGPT2023.09 | 78 | 17.6 | |
| EntDocument set=D4 (Summaries), Source type=Sp. (Speeches/Speech Summaries), Summary model=ChatGPT2023.09 | 77.4 | 17.5 | |
| SSDocument set=D4 (Summaries), Source type=Amd (Amendments), Summary model=ChatGPT2023.09 | 77.3 | 20.8 | |
| SSDocument set=D4 (Summaries), Source type=Sp. (Speeches/Speech Summaries), Summary model=Vicuna2023.09 | 77 | 17 | |
| SSDocument set=D4 (Summaries), Source type=Amd (Amendments), Summary model=Vicuna2023.09 | 76.6 | 19.8 | |
| SSDocument set=D3 (Position Papers), Source type=Sp. (Speeches/Speech Summaries)2023.09 | 75.9 | 15.6 | |
| SSDocument set=D2 (all English documents), Source type=Sp. (Speeches/Speech Summaries)2023.09 | 75.1 | 14.7 | |
| PrDocument set=D3 (Position Papers), Source type=Amd (Amendments)2023.09 | 72.4 | 15 | |
| PrDocument set=D3 (Position Papers), Source type=Sp. (Speeches/Speech Summaries)2023.09 | 67.3 | 11.1 | |
| PrDocument set=D2 (all English documents), Source type=Amd (Amendments)2023.09 | 66.8 | 7 | |
| ClassSource type=Sp. (Speeches/Speech Summaries)2023.09 | 65.2 | 7 | |
| PrDocument set=D2 (all English documents), Source type=Sp. (Speeches/Speech Summaries)2023.09 | 59.8 | 4.8 | |
| Nat2023.09 | 55.1 | 10.7 | |
| Random2023.09 | 50 | 2.5 |