Attribute Value Extraction on MAVE zero-shot 1.0 (test)
85.56PrecisionMAVEQA
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MAVEQAAttribute=Resolution, Protocol=Zero-shot2021.12 | 85.56 | 44.94 | 58.93 | |
| MAVEQAAttribute=Food Processor Capacity, Protocol=Zero-shot2021.12 | 83.5 | 98.85 | 90.53 | |
| AVEQAAttribute=Food Processor Capacity, Protocol=Zero-shot2021.12 | 81.97 | 92.34 | 86.85 | |
| AVEQAAttribute=Resolution, Protocol=Zero-shot2021.12 | 80.95 | 38.55 | 52.23 | |
| AVEQAAttribute=Special Occasion, Protocol=Zero-shot2021.12 | 62.13 | 50.16 | 55.51 | |
| MAVEQAAttribute=Number of Sinks, Protocol=Zero-shot2021.12 | 48.57 | 38.97 | 43.24 | |
| AVEQAAttribute=Number of Sinks, Protocol=Zero-shot2021.12 | 39.1 | 29.8 | 33.82 | |
| MAVEQAAttribute=Special Occasion, Protocol=Zero-shot2021.12 | 10.06 | 0.8 | 1.48 | |
| AVEQAAttribute=Compatibility, Protocol=Zero-shot2021.12 | 0 | 0 | 0 | |
| MAVEQAAttribute=Compatibility, Protocol=Zero-shot2021.12 | 0 | 0 | 0 |