Rationale-label Pair Evaluation on Rationale-label pairs Pointwise evaluation
1.46REVPointwise Evaluation Instance (X→RY) 3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Pointwise Evaluation Instance (X→RY) 3Type=X→RY, Question=If you're caught committing murder, an injection can lead to your own what?, Label=die (incorrect), Rationale=An injection can lead to one's own death. If you're caught committing murder, you can be injected into your own body and die.2022.10 | 1.46 | 0 | 0 | |
| Pointwise Evaluation Instance (X : YR) 2Type=X : YR, Question=What leads to someone's death when they are very depressed?, Label=suicide, Rationale=Suicide is the act of committing suicide. When someone is very depressed, suicide leads to their death.2022.10 | 0.57 | 0 | 0 | |
| Pointwise Evaluation Instance (X→RY) 2Type=X→RY, Question=What would you do if you have excitement and do not want to stay in your house?, Label=go to gym (incorrect), Rationale=Go to gym is to go to a place where you can express information. If you have excitement and do not want to stay in your house, then you would go somewhere.2022.10 | 0.53 | 1 | 0 | |
| Pointwise Evaluation Instance (XY*→R) 2Type=XY*→R, Question=What would you be if you comfort friend?, Label=friendly, Rationale=Comforting friend is a good thing.2022.10 | 0.43 | 0 | 1 | |
| Pointwise Evaluation Instance (XY*→R) 1Type=XY*→R, Question=Where are old pictures kept?, Label=attic, Rationale=Attic is a place where old pictures are kept.2022.10 | 0.34 | 1 | 0 | |
| Pointwise Evaluation Instance (Y*;R*) 1Type=Y*;R*, Question=If you have a ticket and you are planning to eat hot dogs, where would you go?, Label=baseball stadium, Rationale=Hot dogs can be eaten at baseball stadium. When you go to a baseball stadium, you have a ticket and you may plan to eat hot dogs.2022.10 | 0.32 | 0 | 0 | |
| Pointwise Evaluation Instance (Y*;R*) 2Type=Y*;R*, Question=How does a person go to space?, Label=space shuttle, Rationale=People go to space by a vehicle specially designed to travel to space. That vehicle is called a space shuttle.2022.10 | 0.32 | 0 | 0 | |
| Pointwise Evaluation Instance (X : YR) 3Type=X : YR, Question=Where are you normally when you take a bath?, Label=hotel room (incorrect), Rationale=Hotel room is a place where people stay. Bathing is normally done in hotel rooms.2022.10 | 0.32 | 0 | -1 | |
| Pointwise Evaluation Instance (Y*;R*) 3Type=Y*;R*, Question=What is a dangerous outdoor activity for children?, Label=sun themselves, Rationale=Sunning themselves is a dangerous activity Children should not sun themselves2022.10 | 0.28 | 1 | 1 | |
| Pointwise Evaluation Instance (XY*→R) 3Type=XY*→R, Question=What do customers do to a waiter after the waiter serves customers?, Label=pay to, Rationale=Paying to a waiter is the action of paying. Waiters get paid to serve customers.2022.10 | 0.1 | -1 | 0 | |
| Pointwise Evaluation Instance (X→RY) 1Type=X→RY, Question=What is likely heard by those going to a party?, Label=laughter (incorrect), Rationale=People go to a party to meet new people. People are likely to hear laughter at the party.2022.10 | -0.1 | 1 | 0 | |
| Pointwise Evaluation Instance (X : YR) 1Type=X : YR, Question=Where is there likely to be more than one desk drawer?, Label=desk (incorrect), Rationale=Desk drawer is a drawer used for storing office supplies. There is likely to be more than one desk drawer in office.2022.10 | -4.75 | 1 | 1 |