Instruction Following on SuperNI Hold-Out v1.0 (test)
53.53ROUGE-LPACIT
Evaluation Results
| Method | Links | |
|---|---|---|
| PACITBackbone=LLAMA2-7B, Inference Setting=Few-Shot2023.10 | 53.53 | |
| PACITBackbone=T5-3B, Inference Setting=Few-Shot2023.10 | 52.11 | |
| SuperNI (Few-Shot)Backbone=T5-3B, Inference Setting=Few-Shot2023.10 | 51.08 | |
| SuperNI (Few-Shot)Backbone=LLAMA2-7B, Inference Setting=Few-Shot2023.10 | 50.71 | |
| SuperNI (Zero-Shot)Backbone=LLAMA2-7B, Inference Setting=Few-Shot2023.10 | 49.35 | |
| PACITBackbone=T5-770M, Inference Setting=Few-Shot2023.10 | 46.66 | |
| SuperNI (Zero-Shot)Backbone=T5-3B, Inference Setting=Few-Shot2023.10 | 45.73 | |
| PACITBackbone=LLAMA2-7B, Inference Setting=Zero-Shot2023.10 | 45.62 | |
| SuperNI (Few-Shot)Backbone=T5-770M, Inference Setting=Few-Shot2023.10 | 45.08 | |
| SuperNI (Zero-Shot)Backbone=LLAMA2-7B, Inference Setting=Zero-Shot2023.10 | 44.81 | |
| PACITBackbone=T5-3B, Inference Setting=Zero-Shot2023.10 | 43.09 | |
| SuperNI (Zero-Shot)Backbone=T5-3B, Inference Setting=Zero-Shot2023.10 | 42.89 | |
| SuperNI (Few-Shot)Backbone=LLAMA2-7B, Inference Setting=Zero-Shot2023.10 | 42.14 | |
| SuperNI (Zero-Shot)Backbone=T5-770M, Inference Setting=Few-Shot2023.10 | 40.59 | |
| SuperNI (Few-Shot)Backbone=T5-3B, Inference Setting=Zero-Shot2023.10 | 38.54 | |
| SuperNI (Zero-Shot)Backbone=T5-770M, Inference Setting=Zero-Shot2023.10 | 38.02 | |
| PACITBackbone=T5-770M, Inference Setting=Zero-Shot2023.10 | 33.59 | |
| SuperNI (Few-Shot)Backbone=T5-770M, Inference Setting=Zero-Shot2023.10 | 33.3 |