Counterfactual Recommendation on Medical Communication Responses
99.38Improvement RateGreedy Recommendations
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Greedy RecommendationsAuditor=EBM, Extractor=Gemma-4-31B2026.06 | 99.38 | 3.6 | |
| Greedy RecommendationsAuditor=EBM, Extractor=Gemma-4-31B (R)2026.06 | 99.23 | 5 | |
| Counterfactual RecommendationsAuditor=EBM, Extractor=Gemma-4-31B (R)2026.06 | 98.91 | 6.6 | |
| Greedy RecommendationsAuditor=EBM, Extractor=Qwen3.5-27B (R)2026.06 | 98.18 | 4.3 | |
| Counterfactual RecommendationsAuditor=EBM, Extractor=Qwen3.5-27B (R)2026.06 | 97.54 | 6.3 | |
| Counterfactual RecommendationsAuditor=EBM, Extractor=Qwen3.5-27B2026.06 | 97.19 | 6.3 | |
| Counterfactual RecommendationsAuditor=LR, Extractor=Gemma-4-31B (R)2026.06 | 95.84 | 7 | |
| Counterfactual RecommendationsAuditor=EBM, Extractor=Gemma-4-31B2026.06 | 94.91 | 6.4 | |
| Greedy RecommendationsAuditor=EBM, Extractor=Qwen3.5-27B2026.06 | 94.78 | 4.1 | |
| Counterfactual RecommendationsAuditor=LR, Extractor=Gemma-4-31B2026.06 | 94.72 | 7.6 | |
| Counterfactual RecommendationsAuditor=Average across auditors and extractors2026.06 | 93.18 | 6.41 | |
| Counterfactual RecommendationsAuditor=EBM, Extractor=Qwen3-80B2026.06 | 89.58 | 5.3 | |
| Counterfactual RecommendationsAuditor=LR, Extractor=Qwen3-80B2026.06 | 89.55 | 5.3 | |
| Greedy RecommendationsAuditor=EBM, Extractor=Qwen3-80B2026.06 | 89.49 | 3.4 | |
| Counterfactual RecommendationsAuditor=LR, Extractor=Qwen3.5-27B (R)2026.06 | 88.68 | 6.8 | |
| Greedy RecommendationsAuditor=LR, Extractor=Qwen3-80B2026.06 | 88.29 | 2.2 | |
| Greedy RecommendationsAuditor=LR, Extractor=Gemma-4-31B (R)2026.06 | 88.23 | 2.3 | |
| Counterfactual RecommendationsAuditor=LR, Extractor=Qwen3.5-27B2026.06 | 86.26 | 6.5 | |
| Greedy RecommendationsAuditor=Average across auditors and extractors2026.06 | 85.14 | 2.95 | |
| Greedy RecommendationsAuditor=LR, Extractor=Qwen3.5-27B (R)2026.06 | 74.94 | 2 | |
| Greedy RecommendationsAuditor=LR, Extractor=Qwen3.5-27B2026.06 | 71.95 | 1.6 | |
| Greedy RecommendationsAuditor=LR, Extractor=Gemma-4-31B2026.06 | 46.98 | 1 |