# Qualitative Interface Comparison on User Study (N=24) (between-subjects) Source: [Qualitative Interface Comparison on User Study (N=24) (between-subjects)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:52:37.932Z Qualitative evaluation derived from a user study involving 24 participants (between-subjects design), focusing on interface comparison assessed via the frequency of specific mentions. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Qualitative Interface Comparison | | Dataset (including any stated split) | User Study (N=24) (between-subjects) | | Metric | Mentions | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Mentions](): Higher is better; unit: SCALAR. ## Recorded results | Method | Mentions | Result date | Report paper | | --- | --- | --- | --- | | CanAnswer | 10 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 9 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 8 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 7 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 7 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 7 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 7 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 6 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 6 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 5 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 5 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 4 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 3 | Not recorded | 693a4ff26cfd488761a54939 | | CanAnswer | 3 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 3 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 2 | Not recorded | 693a4ff26cfd488761a54939 | | Baseline | 2 | Not recorded | 693a4ff26cfd488761a54939 | ### CanAnswer Mentions: 10. Result ID: 69989c535698665ec4fea7fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Convenience for gaining information","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 9. Result ID: 69989c535698665ec4fea7fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Credibility","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 8. Result ID: 69989c535698665ec4fea7fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Impressive of learned knowledge points","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 7. Result ID: 69989c535698665ec4fea7ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Suggested Follow-Ups feature","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 7. Result ID: 69989c535698665ec4fea800. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Well-structured and consistent answers","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### Baseline Mentions: 7. Result ID: 69989c535698665ec4fea807. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Concerns about credibility","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### Baseline Mentions: 7. Result ID: 69989c535698665ec4fea808. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Disorganized information","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 6. Result ID: 69989c535698665ec4fea801. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Topic switch feature","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### Baseline Mentions: 6. Result ID: 69989c535698665ec4fea809. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Difficult interaction","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### Baseline Mentions: 5. Result ID: 69989c535698665ec4fea804. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Ease of accessing information quickly","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### Baseline Mentions: 5. Result ID: 69989c535698665ec4fea80a. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Vague responses","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### Baseline Mentions: 4. Result ID: 69989c535698665ec4fea805. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Cross-checking","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 3. Result ID: 69989c535698665ec4fea802. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Relevance of the provided examples","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### CanAnswer Mentions: 3. Result ID: 69989c535698665ec4fea803. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Aspect":"Limited Interactivity","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### Baseline Mentions: 3. Result ID: 69989c535698665ec4fea806. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Engaging content with emotional support","Feedback Polarity":"Pros"}. This record does not assert independent reproduction. ### Baseline Mentions: 2. Result ID: 69989c535698665ec4fea80b. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Hard to understand technical terms","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. ### Baseline Mentions: 2. Result ID: 69989c535698665ec4fea80c. [Reporting paper]() Recorded evaluation configuration: {"Aspect":"Lack of personalized experience","Feedback Polarity":"Cons"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.