Thematic Analysis on AAOCA Qualitative Interview Transcripts
68Jaccard SimilarityTAMA, Llama 3.1 8B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TAMA, Llama 3.1 8BRefinement Strategy=TAMA, Backbone Model=Llama 3.1 8B, Processing Steps=Steps 1–62025.03 | 68 | 8 | 35 | |
| Single-Agent LLM, GPT-4oRefinement Strategy=Single-Agent, Backbone Model=GPT-4o, Processing Steps=Steps 1–22025.03 | 42 | 83 | 57 | |
| Traditional Manual TAType=Manual2025.03 | 33 | 100 | 53 | |
| TAMA, GPT-4oRefinement Strategy=TAMA, Backbone Model=GPT-4o, Processing Steps=Steps 1–62025.03 | 29 | 92 | 55 | |
| LLM-TA2025.03 | 22 | 83 | — | |
| Single-Agent LLM, Llama 3.1 8BRefinement Strategy=Single-Agent, Backbone Model=Llama 3.1 8B, Processing Steps=Steps 1–22025.03 | 20 | 12 | 34 |