End-to-End Skill Extraction on KARIYER (test)
56CoNLL-F1Dynamic Ten-Shot
Evaluation Results
| Method | Links | |
|---|---|---|
| Dynamic Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 56 | |
| Static Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 55 | |
| Dynamic Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 55 | |
| Dynamic Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 55 | |
| Dynamic Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 55 | |
| Static Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 54 | |
| Static Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 54 | |
| Dynamic Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 54 | |
| Dynamic Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 54 | |
| Dynamic Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 54 | |
| Zero-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 53 | |
| Static Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 53 | |
| Static Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 53 | |
| Dynamic Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 53 | |
| Static Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 52 | |
| Static Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 52 | |
| Static Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 52 | |
| Dynamic Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 52 | |
| Zero-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 51 | |
| Zero-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 50 | |
| Static Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 50 | |
| Dynamic Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 41 | |
| Static Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 40 | |
| Dynamic Two-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 40 | |
| Dynamic Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 40 | |
| Zero-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 39 | |
| Static Six-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 39 | |
| Static Ten-ShotRetrieval Method=Embedding Similarity, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 38 | |
| SSL via BertRetrieval Method=Embedding Similarity, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 37 | |
| SSL via BertRetrieval Method=Embedding Similarity, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 36 | |
| SSL via BertRetrieval Method=Embedding Similarity, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 35 | |
| Dynamic Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 34 | |
| Dynamic Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 34 | |
| Dynamic Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 34 | |
| Dynamic Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 34 | |
| Dynamic Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 34 | |
| Dynamic Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 33 | |
| SSL via BertRetrieval Method=Fuzzy Matching, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 30 | |
| Dynamic Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 30 | |
| Dynamic Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 30 | |
| Dynamic Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 30 | |
| SSL via BertRetrieval Method=Fuzzy Matching, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 29 | |
| SSL via BertRetrieval Method=Fuzzy Matching, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 29 | |
| Static Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 28 | |
| Static Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 28 | |
| Static Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 28 | |
| Zero-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 27 | |
| Zero-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 26 | |
| Zero-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 26 | |
| Static Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 25 | |
| Static Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 25 | |
| Static Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 25 | |
| Static Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext- Desc. Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 25 | |
| Static Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankKey Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 24 | |
| Static Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/ RerankContext Prompt, Reranking Model=GPT-4o, Causal Reasoning=true2026.01 | 24 | |
| Dynamic Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 22 | |
| Dynamic Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 21 | |
| Dynamic Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 20 | |
| SSL via BertRetrieval Method=Embedding Similarity, Reranking Method=w/o Rerank2026.01 | 19 | |
| SSL via BertRetrieval Method=Fuzzy Matching, Reranking Method=w/o Rerank2026.01 | 17 | |
| Static Two-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 16 | |
| Static Six-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 15 | |
| Zero-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 14 | |
| Static Ten-ShotRetrieval Method=Fuzzy Matching, Identification Model=Claude Sonnet 3.7, Reranking Method=w/o Rerank2026.01 | 14 |