Organization-level SIC code classification on SIC Code
82.7Macro PrecisionGSnip + LLaMASum
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GSnip + LLaMASumBackbone=GPT-4o-mini, Fine-tuning=true2026.04 | 82.7 | 82.5 | 82.3 | |
| GSnip + GPTSumBackbone=GPT-4o-mini, Fine-tuning=true2026.04 | 82.6 | 82.2 | 82.2 | |
| GSnipBackbone=GPT-4o-mini, Fine-tuning=true2026.04 | 82.3 | 81.8 | 81.7 | |
| GSnip + GPTSumBackbone=RoBERTa, Fine-tuning=true2026.04 | 77.4 | 76.9 | 76.3 | |
| GSnip + LLaMASumBackbone=RoBERTa, Fine-tuning=true2026.04 | 77.2 | 75.5 | 75 | |
| GSnip + GPTSumBackbone=Longformer, Fine-tuning=true2026.04 | 76.7 | 75.8 | 75 | |
| GSnipBackbone=RoBERTa, Fine-tuning=true2026.04 | 75.7 | 74.8 | 74.1 | |
| GSnipBackbone=Longformer, Fine-tuning=true2026.04 | 75.4 | 75.4 | 74.6 | |
| GSnip + LLaMASumBackbone=Longformer, Fine-tuning=true2026.04 | 74 | 72.7 | 71.6 | |
| GSnip + GPTSumBackbone=BERT, Fine-tuning=true2026.04 | 72.4 | 71.8 | 70 | |
| GSnip + LLaMASumBackbone=BERT, Fine-tuning=true2026.04 | 72.3 | 72.8 | 69.9 | |
| GSnipBackbone=BERT, Fine-tuning=true2026.04 | 70 | 69.9 | 69.9 | |
| GPTSumBackbone=GPT-4o-mini, Fine-tuning=true2026.04 | 67.3 | 66.3 | 66.4 | |
| LLaMASumBackbone=GPT-4o-mini, Fine-tuning=true2026.04 | 65.7 | 64.8 | 64.9 | |
| GPTSumBackbone=Longformer, Fine-tuning=true2026.04 | 58.6 | 58.6 | 58.1 | |
| GPTSumBackbone=RoBERTa, Fine-tuning=true2026.04 | 58.1 | 56.5 | 55 | |
| GPTSumBackbone=BERT, Fine-tuning=true2026.04 | 56.2 | 56 | 53.2 | |
| LLaMASumBackbone=RoBERTa, Fine-tuning=true2026.04 | 52.5 | 51.2 | 48.3 | |
| LLaMASumBackbone=Longformer, Fine-tuning=true2026.04 | 51.2 | 51.5 | 48.1 | |
| LLaMASumBackbone=BERT, Fine-tuning=true2026.04 | 49 | 51.3 | 48 |