Financial Auditing on Financial Audit Evaluation Set 67 cases (test) benchmark leaderboard · SOTA2 Research

Financial Auditing on Financial Audit Evaluation Set 67 cases (test)

0SERFinAuditing

Evaluation Results

Method	Links
FinAuditing2026.06		0	16.42	68.66
FinAuditing2026.06		0	19.4	74.63
FinAuditing2026.06		0	22.39	70.15
Herculean2026.06		0	5.97	28.36
Herculean2026.06		0	0	34.33
Herculean2026.06		0	11.94	33.78
AUDITFLOW2026.06		0	0	19.4
FinAuditing2026.06		1.49	20.89	71.64
Herculean2026.06		1.49	8.96	23.88
AUDITFLOW2026.06		1.49	1.49	14.93
AUDITFLOW2026.06		1.49	0	17.91
Herculean2026.06		2.99	11.94	47.76
AUDITFLOW2026.06		2.99	0	16.42
GraphRAG2026.06		4.84	1.61	45.16
AUDITFLOW2026.06		7.46	2.99	16.42
GraphRAG2026.06		11.29	0	41.94
Single Agent2026.06		13.43	1.49	17.91
Single Agent2026.06		13.43	1.49	17.91
Single Agent2026.06		13.43	1.49	17.91
Single Agent2026.06		13.43	1.49	17.91
FinAuditing2026.06		14.93	29.85	50.75
Single Agent2026.06		16.42	1.49	17.91
GraphRAG2026.06		17.46	6.35	37.38
TreeRAG2026.06		20.89	1.49	41.79
TreeRAG2026.06		32.84	2.99	20.89
TreeRAG2026.06		34.33	1.49	22.39
TreeRAG2026.06		37.31	2.99	35.82
Single Agent2026.06		37.31	1.49	31.34
AUDITFLOW2026.06		37.31	1.49	29.85
GraphRAG2026.06		38.71	1.61	32.26
TreeRAG2026.06		38.81	7.46	20.89
Herculean2026.06		43.28	22.39	5.97
GraphRAG2026.06		44.78	4.48	28.36
TreeRAG2026.06		44.78	7.46	26.87
Direct LLM2026.06		53.73	1.49	35.82
Direct LLM2026.06		56.72	8.96	26.87
Direct LLM2026.06		59.7	2.99	29.85
Direct LLM2026.06		59.7	2.99	31.34
GraphRAG2026.06		62.69	14.93	4.48
Direct LLM2026.06		64.18	1.49	32.84
FinAuditing2026.06		70.15	11.94	2.99
Direct LLM2026.06		88.06	0	10.45
Vanilla RAG2026.06		89.55	7.46	1.49
Vanilla RAG2026.06		92.54	0	0
Vanilla RAG2026.06		92.54	0	0
Vanilla RAG2026.06		94.03	1.49	2.99
Vanilla RAG2026.06		95.52	0	0
Vanilla RAG2026.06		97.01	0	0