List your company

Failure Attribution Accuracy on Who&When (Alg)

42.86Accuracy (Who&When Alg)AgenTracer
10.661619.020827.3835.7392Jun 2, 2026

Evaluation results

MethodLinks
AgenTracerevaluation with ground truth (G)=true2026.0642.86
AgenTracer2026.0637.3
CDC-MAS2026.0636.2
StepFinder2026.0629.63
StepFinderCategory=Sequential, Embedding=Qwen3-Embedding-0.6B, Temporal Feature Extractor=BiLSTM2026.0629.63
TransformerCategory=Sequential, Layers=2, Attention Heads=42026.0624.87
TCNCategory=Sequential, Layers=2, Kernel Size=32026.0624.34
BiGRUCategory=Sequential, Layers=22026.0623.28
Step-by-Step (G)Category=LLM-based, LLM Model=GPT-4o, Ground Truth=True2026.0620.11
Binary Search (G)Category=LLM-based, LLM Model=GPT-4o, Ground Truth=True2026.0620.1
All-at-Once (G)Category=LLM-based, LLM Model=GPT-4o, Ground Truth=True2026.0615.87
Binary SearchCategory=LLM-based, LLM Model=GPT-4o, Ground Truth=False2026.0615.61
RandomCategory=Baseline2026.0615.08
Step-by-StepCategory=LLM-based, LLM Model=GPT-4o, Ground Truth=False2026.0614.02
All-at-OnceCategory=LLM-based, LLM Model=GPT-4o, Ground Truth=False2026.0611.9