List your company

Applied Mathematics on Graduate-level Applied Mathematics final exam (pilot study)

90AccuracyShadow (Forced Tools)
45.2856.8968.580.11Mar 21, 2026

Evaluation results

MethodLinks
Shadow (Forced Tools)Base Model=Qwen3-32B2026.0390
Shadow (Full/Dynamic)Base Model=Qwen3-32B2026.0385
Shadow (No Code)Base Model=Qwen3-32B2026.0385
Naive RAGBase Model=Qwen3-32B2026.0374
Baseline (Zero-shot)Base Model=Qwen3-32B2026.0367
Shadow (Full/Dynamic)Base Model=Qwen2.5-32B2026.0365
Shadow (Forced Tools)Base Model=Qwen2.5-32B2026.0357
Naive RAGBase Model=Qwen2.5-32B2026.0356
Shadow (No Code)Base Model=Qwen2.5-32B2026.0350
Baseline (Zero-shot)Base Model=Qwen2.5-32B2026.0347