General AI assistant tasks on GAIA 68 curated tasks
67.6AccuracyGraphBit
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| GraphBitLLM=GPT-5.2, Proc. (ms)=11.9, CPU (%)=21.1, Mem. (MB)=126.12026.03 | 67.6 | 0 | |
| Pydantic AILLM=GPT-5.2, Proc. (ms)=18.3, CPU (%)=24.2, Mem. (MB)=166.52026.03 | 52.9 | 0 | |
| LlamaIndexLLM=GPT-5.2, Proc. (ms)=15.0, CPU (%)=25.2, Mem. (MB)=165.42026.03 | 50 | 0 | |
| CrewAILLM=GPT-5.2, Proc. (ms)=31.0, CPU (%)=30.7, Mem. (MB)=202.22026.03 | 44.9 | 14.3 | |
| LangChainLLM=GPT-5.2, Proc. (ms)=36.1, CPU (%)=24.7, Mem. (MB)=234.42026.03 | 38.2 | 41.2 | |
| LangGraphLLM=GPT-5.2, Proc. (ms)=31.5, CPU (%)=26.1, Mem. (MB)=208.02026.03 | 36.8 | 47.1 | |
| AutoGenLLM=GPT-5.2, Proc. (ms)=70.0, CPU (%)=27.0, Mem. (MB)=274.82026.03 | 35.3 | 33.8 |