Memory Control Flow Attack (Order) on MEMFLOW Order
100ISRMEMFLOW
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 69.4 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 61.1 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 63.9 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 63.9 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 52.8 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 66.7 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 66.7 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 55.6 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 58.3 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 63.9 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 52.8 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 66.7 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Order, Tool Label=Neutral, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 0 |