Memory Control Flow Attack (Override) on MEMFLOW Override
100ISRMEMFLOW
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 97.2 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Neutral, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=None, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 91.7 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Weak, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 100 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=gpt-5-mini2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LangChain, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gpt-5-mini2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=claude-sonnet-4-52026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=OFF, Regime=Isolated, Framework=LlamaIndex, LLM Backbone=gemini-2.5-flash2026.03 | 100 | 0 | |
| MEMFLOWTool Target=Safe Tool, Tool Label=Harmful, Retrieval Strength=Strong, Regime=Isolated, Framework=LangChain, LLM Backbone=claude-sonnet-4-52026.03 | 97.2 | 97.2 |