LLM Memory
10 months ago
- #Memory Systems
- #LLM
- #Knowledge Graphs
- LLM memory challenges in fiction writing due to limited context windows.
- Reference frames are crucial for knowledge validity, including temporal and spatial contexts.
- Vector embeddings struggle with episodic memories and lack explainability.
- Knowledge graphs can be document-based or use semantic edges for connections.
- Meta-documents act as caches for frequently queried information.
- Automatic vs. explicit connection-making in knowledge graphs.
- Forgetting mechanisms are necessary to manage graph complexity.
- Episodic memory involves narrative documents linked chronologically.
- Traversal strategies for efficient memory querying.
- External tools like SQLite can complement core memory systems.
- Scratchpads as simple memory systems with pruning challenges.
- Layering different types of knowledge (identity vs. episodic).
- Implicit memory control preferred over explicit due to model limitations.
- Future memory systems may rely on fully-learned neural methods.