Knowledge and Memory
5 days ago
- #knowledge
- #language-models
- #memory
- Claude hallucinated nonexistent Ruby methods, unlike humans who remember learning.
- Human knowledge is sedimentary, allowing us to feel the solidity or airiness of facts.
- Humans don't guess methods they haven't learned, unlike language models which lack memory.
- Language models don't have experiential memory; their weights don't encode true memory.
- Context windows in models are like waking up to unfamiliar notes—disorienting and unreliable.
- Structured human memory helps us discern what we know versus what we don’t.