As Complexity Grows, Architecture Dominates Material
a day ago
- Alan Kay's dog house analogy illustrates that scaling systems without proper architecture leads to structural collapse.
- Two responses to failure: either plaster over problems (pyramid approach) or invent architecture (arches) that leverages non-obvious interactions.
- Architecture like Chartres Cathedral uses less material than the Parthenon by cunningly arranging components to create greater integrity.
- In software, chaining agents multiplies failure rates; adding retries and guardrails compounds fragility rather than solving it.
- Prompt objects use message passing with LLM interpretation, allowing objects to reflect, adapt, and recover, leading to emergent antifragility.
- This approach inverts the failure multiplication: longer chains become more robust through compounding recovery.
- A simple ARC-AGI solver built with prompt objects costs under $1/task and avoids complex orchestration, demonstrating architecture over material.
- Formalization should come after exploration; premature constraints risk locking in wrong shapes.