Transformers Are Inherently Succinct
4 hours ago
- #transformers
- #formal-languages
- #succinctness
- Transformers' expressive power is measured by succinctness in describing concepts.
- Transformers can represent formal languages much more succinctly than finite automata and Linear Temporal Logic (LTL) formulas.
- Verifying properties of transformers is EXPSPACE-complete, making it provably intractable.