Show HN: Zero-power photonic language model–code
12 days ago
- #optical-computing
- #language-model
- #generative-model
- Entropica is a generative language model with a forward pass realizable as a passive linear-optical interferometer.
- It uses a 1024-mode, 32-layer unitary network with Reck-scheme MZI meshes and Born-rule readout.
- The model was trained on TinyStories-style generation in under 1.8 hours on a single laptop GPU.
- It is ready for full optical implementation with printed phase masks and a $30 laser pointer.
- All code, weights, and dataset generation scripts are publicly available on GitHub.