Researchers Uncover Hidden Ingredients Behind AI Creativity
10 months ago
- #diffusion-models
- #machine-learning
- #AI-creativity
- AI systems like diffusion models (e.g., DALL·E, Imagen, Stable Diffusion) exhibit unexpected creativity by blending elements to create new, coherent images.
- Researchers discovered that technical imperfections in the denoising process (locality and equivariance) drive AI creativity, not just replication.
- Mason Kamb and Surya Ganguli developed the Equivariant Local Score (ELS) machine, which predicts denoised images with 90% accuracy, matching trained diffusion models.
- The study suggests AI creativity arises from focusing on local patches without broader context, similar to how human creativity may fill knowledge gaps.
- Experts note that while the paper explains diffusion model creativity, other AI systems (e.g., large language models) may rely on different mechanisms.