The best available open weight LLMs now come from China
9 months ago
- #AI Models
- #Open Source
- #Chinese Tech
- Chinese AI labs now produce the best open weight models, surpassing Mistral, Gemma, and Llama.
- Notable July releases include models from Moonshot, Qwen, and Z.ai with parameters ranging from 30B to 1 trillion.
- Qwen models use Apache 2 license, Z.ai uses MIT, while Moonshot's Kimi K2 has a non-OSI-compliant modified MIT license.
- Larger Chinese models offer APIs and are increasingly accessible, with some running on personal laptops.
- OpenAI's delay in releasing open weights may be due to competition with these advanced Chinese models.