Can I Run AI locally?
8 hours ago
- #Parameter Sizes
- #AI Models
- #Machine Learning
- Meta's Llama 3.1 8B is highlighted for its great quality/speed ratio.
- Various AI models from companies like Meta, Alibaba, Microsoft, OpenAI, Mistral AI, Google, DeepSeek, Moonshot AI, and others are listed with their parameter sizes and specialties.
- Models range from ultra-tiny (0.8B) to massive (1T parameters), catering to different needs from edge devices to high-performance computing.
- Specializations include multimodal capabilities, coding, reasoning, multilingual support, and efficient MoE (Mixture of Experts) architectures.
- Notable mentions include OpenAI's open-weight MoE, Mistral AI's coding-focused models, and Alibaba's flagship models with thinking mode support.
- The text serves as a guide to help users identify which AI models their machines can run, based on browser APIs and actual specs.