Ollama and gguf
13 days ago
- #bug
- #llama.cpp
- #gguf
- Issue with gguf model failing to run due to errors, while the original model runs fine.
- Error message indicates invalid ggml type for tensor 'blk.0.ffn_down_exps.weight'.
- Suggestion that ggml dependencies may need an update, referencing a specific issue on llama.cpp.
- Note that gguf runs successfully on llama.cpp without issues.
- No responses provided for OS, GPU, CPU, or Ollama version in the bug report.