Hasty Briefsbeta

Ollama and gguf

13 days ago
  • #bug
  • #llama.cpp
  • #gguf
  • Issue with gguf model failing to run due to errors, while the original model runs fine.
  • Error message indicates invalid ggml type for tensor 'blk.0.ffn_down_exps.weight'.
  • Suggestion that ggml dependencies may need an update, referencing a specific issue on llama.cpp.
  • Note that gguf runs successfully on llama.cpp without issues.
  • No responses provided for OS, GPU, CPU, or Ollama version in the bug report.