ThinkingCap-Qwen3.6-27B: Qwen3.6 capabilities with 50% fewer thinking tokens
7 hours ago
- #reasoning models
- #token efficiency
- #multimodal AI
- The ThinkingCap-Qwen3.6-27B model is a finetuned version of Qwen3.6-27B, designed to reduce thinking tokens by 50% on average while maintaining answer quality.
- It can be used with libraries like Transformers and vLLM, and platforms such as Google Colab, Kaggle, and Docker for local deployment.
- Out-of-domain evaluations show token reductions of up to 67.8% on benchmarks like GPQA-Diamond, with maintained accuracy in areas like knowledge, math, and multimodal tasks.
- In-domain evaluations on holdout datasets like GSM8K and ARC-Challenge demonstrate even higher token efficiency, with reductions up to 74.1% and improved accuracy.
- Safety benchmarks indicate preserved guardrails, with refusal rates similar to the base model and token reductions of around 20-24% on safety prompts.
- The model supports GGUF quantization for efficient local inference via llama.cpp and compatible runtimes, with quantized versions available in a sibling repository.
- Usage examples include image-text-to-text tasks, and the model requires specific sampling parameters (e.g., temperature=1.0) as recommended for optimal performance.