Qwopus 3.6 Fusion 27B
27B dense502,598 all-time downloads
A code-heavy finetune had broken the model’s chain of thought. Fusion takes the difference between the coder and its stable parent as a task vector and merges it back in, a little at the bottom of the network and more toward the top. Reasoning stays intact and the coding gains carry over.
- HumanEval
- 94.5%
- MBPP
- 87.9%
- GSM8K
- 95.0%
- Speed
- ~100 tok/ssingle RTX 5090, MTP speculative decoding