Post
2902
Good news, llama.cpp seems to be close to supporting MTP on qwen models. Bad news, every single gguf will have to be redone when it is.
- 1 reply
Matthew Andrews
BlueNipples
AI & ML interests
None yet
Recent Activity
liked a model 2 days ago
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-GGUF liked a model 2 days ago
llmfan46/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved new activity 5 days ago
mistralai/Mistral-Medium-3.5-128B:Finally dense 100b+!Organizations
posted an update 5 days ago
posted an update about 1 year ago
Post
682
I'll never understand why people are merging reasoning models with non-reasoning models. It's worse, every time.
You got to train reasoning on reasoning data, and merge reasoning, with reasoning.
You got to train reasoning on reasoning data, and merge reasoning, with reasoning.
posted an update over 1 year ago
Post
606
arcee-ai/Virtuoso-Lite is really good. That's all lol.
If this is prompting with special code, forgive my dummy question, how does one turn that into a usable fine tune? Using the layers to mass generate DPO pairs for a detox dataset?