fraQtl/Qwen3.6-35B-A3B-Hi-Fi-GGUF
Text Generation • 35B • Updated • 696 • 4
AI & ML interests
KV cache compression, inference optimization, model compression
Recent Activity
View all activity
fraQtl/Gemma-4-E2B-it-Hi-Fi-GGUF
Text Generation • 5B • Updated • 192
fraQtl/Gemma-4-26B-A4B-it-Hi-Fi-GGUF
Text Generation • 25B • Updated • 157
fraQtl/mistral-7b-instruct-v0.3-kv-sidecars
Updated
fraQtl/qwen3-4b-instruct-2507-kv-sidecars
Updated
fraQtl/fraqtl-sm80-runtime
Updated
fraQtl/fraqtl-d2-mistral-7b-instruct-v0.3
Updated
fraQtl/Qwen3.6-35B-A3B-Hi-Fi-MTP-runtime
Text Generation • 36B • Updated • 163 • 2
fraQtl/Qwen3.6-35B-A3B-compressed
Text Generation • 2B • Updated • 40 • 6
fraQtl/Mistral-7B-fraQtl
3B • Updated
fraQtl/Llama-3.2-3B-fraQtl-kv
3B • Updated • 5
fraQtl/TinyLlama-1.1B-fraQtl-kv
1B • Updated • 6
fraQtl/Qwen2.5-3B-fraQtl-kv
3B • Updated • 2