tribixbite's picture

tribixbite

tribixbite

·

AI & ML interests

None yet

Organizations

None yet

upvoted a collection 10 months ago

Unsloth Dynamic 2.0 Quants

New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance. • 76 items • Updated about 14 hours ago • 379

upvoted a collection 11 months ago

Unsloth 4-bit Dynamic Quants

Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit • 28 items • Updated about 21 hours ago • 94

upvoted a collection 12 months ago

Gemma 3

All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats. • 55 items • Updated about 21 hours ago • 106

upvoted a collection about 1 year ago

HIGGS

Models prequantized with [HIGGS](https://arxiv.org/abs/2411.17525) zero-shot quantization. Requires the latest `transformers` to run. • 18 items • Updated 7 days ago • 14