Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,935

Base only

Active filters: 5-bit

Mia-AiLab/Qwen3.8-27B-DFlash2-EXL3-5.0bpw

Text Generation • 0.7B • Updated 12 days ago • 828 • 7

MaziyarPanahi/Phi-3-Context-Obedient-RAG-GGUF

Text Generation • 4B • Updated May 10, 2024 • 1.08k • 7

FallenMerick/Space-Whale-Lite-13B-GGUF

Text Generation • 13B • Updated May 17, 2024 • 24 • 1

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • 8B • Updated Jul 17, 2024 • 1.04k • 9

MaziyarPanahi/Llama-3.3-70B-Instruct-GGUF

Text Generation • 71B • Updated Dec 7, 2024 • 156k • 22

lmstudio-community/Qwen3-Coder-30B-A3B-Instruct-MLX-5bit

Text Generation • 31B • Updated Aug 1, 2025 • 124k • 10

MaziyarPanahi/Ministral-3-3B-Reasoning-2512-GGUF

Text Generation • 3B • Updated Dec 2, 2025 • 154k • 5

majentik/Qwen3.6-35B-A3B-RotorQuant-MLX-5bit

Text Generation • 35B • Updated 18 days ago • 287 • 1

deepsweet/Qwen3.6-35B-A3B-MLX-oQ5-FP16

Text Generation • 35B • Updated May 10 • 42 • 2

blockblockblock/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated-exl3-5.0bpw

Text Generation • 12B • Updated 27 days ago • 191 • 1

mlx-community/Qwen3.6-35B-A3B-MTP-5bit

Text Generation • 0.8B • Updated Jun 1 • 635 • 6

pipenetwork/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-MLX-5bit

Image-Text-to-Text • 9B • Updated Jul 23 • 460 • 1

ZQ-Dev/KAT-Coder-V2.5-Dev-oQ5e-fp16

Text Generation • 35B • Updated Aug 5 • 192 • 2

pearsonkyle/Qwen3.8-27B-imatrix-MTP-GGUF

Image-Text-to-Text • 27B • Updated 23 days ago • 5.67k • 9

Foresee/Qwen3.8-9B-heretic-uncensored-5bit-MLX

Text Generation • 9B • Updated 20 days ago • 4.17k • 2

keXjos/Qwen3.8-9B-Distill-mlx-5Bit

Text Generation • 9B • Updated 16 days ago • 1.66k • 3

majentik/Ornith-1.5-35B-A3B-MLX-5bit

Image-Text-to-Text • 35B • Updated 16 days ago • 259 • 1

notnaurw/Qwen3.8-27B-oQ5e-SAGE-mtp

Image-Text-to-Text • 28B • Updated 8 days ago • 217 • 1

airagrp/Qwen3.8-27B-oQ5e-mtp

28B • Updated 10 days ago • 75 • 1

zviratko/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-oQ5e-fp16-mtp

10B • Updated 10 days ago • 922 • 2

funnygeeker/Huihui-Ornith-1.5-35B-A3B-abliterated-oQ5e-fp16-mtp

Text Generation • 36B • Updated 10 days ago • 755 • 2

tls20/Qwen3.8-Flash-Next-oQ5e-mtp

180B • Updated 6 days ago • 693 • 1

npario/Qwen3.8-27B-MLX-5bit

Image-Text-to-Text • 27B • Updated 5 days ago • 177 • 1

zviratko/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU-oQ5e-mtp

28B • Updated 4 days ago • 225 • 1

Johneeee/Ornith-1.5-35B-A3B-oQ5e-novision

35B • Updated 4 days ago • 120 • 1

LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 9

MaziyarPanahi/phi-2-GGUF

Text Generation • 3B • Updated Jan 26, 2024 • 482 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 400 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • 7B • Updated Jan 26, 2024 • 556 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • 7B • Updated Jan 30, 2024 • 1.34k • 5