Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

4-bit precision

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

80

Base only

Active filters: 4-bit precision

QUASAR-QAT/Qwen3.8-27B-QUASAR-NVFP4

Image-Text-to-Text • 28B • Updated 4 days ago • 125k • 159

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated Aug 31 • 300k • 327

nvidia/GLM-5.1-NVFP4

Text Generation • 382B • Updated May 27 • 2.07k • 46

QUASAR-QAT/gemma-4-E4B-it-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 7B • Updated 4 days ago • 571 • 3

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-NVFP4

Image-Text-to-Text • 30B • Updated 4 days ago • 177 • 4

QUASAR-QAT/Muse-Glimmer-30B-QUASAR-Q4_0-GGUF

Text Generation • 28B • Updated 4 days ago • 470 • 5

QUASAR-QAT/Qwen3.5-4B-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 4B • Updated 4 days ago • 1.1k • 3

incoai/GLM-5.3-NVFP4

Text Generation • 391B • Updated Aug 28 • 4.88k • 26

QUASAR-QAT/gemma-4-E4B-it-QUASAR-W4A16-G64

Any-to-Any • 8B • Updated 4 days ago • 92 • 2

QUASAR-QAT/gemma-4-12B-it-QUASAR-Q4_0-GGUF

Image-Text-to-Text • 12B • Updated 4 days ago • 1.19k • 5

wallawalla47/Qwen3.8-27B-NVIDIA-NVFP4-NInferV3

Image-Text-to-Text • Updated 7 days ago • 4.92k • 1

cmod/firefunction-v1-GGUF

Updated Feb 25, 2024

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Jul 10 • 30.5k • 30

Esperanto/gemma-2b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 15

Esperanto/gemma-7b-it-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 13

Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 15 • 1

Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx

Updated Dec 12, 2024 • 13

amornpan/openthaigpt-MedChatModelv11

Text Generation • 8B • Updated Mar 10, 2025 • 55 • 2

Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 18

Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024

Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx

Text Generation • Updated Dec 12, 2024 • 18

Esperanto/mistral-7b-kvc-AWQ-int4-onnx

Updated Dec 18, 2024 • 17

amornpan/openthaigpt1.5-14b-MedChatModelV1

Text Generation • 15B • Updated Nov 4, 2024 • 19 • 1

RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation • 71B • Updated Aug 5 • 7.46k • 4

akkikiki/j-moshi-ext-mlx-q4

Updated Feb 12, 2025 • 34

ruslanmv/granite-3.1-2b-Reasoning-4bit

Text Generation • 3B • Updated Feb 11, 2025 • 33

amornpan/V3_qwen2.5-32b-med-thai-optimized

Text Generation • Updated Mar 14, 2025 • 1

korarishi/rishi-2-2b-it

Text Generation • 3B • Updated May 10, 2025 • 19 • 1

Aeshp/llama2-7bChatbot

Text Generation • Updated Jun 27, 2025 • 10

ZennyKenny/novoyaz-20b

Text Generation • Updated Mar 27 • 35 • 1