Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,480

Base only

Active filters: llama-cpp

ggml-org/Qwen2.5-Coder-3B-Q8_0-GGUF

Text Generation • 3B • Updated Nov 26, 2024 • 2.23k • 16

kenonix/Phi-4-mini-instruct-abliterated-Q5_K_M-GGUF

Text Generation • 4B • Updated Mar 6, 2025 • 160 • 1

Aldaris/Qwen3-8B-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 29, 2025 • 8.41k • 6

Bouquets/StrikeGPT-R1-Zero-8B

8B • Updated Jun 12, 2025 • 129 • 9

tinh2406/full_llama2_split_merged-Q4_K_M-GGUF

7B • Updated Jun 11, 2025 • 7 • 1

xmanii/gemma-270m-persian-Q4_K_M-GGUF

0.3B • Updated Aug 15, 2025 • 83 • 2

enacimie/LFM2-700M-Q4_K_M-GGUF

Text Generation • 0.7B • Updated Sep 10, 2025 • 42 • 1

AL-DN/medical-llm-mistral7B-F16-GGUF

Text Generation • 6.82M • Updated Sep 23, 2025 • 17 • 1

ijohn07/Qwen3-14B-Uncensored-Q4_K_M-GGUF

15B • Updated Oct 6, 2025 • 1.26k • 1

sillykiwi/Nemotron-H-4B-Instruct-128K-Q6_K-GGUF

Text Generation • 4B • Updated Oct 27, 2025 • 66 • 1

ErenAta00/CaptureTheFlag-CypherMindLLM-XRLAB-GGUF

Text Generation • 8B • Updated Nov 18, 2025 • 4.62k • 7

PleIAs/Baguettotron-GGUF

0.3B • Updated Nov 19, 2025 • 677 • 13

richardyoung/Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • 8B • Updated 3 days ago • 5.19k • 3

straino/Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit-Q4_K_M-GGUF

Text Generation • 31B • Updated Dec 9, 2025 • 450 • 3

enacimie/Qwen3-0.6B-Q4_K_M-GGUF

Text Generation • 0.8B • Updated Dec 23, 2025 • 705 • 4

solarkyle/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 20 • 195 • 6

jinaai/jina-embeddings-v5-text-small-clustering

Feature Extraction • 0.6B • Updated Apr 15 • 2.59k • 8

jinaai/jina-embeddings-v5-text-small-classification

Text Classification • 0.6B • Updated Apr 15 • 3.75k • 6

AYI-NEDJIMI/CyberSec-Assistant-3B-GGUF

Text Generation • 3B • Updated Feb 21 • 1.26k • 5

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 806 • 10

aashish1904/Qwen3.5-2B-Base-GGUF

Text Generation • 2B • Updated Mar 2 • 817 • 3

Abiray/zembed-1-Q4_K_M-GGUF

Feature Extraction • 4B • Updated Mar 11 • 207 • 5

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 29.5k • 61

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.21k • 4

Rustamshry/PLLuM-12B-instruct-Q8_0-GGUF

12B • Updated Apr 11 • 44 • 1

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 2.04k • 33

Abiray/Qwen3.6-35B-A3B-Q4_K_M-GGUF

Image-Text-to-Text • 35B • Updated Apr 16 • 3.8k • 25

Youssofal/Qwen3.6-35B-A3B-Abliterated-Heretic-GGUF

Text Generation • 35B • Updated Apr 16 • 6.56k • 35

NidAll/supergemma4-e4b-abliterated-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 17 • 996 • 27

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 6.09k • 81