Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

109

Base only

Active filters: lmstudio

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated Jul 27, 2025 • 254

mistralai/Devstral-Small-2505_gguf

24B • Updated Jul 24, 2025 • 1.83k • 81

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 1.4k • 32

lordx64/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-IQ4_XS-GGUF

Text Generation • 35B • Updated Apr 20 • 9.39k • 32

0xKitkat/Qwen3.8-27B-Uncensored-Aggressive

Image-Text-to-Text • 27B • Updated Aug 19 • 14.9k • 35

FedericoFB/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4-GGUF

33B • Updated about 13 hours ago • 1

FedericoFB/Mistral-Small-4-119B-2603-NVFP4-GGUF

119B • Updated about 10 hours ago • 1

danlou/relay-v0.1-Mistral-Nemo-2407-GGUF

Text Generation • 12B • Updated Dec 14, 2024 • 156

DavidAU/DeepHermes-3-Llama-3-8B-Preview-16.5B-Brainstorm-gguf

Text Generation • 17B • Updated Mar 3, 2025 • 714 • 6

DavidAU/How-To-Use-Reasoning-Thinking-Models-and-Create-Them

Text Generation • Updated Jul 27, 2025 • 27

DavidAU/How-To-Set-and-Manage-MOE-Mix-of-Experts-Model-Activation-of-Experts

Text Generation • Updated Jul 27, 2025 • 20

r3b31/Qwen2-VL-7B-Captioner-Relaxed-GGUF

Image-to-Text • 8B • Updated Mar 5, 2025 • 253 • 3

SiddhJagani/gpt-oss-safeguard-20b-mlx-Q8

Text Generation • 21B • Updated Nov 1, 2025 • 26

fibonacciai/RealRobot-Chatbot-Ecommerce-Robot-Fibonacci-Nano-llm

Question Answering • 4B • Updated Dec 2, 2025 • 521 • 10

PersianAICommunity/fibonacci-RealRobot-Chatbot-Ecommerce-Robot-Nano-llm

Question Answering • 4B • Updated Nov 23, 2025 • 55 • 2

Ex0bit/Elbaz-Prime-Intellect-3_Prism_Abliterated

Text Generation • 107B • Updated Dec 3, 2025 • 59 • 5

AIMS2025/DeepSignal

Text Generation • 4B • Updated Jul 20 • 2

MadlabOSS/LFM2-350M-lmsguide

0.4B • Updated Dec 25, 2025 • 5

MadlabOSS/LFM2-700m-lmsguide

0.7B • Updated Dec 25, 2025 • 8

MadlabOSS/LFM2-700m-lmsguide-GGUF

0.7B • Updated Jan 7 • 78

MadlabOSS/LFM2-350M-lmsguide-GGUF

0.4B • Updated Jan 7 • 43

MadlabOSS/LFM2-1.2b-lmsguide

1B • Updated Dec 25, 2025 • 9

MadlabOSS/LFM2-1.2b-lmsguide-GGUF

1B • Updated Jan 7 • 26

MadlabOSS/LFM2-2.6b-lmsguide

3B • Updated Dec 25, 2025 • 14 • 1

MadlabOSS/LFM2-2.6b-lmsguide-GGUF

3B • Updated Jan 7 • 53 • 3

rileyseaburg/distillix-spotless

0.1B • Updated Jan 3 • 105

MadlabOSS/LFM2.5-1.2B-Instruct-SDG

1B • Updated Jan 8 • 10 • 1

MadlabOSS/LFM2.5-1.2B-Instruct-SDG-GGUF

1B • Updated Jan 8 • 75 • 1

MadlabOSS/LFM2-2.6B-SDG

3B • Updated Jan 8 • 9

MadlabOSS/LFM2-2.6B-SDG-GGUF

3B • Updated Jan 13 • 118