Inference Providers
Active filters: 8bit
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation • 9B • Updated • 8.07k
• 116
alokabhishek/Meta-Llama-3-8B-Instruct-bnb-8bit
Text Generation • 8B • Updated • 18
• 3
legraphista/Phi-3.5-mini-instruct-IMat-GGUF
Text Generation • 4B • Updated • 1.44k
• 3
mlx-community/LFM2-8B-A1B-8bit-MLX
Text Generation • 8B • Updated • 100
• 8
appautomaton/cohere-asr-mlx
Automatic Speech Recognition • Updated • 7
mlx-community/gemma-4-12B-it-qat-OptiQ-4bit
Text Generation • 12B • Updated • 5.76k
• 23
mlx-community/ThinkingCap-Qwen3.6-27B-OptiQ-4bit
Image-Text-to-Text • 27B • Updated • 357
• 5
mlx-community/gemma-4-12B-coder-fable5-composer2.5-v1-OptiQ-4bit
Image-Text-to-Text • 12B • Updated • 1.13k
• 12
mlx-community/Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit
Text Generation • 24B • Updated • 1.31k
• 5
mlx-community/DeepSeek-V4-Pro-Qwen3.5-9B-8bit
Image-Text-to-Text • 9B • Updated • 857
• 3
mlx-community/humanizer-12b-OptiQ-4bit
Text Generation • 12B • Updated • 661
• 7
cguldogan/MiniMax-H3-Image-MLX-8bit
Text-to-Image • Updated • 101
• 1
mlx-community/NVIDIA-Nemotron-Labs-Dory1.0-4B-MLX-8bit
Text Generation • 4B • Updated • 380
• 1
nativ-community/SenseNova-Loop-9B-8bit
Image-Text-to-Text • 9B • Updated • 26
• 1
digiflow/Huihui-Qwen3.8-27B-Coder390-EfficientThink-abliterated-MLX-8bit
Text Generation • 27B • Updated • 556
• 1
Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF
Image-Text-to-Text • 25B • Updated • 18.4k
• 103
crumb/gpt-j-6b-finetune-super-glue
Text Generation • Updated • 12
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation • 6B • Updated • 34
• 7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation • 6B • Updated • 59
• 5
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation • Updated • 17
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation • Updated • 21
• 4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization • 3B • Updated • 20
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation • Updated • 13
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation • Updated • 22
• 1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation • 7B • Updated • 23
• 7
Trelis/mpt-7b-instruct-hosted-inference-8bit
Text Generation • Updated • 31
ecastera/eva-mistral-catmacaroni-7b-spanish
Text Generation • 7B • Updated • 16
• 3
ecastera/eva-mistral-turdus-7b-spanish
Text Generation • 7B • Updated • 11
ecastera/eva-mistral-7b-spanish-GGUF
7B • Updated • 105
• 11
BioMistral/BioMistral-7B-BnB.8
Text Generation • 7B • Updated • 21