MLX Quantisations for Qwen 3.8 2B
🏗️ Building on HF
Siddh Jagani
SiddhJagani
AI & ML interests
Building local AI systems, LLM tools, RAG infrastructure, and MLX model deployments.
Recent Activity
liked a model 10 days ago
prithivMLmods/chandra-ocr-2-GGUF liked a model 11 days ago
ISTA-DASLab/Qwen3.8-Flash-Next-GSQ-RCO-GGUF updated a Space about 2 months ago
SiddhJagani/StatsOrganizations
MLX Quantisations for Qwen 3.8 9B
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 22 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 26 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 19 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 17
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 199 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 43 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 29 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 31
MLX Quantisations for Qwen 3.8 4B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 29 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 30
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 41 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 28 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 41 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 51
MLX Quantisations for Qwen 3.8 2B
MLX Quantisations for Qwen 3.8 4B
MLX Quantisations for Qwen 3.8 9B
MLX 8B Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 8B • Updated • 28 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 8B • Updated • 29 -
SiddhJagani/Nemotron-Cascade-8B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q4
Text Generation • 8B • Updated • 30
MLX Claude Opus 4.5
-
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q8
Text Generation • 15B • Updated • 22 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q6
Text Generation • 15B • Updated • 26 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q3
Text Generation • 15B • Updated • 19 -
SiddhJagani/Nemotron-Cascade-14B-Thinking-Claude-4.5-Opus-High-Reasoning-Distill-mlx-Q2
Text Generation • 15B • Updated • 17
MLX Based GPT-OSS-Safeguard models
-
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q2
Text Generation • 21B • Updated • 41 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q3
Text Generation • 21B • Updated • 28 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q4
Text Generation • 21B • Updated • 41 -
SiddhJagani/gpt-oss-safeguard-20b-mlx-Q6
Text Generation • 21B • Updated • 51
MLX Non-Thinking Models
-
SiddhJagani/gpt-oss-20b-no-think-mlx-2Bit
Text Generation • 21B • Updated • 199 • 2 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q3
Text Generation • 21B • Updated • 43 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q4
Text Generation • 21B • Updated • 29 -
SiddhJagani/gpt-oss-20b-no-think-mlx-Q6
Text Generation • 21B • Updated • 31