meta-llama/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 8.06M • • 1.43k
HIGGS-per-tensor
-
-
inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic
1B • Updated • 16 -
inference-optimization/Llama-3.2-1B-Instruct-NVFP4
0.8B • Updated • 96 -
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-heuristic-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-hybrid-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-5-bits-mode-noise-per-tensor
1B • Updated • 15 -
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-heuristic-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-hybrid-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-5.5-bits-mode-noise-per-tensor
1B • Updated • 13 -
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-heuristic-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-hybrid-per-tensor
1B • Updated • 15 -
inference-optimization/Llama-3.2-1B-Instruct-6-bits-mode-noise-per-tensor
1B • Updated • 13 -
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-heuristic-per-tensor
1B • Updated • 15 -
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-hybrid-per-tensor
1B • Updated • 16 -
inference-optimization/Llama-3.2-1B-Instruct-6.5-bits-mode-noise-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-heuristic-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-hybrid-per-tensor
1B • Updated • 14 -
inference-optimization/Llama-3.2-1B-Instruct-7-bits-mode-noise-per-tensor
1B • Updated • 14 -
meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 2.09M • • 2.14k -
inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic
3B • Updated • 14 -
inference-optimization/Llama-3.2-3B-Instruct-NVFP4
2B • Updated • 395 -
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-heuristic-per-tensor
3B • Updated • 11 -
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-hybrid-per-tensor
3B • Updated • 14 -
inference-optimization/Llama-3.2-3B-Instruct-5-bits-mode-noise-per-tensor
3B • Updated • 16 -
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-heuristic-per-tensor
3B • Updated • 14 -
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-hybrid-per-tensor
3B • Updated • 14 -
inference-optimization/Llama-3.2-3B-Instruct-5.5-bits-mode-noise-per-tensor
3B • Updated • 14 -
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-heuristic-per-tensor
3B • Updated • 23 -
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-hybrid-per-tensor
3B • Updated • 25 -
inference-optimization/Llama-3.2-3B-Instruct-6-bits-mode-noise-per-tensor
3B • Updated • 23 -
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-heuristic-per-tensor
3B • Updated • 25 -
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-hybrid-per-tensor
3B • Updated • 25 -
inference-optimization/Llama-3.2-3B-Instruct-6.5-bits-mode-noise-per-tensor
3B • Updated • 24 -
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-heuristic-per-tensor
3B • Updated • 25 -
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-hybrid-per-tensor
3B • Updated • 24 -
inference-optimization/Llama-3.2-3B-Instruct-7-bits-mode-noise-per-tensor
3B • Updated • 23 -
meta-llama/Llama-3.1-8B-Instruct
Text Generation • 8B • Updated • 10.6M • • 5.89k -
RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic
Text Generation • 8B • Updated • 54.7k • 9 -
RedHatAI/Llama-3.1-8B-Instruct-NVFP4
Text Generation • 5B • Updated • 16.2k • 1 -
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-heuristic-per-tensor
5B • Updated • 34 -
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-hybrid-per-tensor
5B • Updated • 32 -
inference-optimization/Llama-3.1-8B-Instruct-5-bits-mode-noise-per-tensor
5B • Updated • 27 -
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 31 -
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 33 -
inference-optimization/Llama-3.1-8B-Instruct-5.5-bits-mode-noise-per-tensor
6B • Updated • 30 -
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-heuristic-per-tensor
6B • Updated • 31 -
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-hybrid-per-tensor
6B • Updated • 33 -
inference-optimization/Llama-3.1-8B-Instruct-6-bits-mode-noise-per-tensor
6B • Updated • 32 -
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 30 -
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 56 -
inference-optimization/Llama-3.1-8B-Instruct-6.5-bits-mode-noise-per-tensor
7B • Updated • 41 -
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-heuristic-per-tensor
7B • Updated • 41 -
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-hybrid-per-tensor
7B • Updated • 42 -
inference-optimization/Llama-3.1-8B-Instruct-7-bits-mode-noise-per-tensor
7B • Updated • 44 -
Qwen/Qwen3-8B
Text Generation • 8B • Updated • 12.6M • • 1.1k -
RedHatAI/Qwen3-8B-FP8-dynamic
Text Generation • 8B • Updated • 51.6k • 12 -
RedHatAI/Qwen3-8B-NVFP4
Text Generation • 5B • Updated • 1.97k • 2 -
inference-optimization/Qwen3-8B-5-bits-mode-heuristic-per-tensor
6B • Updated • 46 -
inference-optimization/Qwen3-8B-5-bits-mode-hybrid-per-tensor
6B • Updated • 45 -
inference-optimization/Qwen3-8B-5-bits-mode-noise-per-tensor
6B • Updated • 43 -
inference-optimization/Qwen3-8B-5.5-bits-mode-heuristic-per-tensor
6B • Updated • 48 -
inference-optimization/Qwen3-8B-5.5-bits-mode-hybrid-per-tensor
6B • Updated • 46 -
inference-optimization/Qwen3-8B-5.5-bits-mode-noise-per-tensor
6B • Updated • 42 -
inference-optimization/Qwen3-8B-6-bits-mode-heuristic-per-tensor
6B • Updated • 45 -
inference-optimization/Qwen3-8B-6-bits-mode-hybrid-per-tensor
6B • Updated • 45 -
inference-optimization/Qwen3-8B-6-bits-mode-noise-per-tensor
6B • Updated • 44 -
inference-optimization/Qwen3-8B-6.5-bits-mode-heuristic-per-tensor
7B • Updated • 55 -
inference-optimization/Qwen3-8B-6.5-bits-mode-hybrid-per-tensor
7B • Updated • 45 -
inference-optimization/Qwen3-8B-6.5-bits-mode-noise-per-tensor
6B • Updated • 47 -
inference-optimization/Qwen3-8B-7-bits-mode-heuristic-per-tensor
7B • Updated • 75 -
inference-optimization/Qwen3-8B-7-bits-mode-hybrid-per-tensor
7B • Updated • 68 -
inference-optimization/Qwen3-8B-7-bits-mode-noise-per-tensor
6B • Updated • 57 -
Qwen/Qwen3-30B-A3B
Text Generation • 31B • Updated • 1.95M • • 891 -
RedHatAI/Qwen3-30B-A3B-FP8-dynamic
Text Generation • 31B • Updated • 127k • 3 -
RedHatAI/Qwen3-30B-A3B-NVFP4
Text Generation • 17B • Updated • 27.3k • 2 -
inference-optimization/Qwen3-30B-A3B-5-bits-mode-heuristic-per-tensor
19B • Updated • 27 -
inference-optimization/Qwen3-30B-A3B-5-bits-mode-hybrid-per-tensor
19B • Updated • 30 -
inference-optimization/Qwen3-30B-A3B-5-bits-mode-noise-per-tensor
19B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 27 -
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 26 -
inference-optimization/Qwen3-30B-A3B-5.5-bits-mode-noise-per-tensor
21B • Updated • 29 -
inference-optimization/Qwen3-30B-A3B-6-bits-mode-heuristic-per-tensor
23B • Updated • 47 -
inference-optimization/Qwen3-30B-A3B-6-bits-mode-hybrid-per-tensor
23B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-6-bits-mode-noise-per-tensor
23B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 30 -
inference-optimization/Qwen3-30B-A3B-6.5-bits-mode-noise-per-tensor
25B • Updated • 33 -
inference-optimization/Qwen3-30B-A3B-7-bits-mode-heuristic-per-tensor
27B • Updated • 43 -
inference-optimization/Qwen3-30B-A3B-7-bits-mode-hybrid-per-tensor
27B • Updated • 29 -
inference-optimization/Qwen3-30B-A3B-7-bits-mode-noise-per-tensor
27B • Updated • 28 -
Qwen/Qwen3-30B-A3B-Instruct-2507
Text Generation • 31B • Updated • 1.07M • • 810 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-FP8-Dynamic
31B • Updated • 45 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-NVFP4
17B • Updated • 44 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-heuristic-per-tensor
19B • Updated • 38 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-hybrid-per-tensor
19B • Updated • 29 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5-bits-mode-noise-per-tensor
19B • Updated • 29 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-heuristic-per-tensor
21B • Updated • 31 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-hybrid-per-tensor
21B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-5.5-bits-mode-noise-per-tensor
21B • Updated • 32 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-heuristic-per-tensor
23B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-hybrid-per-tensor
23B • Updated • 31 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6-bits-mode-noise-per-tensor
23B • Updated • 30 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-heuristic-per-tensor
25B • Updated • 31 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-hybrid-per-tensor
25B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-6.5-bits-mode-noise-per-tensor
25B • Updated • 29 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-heuristic-per-tensor
27B • Updated • 28 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-hybrid-per-tensor
27B • Updated • 31 -
inference-optimization/Qwen3-30B-A3B-Instruct-2507-7-bits-mode-noise-per-tensor
26B • Updated • 30