Models

10

Full-text search

Active filters: kv-cache-quantization

rungalileo/llama-3.2-3B-instruct-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 6

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_int4_awq-kv_int8

Text Generation • Updated Feb 8 • 9

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 23 days ago • 29

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated 23 days ago • 18

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_fp8-kv_fp8

Text Generation • Updated about 14 hours ago • 20

rungalileo/llama-3.2-3b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 23 days ago • 14

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 23 days ago • 11

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_nvfp4-kv_fp8

Text Generation • Updated 23 days ago • 16

rungalileo/llama-3.1-8b-instruct-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 7 days ago • 18

rungalileo/mistral-7b-instruct-v0.3-trtllm-ckpt-wq_w8a8sq-kv_int8

Text Generation • Updated 7 days ago • 14