Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

563

Full-text search

Active filters: meta-llama/Llama-3.1-8B-Instruct

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 17

ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

starble-dev/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Jul 24, 2024 • 20

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • 3B • Updated Oct 23, 2024 • 3.26k • 12

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • 8B • Updated Sep 22, 2025 • 5.26k • 19

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024

gaianet/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 211

shenzhi-wang/Llama3.1-8B-Chinese-Chat

Text Generation • 8B • Updated Jul 29, 2024 • 5.36k • • 264

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1.53k • 2

joshnader/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 2 • 1

zak66/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024

callitaclue/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 2

pek111/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 243 • 7

xyottax/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024

deven367/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 50

palisaderesearch/Badllama-3.1-8B

Text Generation • 8B • Updated Nov 20, 2024

hoorang/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 25, 2024

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q3_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024 • 1

qwp4w3hyb/Meta-Llama-3.1-8B-Instruct-iMat-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 91 • 6

kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 25, 2024

pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • 8B • Updated Jul 25, 2024

Orion-zhen/Llama3.1-8B-Chinese-Chat-4.0bpw-exl2

Text Generation • Updated Jul 26, 2024 • 1

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • 2B • Updated Aug 28, 2024 • 13 • 13

Morgen0052/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 3

Orion-zhen/Llama3.1-8B-Chinese-Chat-6.5bpw-exl2

Text Generation • Updated Jul 26, 2024 • 5

GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • 8B • Updated Jul 26, 2024 • 7

WongBingbing/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • Updated Jul 26, 2024

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • 8B • Updated Sep 22, 2025 • 26.1k • 30