matatonic

matatonic's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in mradermacher/model_requests 7 months ago

https://huggingface.co/Qwen/Qwen3-235B-A22B-Instruct-2507 imatrix

9

#1186 opened 7 months ago by

matatonic

New activity in matatonic/Qwen2.5-Coder-0.5B-8.0bpw-h8-exl2 10 months ago

Improve language tag

#1 opened 10 months ago by

lbourdois

New activity in matatonic/Qwen2.5-Coder-14B-6.5bpw-h8-exl2 10 months ago

Improve language tag

#1 opened 10 months ago by

lbourdois

New activity in matatonic/QwQ-32B-4.25bpw-exl2 10 months ago

Improve language tag

#1 opened 10 months ago by

lbourdois

New activity in matatonic/QwQ-32B-6.5bpw-h8-exl2 10 months ago

Improve language tag

#1 opened 10 months ago by

lbourdois

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2 10 months ago

Improve language tag

#2 opened 10 months ago by

lbourdois

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-4.5bpw-exl2 10 months ago

Improve language tag

#1 opened 10 months ago by

lbourdois

New activity in YiXin-AILab/YiXin-Distill-Qwen-72B 12 months ago

Can you quantify exl2 4.5bpw of this model?

5

#1 opened 12 months ago by

xldistance

New activity in matatonic/r1-1776-distill-llama-70b-abliterated-6.5bpw-h8-exl2 about 1 year ago

Can you train this model for 4.5bpw quantization?

2

#1 opened about 1 year ago by

xldistance

New activity in matatonic/Qwen2.5-72B-Instruct-abliterated-v2-6.5bpw-h8-exl2 about 1 year ago

Can you produce a 4.5bpw quantized model of this model?

2

#1 opened about 1 year ago by

xldistance

New activity in matatonic/r1-1776-distill-llama-70b-6.5bpw-h8-exl2 about 1 year ago

Running 1776 with draft model

1

#1 opened about 1 year ago by

ernestr

New activity in cyan2k/molmo-7B-D-bnb-4bit over 1 year ago

conversion script please

5

#2 opened over 1 year ago by

ctranslate2-4you

New activity in Qwen/Qwen2-VL-7B-Instruct-AWQ over 1 year ago

config.json breaking change?

😔 1

2

#4 opened over 1 year ago by

matatonic

New activity in internlm/internlm-xcomposer2d5-7b over 1 year ago

xcomposer2d5 3rd party sft support

3

#12 opened over 1 year ago by

tastelikefeet

New activity in OpenGVLab/InternVL-Chat-V1-5-AWQ almost 2 years ago

How to load without lmdeploy?

6

#1 opened almost 2 years ago by

matatonic

New activity in qihoo360/360VL-70B almost 2 years ago

Fix invalid quotes in modeling_360vl.py

5

#1 opened almost 2 years ago by

matatonic

New activity in echo840/Monkey almost 2 years ago

problem loading tokenizer

5

#4 opened almost 2 years ago by

matatonic

New activity in dphn/dolphin-2.2-70b over 2 years ago

Safetensors version?

6

#2 opened over 2 years ago by

matatonic

New activity in TheBloke/guanaco-7B-GGML over 2 years ago

Problems with guanaco-7B.ggmlv3.q3_K_S.bin

3

#3 opened over 2 years ago by

matatonic

Problems with guanaco-7B.ggmlv3.q3_K_S.bin

3

#3 opened over 2 years ago by

matatonic