veg

ciprianv's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in INC4AI/MiMo-V2.5-Pro-int4-mixed 21 days ago

working vllm or sglang command

#1 opened 21 days ago by

ciprianv

New activity in lukealonso/MiMo-V2.5-NVFP4 21 days ago

Looping in OpenCode

👀 1

5

#4 opened about 1 month ago by

Jon-Nielsen

New activity in Qwen/Qwen3.5-397B-A17B-GPTQ-Int4 3 months ago

GPTQ vs Q4 GGUF

👀 3

1

#2 opened 3 months ago by

ciprianv

New activity in mratsim/MiniMax-M2.5-BF16-INT4-AWQ 4 months ago

Cant get it to work on 8x RTX3090

14

#1 opened 4 months ago by

maglat

New activity in lukealonso/MiniMax-M2.5-NVFP4 4 months ago

"w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected."

👍 1

21

#2 opened 4 months ago by

zenmagnets

New activity in mratsim/MiniMax-M2.5-BF16-INT4-AWQ 4 months ago

accuracy

26

#4 opened 4 months ago by

ktsaou

New activity in mratsim/MiniMax-M2.1-BF16-INT4-AWQ 4 months ago

Fastest for my 3090x8

2

#1 opened 4 months ago by

ciprianv

New activity in 0xSero/MiniMax-M2.1-139B 5 months ago

Hey i like the model could you maybe make a NVFP4 version or a version optimised for the dgx spark?

3

#1 opened 5 months ago by

Floris111

New activity in cerebras/GLM-4.7-REAP-218B-A32B 5 months ago

Please create also Minimax 2.1 REAP versions

2

#1 opened 5 months ago by

ciprianv

New activity in unsloth/MiniMax-M2.1-GGUF 5 months ago

Report: getting 20 t/s with UD-Q4_K_XL and 72 VRAM

🔥 2

10

#2 opened 5 months ago by

SlavikF

Hot Damn This Model Cooks!

👍 6

12

#5 opened 5 months ago by

aaron-newsome

New activity in MiniMaxAI/MiniMax-M2.1 5 months ago

Please make 4 bit dwq mlx quant

2

#1 opened 5 months ago by

Narutoouz

New activity in unsloth/Devstral-Small-2-24B-Instruct-2512-GGUF 6 months ago

Please update llama.cpp to see improved performance!

🚀 4

4

#7 opened 6 months ago by

danielhanchen

New activity in unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF 10 months ago

Updated Title: UDQ4_K_XL - Great Rust coder

👍 3

5

#11 opened 10 months ago by

wonderfuldestruction

New activity in unsloth/Qwen3-235B-A22B-Thinking-2507-GGUF 11 months ago

download link creates Q5_K_M instead of UD-Q5_K_XL named files

1

#2 opened 11 months ago by

ciprianv

New activity in Qwen/Qwen3-Coder-480B-A35B-Instruct 11 months ago

Confused about the eval score

❤️ 2

3

#15 opened 11 months ago by

Denisssy

New activity in ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF 11 months ago

IQ3_KS metrics on mixed CUDA + CPU, pretty good model!

🔥 2

34

#2 opened 11 months ago by

Panchovix

New activity in tngtech/DeepSeek-TNG-R1T2-Chimera 11 months ago

What are the recommended settings?

1

#7 opened 11 months ago by

ciprianv

New activity in ubergarm/DeepSeek-R1-0528-GGUF 12 months ago

Thanks for your work! Any chance for something between Q2_K_R and Q3_K_R?

👍👀 5

19

#7 opened about 1 year ago by

Panchovix

New activity in unsloth/DeepSeek-R1-0528-GGUF 12 months ago

Update - Tool Calling + Chat Template bug fixes

9

#20 opened 12 months ago by

danielhanchen