Performance Test on MacBook Max – 77 tokens/s for a 1k‑token Task

#1
by cutiedeng - opened

Ran the model on my MacBook Max and got 77 tokens/s for a 1,000‑token task. Thanks for the great work on the model!

this model was a turning point for me, its when the models started going from meh to literal empirical least damaged possible while being fully uncensored.

aappreciate your usage.

dealignai changed discussion status to closed

Sign up or log in to comment