it's the same size as FP16? (April 2nd 2026)
#1
by wijjjj - opened
I'm curious how this is supposed to be FP8? Thanks in advance for any hints.
Must be wrong size.
The major MOE layers (128 Experts) are still in BF16.
looking for nvfp4 ，so I can run it with single 5090