Duplicated from PhysiQuanty/Patent-Test-Radix-65536-AutoTokenizer_FineTune
Tokenizer-free / base-N model export.
from transformers import AutoModelForCausalLM m = AutoModelForCausalLM.from_pretrained("./hf_binaryllm_repo", trust_remote_code=True)
Base model