monsoon-nlp
/

dna-blockdiff-2

Model card Files Files and versions

Test version of https://huggingface.co/monsoon-nlp/dna-blockdiff using the custom bd3lms EmbeddingLayer instead of the torch.nn.EmbeddingLayer

Does not seem to stop generating
Does not fix issue with attention on inference
Does not fix issue with torch.where in training

Downloads last month: 8

Safetensors

Model size

98.7M params

Tensor type

F32

·

Model tree for monsoon-nlp/dna-blockdiff-2

Finetunes