HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
Taykhoom Dalal
Taykhoom
·
AI & ML interests
None yet
Recent Activity
updated a collection about 10 hours ago
ERNIE-RNA updated a model about 10 hours ago
Taykhoom/ERNIE-RNA published a model about 10 hours ago
Taykhoom/ERNIE-RNAOrganizations
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
MSA-based RNA language model trained on homologous RNA sequence alignments.
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
RNABERT: RNA language model for clustering and structural alignment.
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).
HF port of ERNIE-RNA: RNA language model with 2D structural pairing bias
SpliceBERT RNA language model: 3 variants (1024nt vertebrate, 510nt vertebrate, 510nt human)
DNABERT family: k-mer variants (3/4/5/6), DNABERT-2 (BPE+ALiBi), and DNABERT-S (species-aware). All with Flash Attention 2 and SDPA.
UTRBERT: BERT-base models pre-trained on 3-prime UTR sequences, 3- through 6-mer tokenization.
MSA-based RNA language model trained on homologous RNA sequence alignments.
RNABERT: RNA language model for clustering and structural alignment.
Minimal HuggingFace ports of RiNALMo RNA language model (micro, mega, giga).
Minimal HuggingFace ports of UTR-LM RNA language model, with four checkpoints covering different auxiliary objectives (MLM, MFE, secondary structure).