RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper
• 1907.11692 • Published
• 10
HeavyBERTa
HeavyBERTa is a specialized protein language model built on the RoBERTa architecture, pre-trained on unpaired heavy chain antibody sequences from the OAS (Observed Antibody Space) database.
For further details and access to the code, visit our GitHub repository.
- Downloads last month
- 2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support