RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 10
HeavyBERTa
HeavyBERTa is a specialized protein language model built on the RoBERTa architecture, pre-trained on unpaired heavy chain antibody sequences from the OAS (Observed Antibody Space) database.
For further details and access to the code, visit our GitHub repository.
- Downloads last month
- 105
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support