Add DecoderTCR V0.3 weights (nested layout) + MIT model card
#4
by bl-2633 - opened
- DecoderTCR-ESM2-V0.1/3B_DecoderTCR.ckpt +3 -0
- DecoderTCR-ESM2-V0.1/650M_DecoderTCR.ckpt +3 -0
- DecoderTCR-ESMC-V0.3/300M.ckpt +3 -0
- DecoderTCR-ESMC-V0.3/600M.ckpt +3 -0
- DecoderTCR-ESMC-V0.3/6B.ckpt +3 -0
- LICENSE +9 -0
- README.md +24 -9
DecoderTCR-ESM2-V0.1/3B_DecoderTCR.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fc369f2387dc922660492df86e38cfcff65812201929558cfece4e6e674d3553
|
| 3 |
+
size 11356181292
|
DecoderTCR-ESM2-V0.1/650M_DecoderTCR.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:bf88513fabdfec601f2019cb13fb27a2980b370131a488cab3ab1e53bda483a5
|
| 3 |
+
size 2604318926
|
DecoderTCR-ESMC-V0.3/300M.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:18d47c169d0ce992152838b8229e1c682b0a681f55057b471dcdcbf07d2fcad9
|
| 3 |
+
size 3996365253
|
DecoderTCR-ESMC-V0.3/600M.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4d3c84f30e3781c023e412eb3f3c098ef9fe64fd1423fd34df4b40b9dcbac0aa
|
| 3 |
+
size 2300241260
|
DecoderTCR-ESMC-V0.3/6B.ckpt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b6bd3170b55a9a06d9c1472e248bd083e092afc7924439b444bf7379b74ab692
|
| 3 |
+
size 25408220584
|
LICENSE
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
License (MIT)
|
| 2 |
+
|
| 3 |
+
Copyright 2026 Chan Zuckerberg Biohub, Inc.
|
| 4 |
+
|
| 5 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
|
| 6 |
+
|
| 7 |
+
The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
|
| 8 |
+
|
| 9 |
+
THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
|
README.md
CHANGED
|
@@ -1,15 +1,20 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
| 4 |
|
| 5 |
-
# DecoderTCR
|
| 6 |
-
DecoderTCR is a protein language model for T-cell receptor (TCR) & peptide-MHC complexes. The
|
| 7 |
|
| 8 |
For Model Code and additional information on installation/usage please see [the associated GitHub repository](https://github.com/czbiohub-chi/DecoderTCR)
|
| 9 |
|
| 10 |
## Model Architecture
|
| 11 |
|
| 12 |
-
DecoderTCR is built on a Transformer-based protein language model (ESM2
|
| 13 |
|
| 14 |
### Core Architecture
|
| 15 |
|
|
@@ -39,12 +44,17 @@ The model follows the **ESM2** architecture, a deep Transformer encoder designed
|
|
| 39 |
The model is initialized from a pretrained **ESM2 checkpoint** and further trained via continual pretraining with MLM objectives.
|
| 40 |
|
| 41 |
|
| 42 |
-
###
|
| 43 |
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
|
| 47 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 48 |
|
| 49 |
### Model Card Authors
|
| 50 |
|
|
@@ -172,7 +182,12 @@ Should you have any security or privacy issues or questions related to the servi
|
|
| 172 |
## Acknowledgements
|
| 173 |
|
| 174 |
This model builds upon:
|
| 175 |
-
- **ESM2** by Meta AI (Facebook Research) for the base protein language model
|
|
|
|
| 176 |
- The broader computational biology and immunology research communities
|
| 177 |
|
| 178 |
Special thanks to the developers and contributors of the ESM models and the open-source tools that made this work possible.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
+
tags:
|
| 4 |
+
- MLM
|
| 5 |
+
- Protein
|
| 6 |
+
- TCR
|
| 7 |
+
- Immunology
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# DecoderTCR
|
| 11 |
+
DecoderTCR is a protein language model for T-cell receptor (TCR) & peptide-MHC complexes. The models are based on the ESM2 and ESMC model families.
|
| 12 |
|
| 13 |
For Model Code and additional information on installation/usage please see [the associated GitHub repository](https://github.com/czbiohub-chi/DecoderTCR)
|
| 14 |
|
| 15 |
## Model Architecture
|
| 16 |
|
| 17 |
+
DecoderTCR is built on a Transformer-based protein language model (ESM2 and ESMC families).
|
| 18 |
|
| 19 |
### Core Architecture
|
| 20 |
|
|
|
|
| 44 |
The model is initialized from a pretrained **ESM2 checkpoint** and further trained via continual pretraining with MLM objectives.
|
| 45 |
|
| 46 |
|
| 47 |
+
### Released Models
|
| 48 |
|
| 49 |
+
This repository hosts two model lines. The **V0.3 ESMC** line (`DecoderTCR-ESMC`) is the current default; the **V0.1 ESM2** line is retained for paper reproduction.
|
| 50 |
+
|
| 51 |
+
| Model | File | Backbone | Parameters | Layers | Hidden Dim | Attention Heads |
|
| 52 |
+
| --- | --- | --- | --- | --- | --- | --- |
|
| 53 |
+
| DecoderTCR-ESMC 300M | `DecoderTCR-ESMC-V0.3/300M.ckpt` | ESMC | ~300M | 30 | 960 | 15 |
|
| 54 |
+
| DecoderTCR-ESMC 600M (default) | `DecoderTCR-ESMC-V0.3/600M.ckpt` | ESMC | ~600M | 36 | 1152 | 18 |
|
| 55 |
+
| DecoderTCR-ESMC 6B | `DecoderTCR-ESMC-V0.3/6B.ckpt` | ESMC | ~6B | 80 | 2560 | 40 |
|
| 56 |
+
| DecoderTCR 650M | `DecoderTCR-ESM2-V0.1/650M_DecoderTCR.ckpt` | ESM2 | ~650M | 33 | 1280 | 20 |
|
| 57 |
+
| DecoderTCR 3B | `DecoderTCR-ESM2-V0.1/3B_DecoderTCR.ckpt` | ESM2 | ~3B | 36 | 2560 | 40 |
|
| 58 |
|
| 59 |
### Model Card Authors
|
| 60 |
|
|
|
|
| 182 |
## Acknowledgements
|
| 183 |
|
| 184 |
This model builds upon:
|
| 185 |
+
- **ESM2** by Meta AI (Facebook Research) for the ESM2 base protein language model
|
| 186 |
+
- **ESMC** released by Chan Zuckerberg Biohub (https://github.com/Biohub/esm) for the ESMC base protein language model
|
| 187 |
- The broader computational biology and immunology research communities
|
| 188 |
|
| 189 |
Special thanks to the developers and contributors of the ESM models and the open-source tools that made this work possible.
|
| 190 |
+
|
| 191 |
+
## License
|
| 192 |
+
|
| 193 |
+
DecoderTCR code and all released weights are distributed under the [MIT license](https://github.com/czbiohub-chi/DecoderTCR/blob/main/LICENSE). The base backbones are likewise MIT: ESM2 (Meta AI) and ESMC (Chan Zuckerberg Biohub, https://github.com/Biohub/esm).
|