Add DecoderTCR V0.3 weights (nested layout) + MIT model card

#4
by bl-2633 - opened
DecoderTCR-ESM2-V0.1/3B_DecoderTCR.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc369f2387dc922660492df86e38cfcff65812201929558cfece4e6e674d3553
3
+ size 11356181292
DecoderTCR-ESM2-V0.1/650M_DecoderTCR.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bf88513fabdfec601f2019cb13fb27a2980b370131a488cab3ab1e53bda483a5
3
+ size 2604318926
DecoderTCR-ESMC-V0.3/300M.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18d47c169d0ce992152838b8229e1c682b0a681f55057b471dcdcbf07d2fcad9
3
+ size 3996365253
DecoderTCR-ESMC-V0.3/600M.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d3c84f30e3781c023e412eb3f3c098ef9fe64fd1423fd34df4b40b9dcbac0aa
3
+ size 2300241260
DecoderTCR-ESMC-V0.3/6B.ckpt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6bd3170b55a9a06d9c1472e248bd083e092afc7924439b444bf7379b74ab692
3
+ size 25408220584
LICENSE ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ License (MIT)
2
+
3
+ Copyright 2026 Chan Zuckerberg Biohub, Inc.
4
+
5
+ Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the “Software”), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:
6
+
7
+ The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.
8
+
9
+ THE SOFTWARE IS PROVIDED “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.
README.md CHANGED
@@ -1,15 +1,20 @@
1
  ---
2
  license: mit
 
 
 
 
 
3
  ---
4
 
5
- # DecoderTCR v0.1
6
- DecoderTCR is a protein language model for T-cell receptor (TCR) & peptide-MHC complexes. The model is based on the ESM2 model family.
7
 
8
  For Model Code and additional information on installation/usage please see [the associated GitHub repository](https://github.com/czbiohub-chi/DecoderTCR)
9
 
10
  ## Model Architecture
11
 
12
- DecoderTCR is built on a Transformer-based protein language model (ESM2 family).
13
 
14
  ### Core Architecture
15
 
@@ -39,12 +44,17 @@ The model follows the **ESM2** architecture, a deep Transformer encoder designed
39
  The model is initialized from a pretrained **ESM2 checkpoint** and further trained via continual pretraining with MLM objectives.
40
 
41
 
42
- ### Model Scale (Example Configurations)
43
 
44
- | Model Variant | Parameters | Layers | Hidden Dim | Attention Heads |
45
- | --- | --- | --- | --- | --- |
46
- | ESM2-650M | ~650M | 33 | 1280 | 20 |
47
- | ESM2-3B | ~3B | 36 | 2560 | 40 |
 
 
 
 
 
48
 
49
  ### Model Card Authors
50
 
@@ -172,7 +182,12 @@ Should you have any security or privacy issues or questions related to the servi
172
  ## Acknowledgements
173
 
174
  This model builds upon:
175
- - **ESM2** by Meta AI (Facebook Research) for the base protein language model
 
176
  - The broader computational biology and immunology research communities
177
 
178
  Special thanks to the developers and contributors of the ESM models and the open-source tools that made this work possible.
 
 
 
 
 
1
  ---
2
  license: mit
3
+ tags:
4
+ - MLM
5
+ - Protein
6
+ - TCR
7
+ - Immunology
8
  ---
9
 
10
+ # DecoderTCR
11
+ DecoderTCR is a protein language model for T-cell receptor (TCR) & peptide-MHC complexes. The models are based on the ESM2 and ESMC model families.
12
 
13
  For Model Code and additional information on installation/usage please see [the associated GitHub repository](https://github.com/czbiohub-chi/DecoderTCR)
14
 
15
  ## Model Architecture
16
 
17
+ DecoderTCR is built on a Transformer-based protein language model (ESM2 and ESMC families).
18
 
19
  ### Core Architecture
20
 
 
44
  The model is initialized from a pretrained **ESM2 checkpoint** and further trained via continual pretraining with MLM objectives.
45
 
46
 
47
+ ### Released Models
48
 
49
+ This repository hosts two model lines. The **V0.3 ESMC** line (`DecoderTCR-ESMC`) is the current default; the **V0.1 ESM2** line is retained for paper reproduction.
50
+
51
+ | Model | File | Backbone | Parameters | Layers | Hidden Dim | Attention Heads |
52
+ | --- | --- | --- | --- | --- | --- | --- |
53
+ | DecoderTCR-ESMC 300M | `DecoderTCR-ESMC-V0.3/300M.ckpt` | ESMC | ~300M | 30 | 960 | 15 |
54
+ | DecoderTCR-ESMC 600M (default) | `DecoderTCR-ESMC-V0.3/600M.ckpt` | ESMC | ~600M | 36 | 1152 | 18 |
55
+ | DecoderTCR-ESMC 6B | `DecoderTCR-ESMC-V0.3/6B.ckpt` | ESMC | ~6B | 80 | 2560 | 40 |
56
+ | DecoderTCR 650M | `DecoderTCR-ESM2-V0.1/650M_DecoderTCR.ckpt` | ESM2 | ~650M | 33 | 1280 | 20 |
57
+ | DecoderTCR 3B | `DecoderTCR-ESM2-V0.1/3B_DecoderTCR.ckpt` | ESM2 | ~3B | 36 | 2560 | 40 |
58
 
59
  ### Model Card Authors
60
 
 
182
  ## Acknowledgements
183
 
184
  This model builds upon:
185
+ - **ESM2** by Meta AI (Facebook Research) for the ESM2 base protein language model
186
+ - **ESMC** released by Chan Zuckerberg Biohub (https://github.com/Biohub/esm) for the ESMC base protein language model
187
  - The broader computational biology and immunology research communities
188
 
189
  Special thanks to the developers and contributors of the ESM models and the open-source tools that made this work possible.
190
+
191
+ ## License
192
+
193
+ DecoderTCR code and all released weights are distributed under the [MIT license](https://github.com/czbiohub-chi/DecoderTCR/blob/main/LICENSE). The base backbones are likewise MIT: ESM2 (Meta AI) and ESMC (Chan Zuckerberg Biohub, https://github.com/Biohub/esm).