Resources HuggingFaceFW/fineweb Viewer • Updated Jul 11, 2025 • 52.5B • 602k • 2.88k CohereLabs/aya_dataset Viewer • Updated Apr 15, 2025 • 206k • 8.95k • 352 CohereLabs/tiny-aya-global Text Generation • 3B • Updated May 1 • 23.1k • • 159
PolyGloss GlossLM v2 lecslab/polygloss-corpus Viewer • Updated Dec 11, 2025 • 353k • 96 • 4 lecslab/polygloss-byt5-interleaved-2025-12-28 0.6B • Updated Feb 21 • 83 lecslab/polygloss-byt5-multitask-2025-12-28 Updated Dec 29, 2025 • 9 lecslab/polygloss-byt5-concat-2025-12-28 Updated Dec 29, 2025 • 6
Spec Decoding lecslab/biling_ber Viewer • Updated May 1 • 354k • 342 lecslab/biling_chr Viewer • Updated May 1 • 10.9k • 58 lecslab/biling_haw Viewer • Updated May 1 • 121 • 25 lecslab/biling_ibo Viewer • Updated May 1 • 1.75k • 126
GlossLM Multilingual IGT corpora and pretrained models lecslab/glosslm 0.6B • Updated Nov 4, 2024 • 13 • 3 lecslab/glosslm-unimorph-st_unseg_only 0.6B • Updated Jun 13, 2024 • 4 lecslab/glosslm-corpus Viewer • Updated Nov 4, 2024 • 451k • 61 • 2 lecslab/glosslm-corpus-split Viewer • Updated Mar 10, 2024 • 556k • 509
Resources HuggingFaceFW/fineweb Viewer • Updated Jul 11, 2025 • 52.5B • 602k • 2.88k CohereLabs/aya_dataset Viewer • Updated Apr 15, 2025 • 206k • 8.95k • 352 CohereLabs/tiny-aya-global Text Generation • 3B • Updated May 1 • 23.1k • • 159
Spec Decoding lecslab/biling_ber Viewer • Updated May 1 • 354k • 342 lecslab/biling_chr Viewer • Updated May 1 • 10.9k • 58 lecslab/biling_haw Viewer • Updated May 1 • 121 • 25 lecslab/biling_ibo Viewer • Updated May 1 • 1.75k • 126
PolyGloss GlossLM v2 lecslab/polygloss-corpus Viewer • Updated Dec 11, 2025 • 353k • 96 • 4 lecslab/polygloss-byt5-interleaved-2025-12-28 0.6B • Updated Feb 21 • 83 lecslab/polygloss-byt5-multitask-2025-12-28 Updated Dec 29, 2025 • 9 lecslab/polygloss-byt5-concat-2025-12-28 Updated Dec 29, 2025 • 6
GlossLM Multilingual IGT corpora and pretrained models lecslab/glosslm 0.6B • Updated Nov 4, 2024 • 13 • 3 lecslab/glosslm-unimorph-st_unseg_only 0.6B • Updated Jun 13, 2024 • 4 lecslab/glosslm-corpus Viewer • Updated Nov 4, 2024 • 451k • 61 • 2 lecslab/glosslm-corpus-split Viewer • Updated Mar 10, 2024 • 556k • 509