| | --- |
| | license: other |
| | license_name: server-side-public-license |
| | license_link: https://www.mongodb.com/legal/licensing/server-side-public-license |
| | tags: |
| | - diffusion |
| | - virtual try-on |
| | - virtual try-off |
| | - virtual-try-off |
| | - image generation |
| | - fashion |
| | - e-commerce |
| | base_model: |
| | - CompVis/stable-diffusion-v1-4 |
| | --- |
| | |
| | ## TryOffDiff <small>[[Project Page]][project_page]</small> |
| | |
| | These models are based on the research papers: |
| | 1. _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models"_ [[paper]][paper_arxiv] |
| | 2. _"MGT: Extending Virtual Try-Off to Multi-Garment Scenarios"_ [[paper]][paper2_arxiv] |
| | |
| | Available models: |
| | - `tryoffdiff.pth`: Generates upper-body garments. Fine-tuned on `VITON-HD-train`. |
| | - `tryoffdiffv2_upper.pth`: Generates upper-body garments. Fine-tuned on a subset of `Dress Code-train`. |
| | - `tryoffdiffv2_lower.pth`: Generates lower-body garments. Fine-tuned on a subset of `Dress Code-train`. |
| | - `tryoffdiffv2_dress.pth`: Generates dresses. Fine-tuned on a subset of `Dress Code-train`. |
| | - `tryoffdiffv2_multi.pth` (*MGT*): Generates all three garment types (upper-body, lower-body, dresses). Fine-tuned on the entire `Dress Code-train`. |
| |
|
| | ## Usage |
| |
|
| | > For a complete running example, see the demo code on [HuggingFace Spaces][hf_spaces]. |
| |
|
| | > For more information on training, inference, and evaluation, refer to the [GitHub repository][github]. |
| |
|
| | ## License |
| | TL;DR: Not available for commercial use, unless the FULL source code is shared! \ |
| | This project is intended solely for academic research. No commercial benefits are derived from it. |
| | Models are licensed under [Server Side Public License (SSPL)][license] |
| |
|
| | ## Citation |
| | If you use this work, please give a star ⭐ and a citation: |
| | ``` |
| | @inproceedings{velioglu2025tryoffdiff, |
| | title = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models}, |
| | author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
| | booktitle = {BMVC}, |
| | year = {2025}, |
| | note = {\url{https://doi.org/nt3n}} |
| | } |
| | @inproceedings{velioglu2025mgt, |
| | title = {MGT: Extending Virtual Try-Off to Multi-Garment Scenarios}, |
| | author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
| | booktitle = {ICCVW}, |
| | year = {2025}, |
| | note = {\url{https://doi.org/pn67}} |
| | } |
| | ``` |
| |
|
| | [hf_spaces]: https://huggingface.co/spaces/rizavelioglu/tryoffdiff/blob/main/app.py |
| | [project_page]: https://rizavelioglu.github.io/tryoffdiff/ |
| | [paper_arxiv]: https://arxiv.org/abs/2411.18350 |
| | [paper2_arxiv]: https://arxiv.org/abs/2504.13078 |
| | [github]: https://github.com/rizavelioglu/tryoffdiff |
| | [license]: https://www.mongodb.com/legal/licensing/server-side-public-license |
