qaihm-bot commited on
Commit
eec749f
·
verified ·
1 Parent(s): b4d837b

See https://github.com/quic/ai-hub-models/releases/v0.47.0 for changelog.

Files changed (1) hide show
  1. README.md +105 -95
README.md CHANGED
@@ -28,25 +28,27 @@ Below are pre-exported model assets ready for deployment.
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x_elite.zip)
32
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8gen3.zip)
33
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs8550_proxy.zip)
34
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
35
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_7gen4.zip)
36
- | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
37
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcm6690.zip)
38
- | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | QAIRT 2.37, ONNX Runtime 1.23.0 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs9075.zip)
39
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x_elite.zip)
40
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8gen3.zip)
41
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8275_proxy.zip)
42
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8550_proxy.zip)
43
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa8775p.zip)
44
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
45
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_7gen4.zip)
46
- | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
47
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa7255p.zip)
48
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcm6690.zip)
49
- | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | QAIRT 2.42 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.46.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs9075.zip)
 
 
50
 
51
  For more device-specific assets and performance metrics, visit **[ControlNet-Canny on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/controlnet_canny)**.
52
 
@@ -78,82 +80,90 @@ See our repository for [ControlNet-Canny on GitHub](https://github.com/quic/ai-h
78
  ## Performance Summary
79
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
80
  |---|---|---|---|---|---|---
81
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 59.129 ms | 351 - 351 MB | NPU
82
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 45.568 ms | 33 - 45 MB | NPU
83
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 60.057 ms | 30 - 31 MB | NPU
84
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 58.171 ms | 30 - 34 MB | NPU
85
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 1040.403 ms | 0 - 10 MB | NPU
86
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 33.962 ms | 32 - 43 MB | NPU
87
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 113.204 ms | 33 - 39 MB | NPU
88
- | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.884 ms | 31 - 42 MB | NPU
89
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 75.85 ms | 2 - 2 MB | NPU
90
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 59.518 ms | 2 - 10 MB | NPU
91
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 139.916 ms | 2 - 10 MB | NPU
92
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 83.656 ms | 2 - 10 MB | NPU
93
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 76.946 ms | 2 - 11 MB | NPU
94
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 75.284 ms | 0 - 16 MB | NPU
95
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 964.957 ms | 2 - 8 MB | NPU
96
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 139.916 ms | 2 - 10 MB | NPU
97
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 46.052 ms | 2 - 10 MB | NPU
98
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 124.414 ms | 2 - 8 MB | NPU
99
- | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 28.773 ms | 2 - 11 MB | NPU
100
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 5.624 ms | 157 - 157 MB | NPU
101
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 3.96 ms | 0 - 7 MB | NPU
102
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 5.414 ms | 0 - 162 MB | NPU
103
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 5.438 ms | 0 - 3 MB | NPU
104
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 28.302 ms | 0 - 6 MB | NPU
105
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 3.167 ms | 0 - 7 MB | NPU
106
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 5.778 ms | 0 - 6 MB | NPU
107
- | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 2.635 ms | 0 - 10 MB | NPU
108
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 3.608 ms | 0 - 0 MB | NPU
109
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.305 ms | 0 - 7 MB | NPU
110
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 7.549 ms | 0 - 8 MB | NPU
111
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.239 ms | 0 - 2 MB | NPU
112
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 3.505 ms | 0 - 9 MB | NPU
113
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 3.304 ms | 0 - 2 MB | NPU
114
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 22.025 ms | 0 - 6 MB | NPU
115
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 7.549 ms | 0 - 8 MB | NPU
116
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.749 ms | 0 - 13 MB | NPU
117
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.636 ms | 0 - 7 MB | NPU
118
- | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.492 ms | 0 - 10 MB | NPU
119
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 115.766 ms | 829 - 829 MB | NPU
120
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 84.074 ms | 13 - 26 MB | NPU
121
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 117.53 ms | 0 - 883 MB | NPU
122
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 109.17 ms | 11 - 26 MB | NPU
123
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 2160.0 ms | 10 - 21 MB | NPU
124
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 67.33 ms | 6 - 17 MB | NPU
125
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 177.928 ms | 9 - 19 MB | NPU
126
- | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 46.028 ms | 13 - 23 MB | NPU
127
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 113.746 ms | 13 - 13 MB | NPU
128
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.577 ms | 13 - 20 MB | NPU
129
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 264.31 ms | 8 - 15 MB | NPU
130
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.347 ms | 10 - 12 MB | NPU
131
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 106.976 ms | 10 - 17 MB | NPU
132
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 106.531 ms | 11 - 25 MB | NPU
133
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 2039.478 ms | 13 - 24 MB | NPU
134
- | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 264.31 ms | 8 - 15 MB | NPU
135
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 61.075 ms | 6 - 18 MB | NPU
136
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 179.697 ms | 10 - 15 MB | NPU
137
- | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 47.215 ms | 13 - 22 MB | NPU
138
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 219.597 ms | 59 - 59 MB | NPU
139
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 163.642 ms | 4 - 11 MB | NPU
140
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 219.435 ms | 0 - 66 MB | NPU
141
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 207.133 ms | 3 - 6 MB | NPU
142
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 5359.841 ms | 0 - 7 MB | NPU
143
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 147.795 ms | 3 - 16 MB | NPU
144
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 445.729 ms | 3 - 9 MB | NPU
145
- | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 89.515 ms | 3 - 14 MB | NPU
146
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 266.163 ms | 0 - 0 MB | NPU
147
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 202.114 ms | 0 - 8 MB | NPU
148
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 725.838 ms | 0 - 9 MB | NPU
149
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 273.289 ms | 1 - 5 MB | NPU
150
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 1136.64 ms | 0 - 9 MB | NPU
151
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 249.997 ms | 0 - 3 MB | NPU
152
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 6374.38 ms | 0 - 6 MB | NPU
153
- | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 725.838 ms | 0 - 9 MB | NPU
154
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 178.859 ms | 0 - 13 MB | NPU
155
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 512.932 ms | 0 - 6 MB | NPU
156
- | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 116.219 ms | 0 - 9 MB | NPU
 
 
 
 
 
 
 
 
157
 
158
  ## License
159
  * The license for the original implementation of ControlNet-Canny can be found
 
28
 
29
  | Runtime | Precision | Chipset | SDK Versions | Download |
30
  |---|---|---|---|---|
31
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x_elite.zip)
32
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8gen3.zip)
33
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs8550_proxy.zip)
34
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
35
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_7gen4.zip)
36
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
37
+ | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_snapdragon_x2_elite.zip)
38
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcm6690.zip)
39
+ | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | QAIRT 2.42, ONNX Runtime 1.24.1 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-precompiled_qnn_onnx-w8a16-qualcomm_qcs9075.zip)
40
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x_elite.zip)
41
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8gen3.zip)
42
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8275_proxy.zip)
43
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs8550_proxy.zip)
44
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa8775p.zip)
45
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_for_galaxy.zip)
46
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_7gen4.zip)
47
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_8_elite_gen5.zip)
48
+ | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_snapdragon_x2_elite.zip)
49
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_sa7255p.zip)
50
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcm6690.zip)
51
+ | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | QAIRT 2.43 | [Download](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/models/controlnet_canny/releases/v0.47.0/controlnet_canny-qnn_context_binary-w8a16-qualcomm_qcs9075.zip)
52
 
53
  For more device-specific assets and performance metrics, visit **[ControlNet-Canny on Qualcomm® AI Hub](https://aihub.qualcomm.com/models/controlnet_canny)**.
54
 
 
80
  ## Performance Summary
81
  | Model | Runtime | Precision | Chipset | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit
82
  |---|---|---|---|---|---|---
83
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 75.89 ms | 351 - 351 MB | NPU
84
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 63.879 ms | 33 - 45 MB | NPU
85
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 83.046 ms | 26 - 28 MB | NPU
86
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 75.854 ms | 33 - 37 MB | NPU
87
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 1058.8 ms | 2 - 12 MB | NPU
88
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 47.344 ms | 32 - 43 MB | NPU
89
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 126.734 ms | 33 - 42 MB | NPU
90
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 29.12 ms | 32 - 42 MB | NPU
91
+ | controlnet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 28.607 ms | 351 - 351 MB | NPU
92
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 76.211 ms | 2 - 2 MB | NPU
93
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 60.5 ms | 2 - 10 MB | NPU
94
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 141.297 ms | 2 - 9 MB | NPU
95
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 82.712 ms | 2 - 4 MB | NPU
96
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 77.763 ms | 2 - 11 MB | NPU
97
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 76.694 ms | 2 - 18 MB | NPU
98
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 801.511 ms | 2 - 8 MB | NPU
99
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 141.297 ms | 2 - 9 MB | NPU
100
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 46.823 ms | 2 - 12 MB | NPU
101
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 121.325 ms | 2 - 8 MB | NPU
102
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 29.121 ms | 2 - 11 MB | NPU
103
+ | controlnet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 29.6 ms | 2 - 2 MB | NPU
104
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 3.608 ms | 156 - 156 MB | NPU
105
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.301 ms | 0 - 7 MB | NPU
106
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.255 ms | 0 - 2 MB | NPU
107
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 3.321 ms | 0 - 3 MB | NPU
108
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 22.081 ms | 0 - 10 MB | NPU
109
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.75 ms | 0 - 11 MB | NPU
110
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.631 ms | 0 - 6 MB | NPU
111
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.483 ms | 0 - 10 MB | NPU
112
+ | text_encoder | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 1.527 ms | 156 - 156 MB | NPU
113
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 3.62 ms | 0 - 0 MB | NPU
114
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 2.335 ms | 0 - 7 MB | NPU
115
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 7.569 ms | 0 - 8 MB | NPU
116
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 3.264 ms | 0 - 2 MB | NPU
117
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 3.523 ms | 0 - 9 MB | NPU
118
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 3.358 ms | 2 - 4 MB | NPU
119
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 21.925 ms | 0 - 6 MB | NPU
120
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 7.569 ms | 0 - 8 MB | NPU
121
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 1.744 ms | 0 - 10 MB | NPU
122
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 3.656 ms | 0 - 6 MB | NPU
123
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 1.496 ms | 0 - 9 MB | NPU
124
+ | text_encoder | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 1.797 ms | 0 - 0 MB | NPU
125
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 114.613 ms | 829 - 829 MB | NPU
126
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 81.027 ms | 13 - 26 MB | NPU
127
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 113.484 ms | 0 - 883 MB | NPU
128
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 106.122 ms | 12 - 28 MB | NPU
129
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 2265.474 ms | 13 - 24 MB | NPU
130
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 61.883 ms | 12 - 25 MB | NPU
131
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 180.416 ms | 9 - 16 MB | NPU
132
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 45.387 ms | 13 - 21 MB | NPU
133
+ | unet | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 48.32 ms | 831 - 831 MB | NPU
134
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 113.559 ms | 13 - 13 MB | NPU
135
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 80.57 ms | 13 - 20 MB | NPU
136
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 266.52 ms | 10 - 16 MB | NPU
137
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 112.01 ms | 13 - 15 MB | NPU
138
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 492.289 ms | 9 - 16 MB | NPU
139
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 107.167 ms | 11 - 25 MB | NPU
140
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 1986.979 ms | 13 - 24 MB | NPU
141
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 266.52 ms | 10 - 16 MB | NPU
142
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 62.97 ms | 6 - 19 MB | NPU
143
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 181.275 ms | 11 - 17 MB | NPU
144
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 44.605 ms | 13 - 22 MB | NPU
145
+ | unet | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 46.235 ms | 13 - 13 MB | NPU
146
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X Elite | 266.338 ms | 62 - 62 MB | NPU
147
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Gen 3 Mobile | 202.318 ms | 3 - 10 MB | NPU
148
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS8550 (Proxy) | 271.527 ms | 1 - 66 MB | NPU
149
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCS9075 | 250.0 ms | 3 - 6 MB | NPU
150
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Qualcomm® QCM6690 | 6156.1 ms | 0 - 6 MB | NPU
151
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 178.645 ms | 3 - 15 MB | NPU
152
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 7 Gen 4 Mobile | 513.39 ms | 2 - 8 MB | NPU
153
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 123.432 ms | 3 - 13 MB | NPU
154
+ | vae | PRECOMPILED_QNN_ONNX | w8a16 | Snapdragon® X2 Elite | 125.995 ms | 62 - 62 MB | NPU
155
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X Elite | 262.929 ms | 0 - 0 MB | NPU
156
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Gen 3 Mobile | 205.05 ms | 0 - 8 MB | NPU
157
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8275 (Proxy) | 718.604 ms | 0 - 8 MB | NPU
158
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS8550 (Proxy) | 265.338 ms | 0 - 2 MB | NPU
159
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA8775P | 250.543 ms | 0 - 9 MB | NPU
160
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCS9075 | 247.507 ms | 0 - 3 MB | NPU
161
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® QCM6690 | 6312.664 ms | 1 - 7 MB | NPU
162
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Qualcomm® SA7255P | 718.604 ms | 0 - 8 MB | NPU
163
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite For Galaxy Mobile | 176.4 ms | 0 - 9 MB | NPU
164
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 7 Gen 4 Mobile | 514.332 ms | 0 - 6 MB | NPU
165
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® 8 Elite Gen 5 Mobile | 127.522 ms | 0 - 10 MB | NPU
166
+ | vae | QNN_CONTEXT_BINARY | w8a16 | Snapdragon® X2 Elite | 133.648 ms | 0 - 0 MB | NPU
167
 
168
  ## License
169
  * The license for the original implementation of ControlNet-Canny can be found