YOLOv9-Detection: Optimized for Qualcomm Devices

Ultralytics YOLOv9 is a machine learning model that predicts bounding boxes and classes of objects in an image.

This is based on the implementation of YOLOv9-Detection found here. This repository contains pre-exported model files optimized for Qualcomm® devices. You can use the Qualcomm® AI Hub Models library to export with custom configurations. More details on model performance across various devices, can be found here.

Qualcomm AI Hub Models uses Qualcomm AI Hub Workbench to compile, profile, and evaluate this model. Sign up to run these models on a hosted Qualcomm® device.

Getting Started

Due to licensing restrictions, we cannot distribute pre-exported model assets for this model. Use the Qualcomm® AI Hub Models Python library to compile and export the model with your own:

  • Custom weights (e.g., fine-tuned checkpoints)
  • Custom input shapes
  • Target device and runtime configurations

See our repository for YOLOv9-Detection on GitHub for usage instructions.

Model Details

Model Type: Model_use_case.object_detection

Model Stats:

  • Model checkpoint: YOLOv9-T
  • Input resolution: 640x640
  • Model size (float): 8.84 MB
  • Model size (w8a8): 3.23 MB
  • Model size (w8a8_mixed_int16): 3.74 MB
  • Model size (w8a16): 3.25 MB

Performance Summary

Model Runtime Precision Chipset Inference Time (ms) Peak Memory Range (MB) Primary Compute Unit
YOLOv9-Detection ONNX float Snapdragon® 8 Elite Gen 5 Mobile 3.231 ms 2 - 238 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X2 Elite 3.62 ms 3 - 3 MB NPU
YOLOv9-Detection ONNX float Snapdragon® X Elite 10.581 ms 5 - 5 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Gen 3 Mobile 7.511 ms 5 - 299 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS8550 (Proxy) 10.042 ms 3 - 139 MB NPU
YOLOv9-Detection ONNX float Qualcomm® QCS9075 10.331 ms 5 - 7 MB NPU
YOLOv9-Detection ONNX float Snapdragon® 8 Elite For Galaxy Mobile 4.217 ms 1 - 242 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite Gen 5 Mobile 101.049 ms 9 - 139 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X2 Elite 100.896 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® X Elite 308.612 ms 2 - 2 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Gen 3 Mobile 224.223 ms 3 - 166 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS6490 466.97 ms 81 - 87 MB CPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS8550 (Proxy) 294.787 ms 2 - 9 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCS9075 184.316 ms 2 - 5 MB NPU
YOLOv9-Detection ONNX w8a16 Qualcomm® QCM6690 217.243 ms 82 - 99 MB CPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 8 Elite For Galaxy Mobile 99.285 ms 0 - 118 MB NPU
YOLOv9-Detection ONNX w8a16 Snapdragon® 7 Gen 4 Mobile 198.818 ms 81 - 94 MB CPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.465 ms 1 - 97 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X2 Elite 110.813 ms 0 - 0 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® X Elite 187.332 ms 2 - 2 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Gen 3 Mobile 136.188 ms 1 - 120 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS6490 101.457 ms 22 - 35 MB CPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS8550 (Proxy) 179.559 ms 0 - 7 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCS9075 190.565 ms 1 - 4 MB NPU
YOLOv9-Detection ONNX w8a8 Qualcomm® QCM6690 61.922 ms 24 - 45 MB CPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 8 Elite For Galaxy Mobile 112.596 ms 2 - 89 MB NPU
YOLOv9-Detection ONNX w8a8 Snapdragon® 7 Gen 4 Mobile 57.178 ms 23 - 40 MB CPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite Gen 5 Mobile 2.765 ms 5 - 212 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X2 Elite 3.453 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® X Elite 8.689 ms 5 - 5 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Gen 3 Mobile 5.94 ms 0 - 235 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8275 (Proxy) 21.625 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8550 (Proxy) 8.122 ms 5 - 7 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8775P 10.437 ms 1 - 206 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS9075 8.92 ms 5 - 11 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® QCS8450 (Proxy) 13.866 ms 4 - 234 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA7255P 21.625 ms 1 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Qualcomm® SA8295P 13.405 ms 0 - 204 MB NPU
YOLOv9-Detection QNN_DLC float Snapdragon® 8 Elite For Galaxy Mobile 3.148 ms 0 - 208 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite Gen 5 Mobile 79.909 ms 2 - 101 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X2 Elite 80.348 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® X Elite 223.778 ms 2 - 2 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Gen 3 Mobile 165.631 ms 2 - 119 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS6490 404.825 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8275 (Proxy) 447.453 ms 0 - 91 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8550 (Proxy) 214.226 ms 2 - 13 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8775P 235.463 ms 1 - 94 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS9075 182.783 ms 1 - 5 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCM6690 561.678 ms 2 - 204 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® QCS8450 (Proxy) 357.824 ms 2 - 121 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA7255P 447.453 ms 0 - 91 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Qualcomm® SA8295P 301.692 ms 0 - 96 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 8 Elite For Galaxy Mobile 114.819 ms 2 - 99 MB NPU
YOLOv9-Detection QNN_DLC w8a16 Snapdragon® 7 Gen 4 Mobile 286.061 ms 29 - 242 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.626 ms 1 - 66 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X2 Elite 100.797 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® X Elite 175.433 ms 1 - 1 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Gen 3 Mobile 136.33 ms 1 - 84 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS6490 404.949 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8275 (Proxy) 347.836 ms 1 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8550 (Proxy) 167.216 ms 1 - 18 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8775P 170.837 ms 1 - 65 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS9075 189.485 ms 1 - 4 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCM6690 510.98 ms 1 - 187 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® QCS8450 (Proxy) 238.111 ms 1 - 82 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA7255P 347.836 ms 1 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Qualcomm® SA8295P 202.919 ms 1 - 62 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.236 ms 2 - 63 MB NPU
YOLOv9-Detection QNN_DLC w8a8 Snapdragon® 7 Gen 4 Mobile 176.206 ms 1 - 64 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite Gen 5 Mobile 2.278 ms 0 - 114 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Gen 3 Mobile 5.592 ms 0 - 126 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8275 (Proxy) 21.013 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8550 (Proxy) 7.7 ms 0 - 3 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8775P 10.192 ms 0 - 107 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS9075 8.523 ms 0 - 14 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® QCS8450 (Proxy) 11.968 ms 0 - 109 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA7255P 21.013 ms 0 - 95 MB NPU
YOLOv9-Detection TFLITE float Qualcomm® SA8295P 12.89 ms 0 - 76 MB NPU
YOLOv9-Detection TFLITE float Snapdragon® 8 Elite For Galaxy Mobile 2.96 ms 0 - 89 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite Gen 5 Mobile 110.534 ms 0 - 66 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Gen 3 Mobile 136.393 ms 0 - 83 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS6490 376.687 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8275 (Proxy) 347.675 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8550 (Proxy) 167.178 ms 0 - 94 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8775P 182.841 ms 0 - 62 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS9075 190.315 ms 0 - 7 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCM6690 500.151 ms 0 - 187 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® QCS8450 (Proxy) 238.089 ms 0 - 79 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA7255P 347.675 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Qualcomm® SA8295P 202.73 ms 0 - 58 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 8 Elite For Galaxy Mobile 133.132 ms 0 - 59 MB NPU
YOLOv9-Detection TFLITE w8a8 Snapdragon® 7 Gen 4 Mobile 179.094 ms 0 - 59 MB NPU

License

  • The license for the original implementation of YOLOv9-Detection can be found here.

References

Community

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support