Update README.md
Browse files
README.md
CHANGED
|
@@ -554,8 +554,7 @@ All evaluations were done using [NeMo-Skills](https://github.com/NVIDIA/NeMo-Ski
|
|
| 554 |
|
| 555 |
## Inference
|
| 556 |
|
| 557 |
-
- Engines: HF, vLLM, llama-cpp
|
| 558 |
-
|
| 559 |
- Test Hardware: NVIDIA GeForce RTX, H100 80GB, DGX Spark, Jetson Thor/Orin Nano
|
| 560 |
|
| 561 |
## Ethical Considerations
|
|
|
|
| 554 |
|
| 555 |
## Inference
|
| 556 |
|
| 557 |
+
- Engines: HF, vLLM, llama-cpp, TRT-LLM, SGLang
|
|
|
|
| 558 |
- Test Hardware: NVIDIA GeForce RTX, H100 80GB, DGX Spark, Jetson Thor/Orin Nano
|
| 559 |
|
| 560 |
## Ethical Considerations
|