Add instruction to download metal weights

Add instruction to download metal weights
This commit is contained in:
Zhuohan Li
2025-08-05 10:22:26 -07:00
committed by GitHub

View File

@@ -216,6 +216,12 @@ To perform inference you'll need to first convert the SafeTensor weights from Hu
python gpt_oss/metal/scripts/create-local-model.py -s <model_dir> -d <output_file>
```
Or downloaded the pre-converted weight:
```shell
huggingface-cli download openai/gpt-oss-120b --include "metal/*" --local-dir gpt-oss-120b/metal/
huggingface-cli download openai/gpt-oss-20b --include "metal/*" --local-dir gpt-oss-20b/metal/
```
To test it you can run:
```shell