Update README.md

This commit is contained in:
Boyu Zhang
2023-11-06 17:17:05 +10:30
committed by GitHub
parent 54807d8b19
commit c5081df22f

View File

@@ -45,9 +45,9 @@ python3 main.py \
## Testing
Use the following command to implement inference.
```
python ./inference/batchbot_torch.py --path checkpoints/actor-models/sent-llama-7b --max_new_tokens 16
python ./inference/batchbot.py --path checkpoints/actor-models/sent-llama-7b --max_new_tokens 16 --local_rank 0
```
## Acknowledgement
This code is developed based on [DeepSpeed-Chat](https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-chat).
This code is developed based on [DeepSpeed-Chat](https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-chat).