alihan/llama-cpp-python
1
0
Fork 0
mirror of https://github.com/abetlen/llama-cpp-python.git synced 2023-09-07 17:34:22 +03:00
Code Issues Packages Projects Releases Wiki Activity

Set repeat_penalty to 0 by default

Browse Source
This commit is contained in:
Andrei Betlen
2023-05-08 01:50:43 -04:00
parent 65d9cc050c
commit 0d751a69a7
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llama_cpp/server/app.py
View File

@@ -146,7 +146,7 @@ top_k_field = Field(
) )
repeat_penalty_field = Field( repeat_penalty_field = Field(
default=1.0, default=0.0,
ge=0.0, ge=0.0,
description="A penalty applied to each token that is already generated. This helps prevent the model from repeating itself.\n\n" description="A penalty applied to each token that is already generated. This helps prevent the model from repeating itself.\n\n"
+ "Repeat penalty is a hyperparameter used to penalize the repetition of token sequences during text generation. It helps prevent the model from generating repetitive or monotonous text. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient.", + "Repeat penalty is a hyperparameter used to penalize the repetition of token sequences during text generation. It helps prevent the model from generating repetitive or monotonous text. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient.",