mirror of
https://github.com/abetlen/llama-cpp-python.git
synced 2023-09-07 17:34:22 +03:00
Set repeat_penalty to 0 by default
This commit is contained in:
@@ -146,7 +146,7 @@ top_k_field = Field(
|
||||
)
|
||||
|
||||
repeat_penalty_field = Field(
|
||||
default=1.0,
|
||||
default=0.0,
|
||||
ge=0.0,
|
||||
description="A penalty applied to each token that is already generated. This helps prevent the model from repeating itself.\n\n"
|
||||
+ "Repeat penalty is a hyperparameter used to penalize the repetition of token sequences during text generation. It helps prevent the model from generating repetitive or monotonous text. A higher value (e.g., 1.5) will penalize repetitions more strongly, while a lower value (e.g., 0.9) will be more lenient.",
|
||||
|
||||
Reference in New Issue
Block a user