alihan/llama-cpp-python
1
0
Fork 0
mirror of https://github.com/abetlen/llama-cpp-python.git synced 2023-09-07 17:34:22 +03:00
Code Issues Packages Projects Releases Wiki Activity

Allow model to tokenize strings longer than context length and set add_bos. Closes #92

Browse Source
This commit is contained in:
Andrei Betlen
2023-05-12 14:28:22 -04:00
parent 8740ddc58e
commit 7a536e86c2
2 changed files with 18 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llama_cpp/llama_cpp.py
View File

@@ -350,7 +350,7 @@ def llama_tokenize(
tokens, # type: Array[llama_token]
n_max_tokens: c_int,
add_bos: c_bool,
) -> c_int:
) -> int:
return _lib.llama_tokenize(ctx, text, tokens, n_max_tokens, add_bos)