Okabintaro 10b0cb727b fix: Make LLamaState pickable for disk cache ...

I fixed the issue by making the saved state a bytes object instead of the ctypes one which can't be pickled.

2023-06-13 12:03:31 +02:00

..

server

Fix cache implementation breaking changes

2023-06-08 13:19:23 -04:00

__init__.py

Black formatting

2023-03-24 14:59:29 -04:00

llama_cpp.py

Update llama.cpp

2023-06-10 12:17:38 -04:00

llama_types.py

Allow first logprob token to be null to match openai api

2023-05-19 02:04:57 -04:00

llama.py

fix: Make LLamaState pickable for disk cache

2023-06-13 12:03:31 +02:00