llama-cpp-python/server at 76a82babef9703b814ae4cea28cc63c2340ed743 - llama-cpp-python - gitea-ailhan-registry

alihan/llama-cpp-python

mirror of https://github.com/abetlen/llama-cpp-python.git synced 2023-09-07 17:34:22 +03:00

Files

History

MillionthOdin16 76a82babef Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

2023-04-05 17:44:53 -04:00

..

__main__.py

Set n_batch to the default value of 8. I think this is leftover from when n_ctx was missing and n_batch was 2048.

2023-04-05 17:44:53 -04:00