alihan/llama-cpp-python
1
0
Fork 0
mirror of https://github.com/abetlen/llama-cpp-python.git synced 2023-09-07 17:34:22 +03:00
Code Issues Packages Projects Releases Wiki Activity
Files
df15caa8779ca6f5fbd8eddae48224073af11b76
llama-cpp-python/docs/index.md
Andrei Betlen df15caa877 Add mkdocs
2023-03-24 18:57:59 -04:00

535 B
Raw Blame History

🦙 Python Bindings for llama.cpp

Simple Python bindings for @ggerganov's llama.cpp library. This package provides:

  • Low-level access to C API via ctypes interface.
  • High-level Python API for text completion
    • OpenAI-like API
    • LangChain compatibility

API Reference

::: llama_cpp.Llama options: members: - init - call show_root_heading: true

::: llama_cpp.llama_cpp options: show_if_no_docstring: true