alihan/LLMLingua
1
0
Fork 0
mirror of https://github.com/microsoft/LLMLingua.git synced 2024-01-23 02:05:46 +03:00
Code Issues Packages Projects Releases Wiki Activity
3 Commits 3 Branches 4 Tags
3df35280a62b8b9683e22b8c88d01c99cdba32c3
Go to file
Clone
Open with VS Code Open with VSCodium Open with Intellij IDEA
Download ZIP Download TAR.GZ Download BUNDLE
Microsoft Open Source 3df35280a6 LICENSE committed
2023-07-06 23:26:06 -07:00
.gitignore
Initial commit
2023-07-07 06:26:00 +00:00
CODE_OF_CONDUCT.md
CODE_OF_CONDUCT.md committed
2023-07-06 23:26:06 -07:00
LICENSE
LICENSE committed
2023-07-06 23:26:06 -07:00
Description
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
MIT 3 MiB
Languages
Python 99.5%
Makefile 0.5%