alihan/llm-text-generation-inference
1
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2023-08-15 01:09:35 +03:00
Code Issues Packages Projects Releases Wiki Activity
Files
v1.0.0
llm-text-generation-inference/server
History

README.md

Text Generation Inference Python gRPC Server

A Python gRPC server for Text Generation Inference

Install

make install

Run

make run-dev