alihan/exo
1
0
Fork 0
mirror of https://github.com/exo-explore/exo.git synced 2025-10-23 02:57:14 +03:00
Code Issues Packages Projects Releases Wiki Activity

clearer example docs and add 405b example

Browse Source
This commit is contained in:
Alex Cheema
2024-10-01 01:37:06 +04:00
parent abca3bfa37
commit 67f789b6ac
1 changed files with 17 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

18
README.md
View File

@@ -120,7 +120,9 @@ That's it! No configuration required - exo will automatically discover the other
exo starts a ChatGPT-like WebUI (powered by [tinygrad tinychat](https://github.com/tinygrad/tinygrad/tree/master/examples/tinychat)) on http://localhost:8000
For developers, exo also starts a ChatGPT-compatible API endpoint on http://localhost:8000/v1/chat/completions. Example with curls:
For developers, exo also starts a ChatGPT-compatible API endpoint on http://localhost:8000/v1/chat/completions. Examples with curl:
#### Llama 3.1 8B:
```sh
curl http://localhost:8000/v1/chat/completions \
@@ -132,6 +134,20 @@ curl http://localhost:8000/v1/chat/completions \
}'
```
#### Llama 3.1 405B:
```sh
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "llama-3.1-405b",
"messages": [{"role": "user", "content": "What is the meaning of exo?"}],
"temperature": 0.7
}'
```
#### Llava 1.5 7B (Vision Language Model):
```sh
curl http://localhost:8000/v1/chat/completions \
-H "Content-Type: application/json" \