Carsen Klock
627bfcae7c
Fix the /v1/models API to output proper OpenAI compatible endpoint
...
Modify the `/v1/models` API to output a proper OpenAI compatible endpoint with an object and a `data` object containing the models list.
* Change the `handle_get_models` method in `exo/api/chatgpt_api.py` to wrap the models list in an object with a `data` field.
* Add an `object` field with the value "list" to the response format.
---
For more details, open the [Copilot Workspace session](https://copilot-workspace.githubnext.com/metaspartan/exo?shareId=XXXX-XXXX-XXXX-XXXX ).
2025-01-06 01:20:30 -07:00
Alex Cheema
d9a836f152
Merge pull request #588 from exo-explore/betterdl
...
better download
2025-01-05 02:35:04 +00:00
Alex Cheema
29244c6369
fix args for ensure_shard
2025-01-05 02:33:25 +00:00
Alex Cheema
8c191050a2
download status in parallel, support async ensure shard with using shard_downloader instead
2025-01-05 02:31:59 +00:00
Alex Cheema
7b1656140e
Merge pull request #585 from pepebruari/main
...
Add --system-prompt to exo cli
2025-01-03 23:49:50 +00:00
pepebruari
fe50d4d34d
Add --system-prompt to exo cli
2025-01-03 16:16:22 -05:00
Alex Cheema
03aa6cecf1
Merge pull request #584 from exo-explore/AlexCheema-patch-1
...
add trending badge to README.md
2024-12-31 17:51:10 +00:00
Alex Cheema
178cc4d961
add trending badge to README.md
2024-12-31 17:50:29 +00:00
Pranav Veldurthi
b13e368368
fix inference engine
2024-12-30 19:41:19 -05:00
Pranav Veldurthi
9986fb86d4
remove prints and fix download progress for SD
2024-12-30 19:07:37 -05:00
Pranav Veldurthi
3475be9e9e
Remove build
2024-12-30 18:39:17 -05:00
Pranav Veldurthi
fff8a1a690
fix inference engine for inference state
2024-12-30 18:36:53 -05:00
Pranav Veldurthi
54605299b8
Merge Latest
2024-12-30 18:36:23 -05:00
Alex Cheema
a174c78004
Merge pull request #383 from ianpaul10/feat/manual-disc-follow-up
...
Support changing manual configuration while running
2024-12-28 11:57:25 +00:00
Ian Paul
b003292b89
formatting and fixing tests after rebasing
2024-12-28 12:31:15 +07:00
Ian Paul
1dfd058c23
rm unecessary lock
2024-12-28 12:13:34 +07:00
Ian Paul
2eadaa2c0d
rm redundant cleanup task
2024-12-28 12:13:34 +07:00
Ian Paul
637446ffa9
rm redundant typing
2024-12-28 12:13:34 +07:00
Ian Paul
a31f9e6c20
fix test warnings
2024-12-28 12:13:34 +07:00
Ian Paul
18acb97b42
make popping from dict threadsafe
2024-12-28 12:11:51 +07:00
Ian Paul
b066c944f3
make all I/O ops in manual_discovery.py run inside a ThreadPoolExecutor
2024-12-28 12:11:51 +07:00
Ian Paul
0e34ce2169
patch after rebasing to main
2024-12-28 12:11:51 +07:00
Ian Paul
90de7eada9
changes after rebase
2024-12-28 12:11:51 +07:00
Ian Paul
8d24df2b4b
fix test runtime warning
2024-12-28 12:11:50 +07:00
Ian Paul
e5eb3259a5
handle when a peer is removed from config, so the known_peers dict gets updated accordingly
2024-12-28 12:11:21 +07:00
Ian Paul
2e8227fccb
handle intermediate state for when config is being updated
2024-12-28 12:11:21 +07:00
Ian Paul
98118babae
allow update to manual discovery file
...
re-load manual discovery file for each runthrough of the peer network, allowing incremental updates to the peer file even when exo is running
2024-12-28 12:11:21 +07:00
Alex Cheema
496a3b49f5
Merge pull request #561 from VerisimilitudeX/patch-1
...
Improved clarity, fixed typos, added macOS/Linux examples, and enhanc…
2024-12-27 17:06:00 +00:00
Alex Cheema
aba1bed5ed
Merge pull request #575 from exo-explore/fixtok
...
Revert "Merge pull request #573 from damho1104/feature/add-exaone-3.5…
2024-12-27 16:36:34 +00:00
Alex Cheema
e08522ee97
Revert "Merge pull request #573 from damho1104/feature/add-exaone-3.5-model"
...
This reverts commit 4eb6a6a74afdc3b5ac02
2024-12-27 16:35:54 +00:00
Alex Cheema
4eb6a6a74a
Merge pull request #573 from damho1104/feature/add-exaone-3.5-model
...
Add exaone-3.5-2.4b, exaone-3.5-7.8b
2024-12-27 12:36:09 +00:00
damho.lee
94a5e908b0
add exaone-3.5 LLM Model
2024-12-24 20:57:11 +09:00
Alex Cheema
fdc3b5ac02
Merge pull request #571 from exo-explore/function_calling
...
add chatgpt-api-compatible tools for function calling
2024-12-24 02:08:48 +00:00
Alex Cheema
185b1e375c
fix names in dummy tokenizer
2024-12-24 02:08:20 +00:00
Alex Cheema
078b807654
fix names of qwen models
2024-12-24 02:06:13 +00:00
Alex Cheema
188ac445c9
function calling example with weather tool
2024-12-24 01:57:17 +00:00
Alex Cheema
456fbdd2b0
add chatgpt-api-compatible tools for function calling
2024-12-24 01:51:55 +00:00
Alex Cheema
41df9ce1d7
Merge pull request #570 from exo-explore/moreqwen
...
add qwen-2.5-1.5b, qwen-2.5-3b, qwen-2.5-32b
2024-12-24 01:51:26 +00:00
Alex Cheema
c609c05e40
add qwen-2.5-1.5b, qwen-2.5-3b, qwen-2.5-32b
2024-12-24 01:50:12 +00:00
Alex Cheema
ba8c514974
Merge pull request #569 from deftdawg/env_bash
...
Use `#!/usr/bin/env bash` for better portability
2024-12-22 23:25:38 +00:00
DeftDawg
cde912deef
- Use #!/usr/bin/env bash instead of #!/bin/bash for better portability
2024-12-22 01:14:54 -05:00
Piyush Acharya
154e0f58e4
Implement suggestiond
2024-12-21 19:40:53 -08:00
Piyush Acharya
6c82365ee2
Improved clarity, fixed typos, added macOS/Linux examples, and enhanced installation/debugging instructions
2024-12-17 18:02:34 -08:00
Alex Cheema
023ddc207e
support different network interface tests
2024-12-17 21:03:00 +00:00
Alex Cheema
2f0b543a1e
add peer connection info to tinychat
2024-12-17 17:37:40 +00:00
Alex Cheema
7ac4004392
change it back to collecting topology periodically even if peers dont change
2024-12-17 17:32:18 +00:00
Alex Cheema
198308b1eb
more robust udp broadcast
2024-12-17 17:28:55 +00:00
Alex Cheema
1f108a06ff
remove test sleep
2024-12-17 16:47:05 +00:00
Alex Cheema
3a58576f8c
make sure this is actually doing something
2024-12-17 16:22:22 +00:00
Alex Cheema
0a07223074
switch to uvloop (faster asyncio event loop) and optimise grpc settings
2024-12-17 16:10:56 +00:00
