Alex Cheema
|
2c0d17c336
|
beautiful download
|
2025-02-01 17:29:19 +00:00 |
|
Alex Cheema
|
7034ee0fcb
|
resumable downloads with integrity checks
|
2025-02-01 13:22:51 +00:00 |
|
Alex Cheema
|
0bebf8dfde
|
fix indent
|
2025-01-30 20:21:28 +00:00 |
|
Alex Cheema
|
55c4385db5
|
cleanup tmp files on failed download
|
2025-01-30 20:11:06 +00:00 |
|
Alex Cheema
|
788c49784c
|
retry fetch_file_list also
|
2025-01-30 19:45:12 +00:00 |
|
Alex Cheema
|
6b1c8635fc
|
ensure exo dir on start, retry with exp backoff on file downloads
|
2025-01-30 19:40:35 +00:00 |
|
Alex Cheema
|
e6b4f2993c
|
fix prompt output spacing in tui
|
2025-01-29 19:01:30 +00:00 |
|
Alex Cheema
|
3675804f4d
|
throttle repo progress events and only send them out if something changed
|
2025-01-29 18:55:54 +00:00 |
|
Alex Cheema
|
96f1aecb05
|
only in_progress if any given file is in_progress
|
2025-01-29 18:43:43 +00:00 |
|
Alex Cheema
|
23a5030604
|
even if part of a file is downloaded it may not be in_progress
|
2025-01-29 18:39:23 +00:00 |
|
Alex Cheema
|
31b56e862f
|
make a singleton thread pool executor for tinygrad since we always want it to run on the same thread
|
2025-01-29 18:37:09 +00:00 |
|
Alex Cheema
|
9f6c688d62
|
update tinygrad
|
2025-01-29 18:06:38 +00:00 |
|
Alex Cheema
|
4887be5103
|
parallelise model loading
|
2025-01-29 02:32:59 +00:00 |
|
Alex Cheema
|
141de0d011
|
increase chatgpt api response timeout to 900 seconds
|
2025-01-29 02:03:00 +00:00 |
|
Alex Cheema
|
837ed5d980
|
Merge pull request #648 from exo-explore/modelasyncload
Fixes
|
2025-01-28 23:39:11 +00:00 |
|
Alex Cheema
|
9c1bea97e8
|
fix embed_tokens for last layer in qwen models
|
2025-01-28 23:09:45 +00:00 |
|
Alex Cheema
|
af171f06fa
|
propagate prompts to other nodes so they can display them, cleaner prompt/output output
|
2025-01-28 21:50:49 +00:00 |
|
Alex Cheema
|
edfa53a4c2
|
Merge pull request #646 from exo-explore/modelasyncload
make sure mlx stuff is on separate thread non blocking
|
2025-01-28 18:56:19 +00:00 |
|
Alex Cheema
|
4a5b80a958
|
make sure mlx stuff is on separate thread non blocking
|
2025-01-28 18:56:00 +00:00 |
|
Alex Cheema
|
92d1bc01de
|
Merge pull request #645 from exo-explore/modelasyncload
load mlx model shard on mlx thread so it doesnt block
|
2025-01-28 18:49:47 +00:00 |
|
Alex Cheema
|
6662d5668c
|
load mlx model shard on mlx thread so it doesnt block
|
2025-01-28 18:49:19 +00:00 |
|
Alex Cheema
|
a0d673fa3a
|
Merge pull request #640 from exo-explore/simpledownload
Simple download
|
2025-01-27 19:38:11 +00:00 |
|
Alex Cheema
|
7c649085a1
|
fix eta/speed for resuming an existing download, using the session downloaded bytes
|
2025-01-27 19:23:18 +00:00 |
|
Alex Cheema
|
90e0e2761f
|
ignore not_started progress updates
|
2025-01-27 06:05:59 +00:00 |
|
Alex Cheema
|
265586f7b4
|
set timeout on get too
|
2025-01-27 06:05:40 +00:00 |
|
Alex Cheema
|
4748bb7dc7
|
increase file download timeout to 30min
|
2025-01-27 05:49:17 +00:00 |
|
Alex Cheema
|
ae770db4f3
|
increase download chunks to 1MB
|
2025-01-27 05:37:50 +00:00 |
|
Alex Cheema
|
82f75d0ccf
|
increase hf download http timeout 15 mins for large downloads
|
2025-01-27 05:20:30 +00:00 |
|
Alex Cheema
|
295f41c5cc
|
increase bench job timeout to give enough time to download
|
2025-01-27 05:03:35 +00:00 |
|
Alex Cheema
|
19a27c5bfd
|
HF_HOME -> EXO_HOME
|
2025-01-27 02:59:23 +00:00 |
|
Alex Cheema
|
d7ca9b7732
|
show each node id in the tinychat topology viz
|
2025-01-27 02:20:22 +00:00 |
|
Alex Cheema
|
b349e48b0d
|
fix visual bug where frontend would show the full hf repo size, but in some cases that includes redundant files so we should use the model index in those cases too
|
2025-01-27 02:13:05 +00:00 |
|
Alex Cheema
|
21586063f6
|
use llama-3.2-1b in tinygrad test
|
2025-01-27 01:35:33 +00:00 |
|
Alex Cheema
|
277d63d860
|
special case when a model doesnt have a model index file, then use wildcard for allow_patterns
|
2025-01-27 01:26:15 +00:00 |
|
Alex Cheema
|
74379ef671
|
log download logs with DEBUG>=6 very verbose
|
2025-01-27 01:11:54 +00:00 |
|
Alex Cheema
|
3c7bd48aa3
|
get rid of some more hf bloat
|
2025-01-27 01:08:46 +00:00 |
|
Alex Cheema
|
1df023023e
|
remove a lot of hf bloat
|
2025-01-27 01:06:47 +00:00 |
|
Alex Cheema
|
b89495f444
|
rewrite ShardDownloader, simplify significantly
|
2025-01-27 00:37:57 +00:00 |
|
Alex Cheema
|
903950f64e
|
Merge pull request #638 from exo-explore/deepseekv3fix
add exception for mlx-community/DeepSeek-R1-3bit and mlx-community/DeepSeek-V3-3bit in tokenizers test
|
2025-01-26 20:33:22 +00:00 |
|
Alex Cheema
|
a3766f538a
|
add exception for mlx-community/DeepSeek-R1-3bit and mlx-community/DeepSeek-V3-3bit in tokenizers test
|
2025-01-26 20:32:48 +00:00 |
|
Alex Cheema
|
9711d632e0
|
Merge pull request #637 from exo-explore/deepseekv3fix
fix post_init deepseek v3
|
2025-01-26 20:31:53 +00:00 |
|
Alex Cheema
|
82ef086010
|
add deepseek-v3-3bit and deepseek-r1-3bit
|
2025-01-26 20:31:28 +00:00 |
|
Alex Cheema
|
55ea366932
|
fix post_init deepseek v3
|
2025-01-26 20:27:31 +00:00 |
|
Alex Cheema
|
63318983de
|
Merge pull request #631 from sigseg5/main
Some adaptivity fixes in tinychat
|
2025-01-26 19:20:58 +00:00 |
|
sigseg5
|
fb841a1f50
|
Adjust truncate size in history list for text without any spaces
|
2025-01-26 00:38:58 +03:00 |
|
sigseg5
|
4512366580
|
Fix bubble behavior when user passes long text without any spaces
|
2025-01-26 00:02:17 +03:00 |
|
sigseg5
|
9525c0e7a7
|
Add adaptive padding for user and assistant messages on width <= 1480px
|
2025-01-26 00:01:54 +03:00 |
|
Alex Cheema
|
66f73768cc
|
Merge pull request #627 from exo-explore/deepseek
Deepseek, tinychat group models, latex formatting, thinking boxes
|
2025-01-24 18:14:57 +00:00 |
|
Alex Cheema
|
fdd05baddb
|
fix tokenizer tests
|
2025-01-24 18:13:36 +00:00 |
|
Alex Cheema
|
59174bdc62
|
we have a lot of models so group them nicely
|
2025-01-24 18:02:00 +00:00 |
|