13 Commits

Author SHA1 Message Date
Andres Marafioti
129cd11bf0 Fixes to bugs from original PR 2024-09-09 16:23:20 +02:00
Elli0t
29fedd0720 Update: Added multi-language support for macOS 2024-09-08 02:51:23 +08:00
Andres Marafioti
65f779de83 review from eustache 2024-09-04 13:39:58 +02:00
andimarafioti
77894a7a5b working 2024-09-04 13:24:38 +02:00
Andres Marafioti
dc024ab6b7 speed up warm up time for llm 2024-09-04 13:24:38 +02:00
Andres Marafioti
901d9a1402 handle language better 2024-09-04 13:24:38 +02:00
Andres Marafioti
2cb9464b8f try to pass the language_id in the queue 2024-09-04 13:24:38 +02:00
Andres Marafioti
bb10b87e98 improve logging 2024-08-27 15:21:31 +02:00
Andres Marafioti
b7c229fb7d add min new tokens 2024-08-26 16:00:36 +02:00
Andres Marafioti
d50687a0c3 refactor all the handlers - folder structure 2024-08-26 15:42:22 +02:00
Ronan McGovern
3d98e34b4c Allow LM selection and Gemma
Allow the language model to be selected via command line.
Remove the system message if using Gemma.
2024-08-23 11:57:59 +01:00
Andres Marafioti
696bf85628 refactor arguments folder + run ruff 2024-08-22 18:02:08 +02:00
Andres Marafioti
d31d665455 add mlx lm to make it go BRRRR 2024-08-21 18:10:52 +02:00