alihan/serge-chatgptui
1
0
Fork 0
mirror of https://github.com/serge-chat/serge.git synced 2024-01-15 09:32:12 +03:00
Code Issues Packages Projects Releases Wiki Activity

Add Mixtral 2.7, MedicineLLM, MistralLite, and Notux (#1026)

Browse Source 
* Update models.json

Update from Mixtral 8x7b-Dolphin 2.5 to Mixtral 8x7b - Dolphin 2.7

* Update README.md

Add Medicine-LLM13B

* Update models.json

Add Medicine LLM 13B

* Update models.json

Add MistralLite-7B

* Update README.md

Add support for MistralLite-7B
Add support for Notux 8x7B

* Update models.json

Add support for MistralLite-7b
Add support for Notux 8x7B v1

---------

Co-authored-by: Juan Calderon-Perez <835733+gaby@users.noreply.github.com>
This commit is contained in:
Olivier DEBAUCHE
2024-01-03 04:21:05 +01:00
committed by GitHub
parent 0686c36103
commit d50c93cbfc
2 changed files with 65 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
README.md
View File

@@ -64,11 +64,14 @@ Instructions for setting up Serge on Kubernetes can be found in the [wiki](https
| **LLaMA 2** | 7B, 7B-Chat, 7B-Coder, 13B, 13B-Chat, 70B, 70B-Chat, 70B-OASST |
| **Med42** | 70B |
| **Medalpaca** | 13B |
| **Medicine-LLM** | 13B |
| **Meditron** | 7B, 7B-Chat, 70B |
| **Mistral** | 7B-V0.1, 7B-Instruct-v0.2, 7B-OpenOrca |
| **Mixtral** | 8x7B-v0.1, 8x7B-Dophin-2.5, 8x7B-Instruct-v0.1 |
| **MistralLite** | 7B |
| **Mixtral** | 8x7B-v0.1, 8x7B-Dophin-2.7, 8x7B-Instruct-v0.1 |
| **Neural-Chat** | 7B-v3.3 |
| **Notus** | 7B-v1 |
| **Notux** | 8x7b-v1 |
| **OpenChat** | 7B-v3.5-1012 |
| **OpenLLaMA** | 3B-v2, 7B-v2, 13B-v2 |
| **Orca 2** | 7B, 13B |

74
api/src/serge/data/models.json
View File

@@ -319,6 +319,22 @@
]
}
]
},
{
"name": "medicine-LLM",
"models": [
{
"name": "Medicine LLM 13B",
"repo": "TheBloke/medicine-LLM-13B-GGUF",
"files": [
{
"name": "q4_K_M",
"filename": "medicine-llm-13b.Q4_K_M.gguf",
"disk_space": 7865963456.0
}
]
}
]
},
{
"name": "Meditron",
@@ -371,18 +387,7 @@
"disk_space": 4368438912.0
}
]
},
{
"name": "Mixtral-8X7B-Dolphin-2_5",
"repo": "TheBloke/dolphin-2.5-mixtral-8x7b-GGUF",
"files": [
{
"name": "q4_K_M",
"filename": "dolphin-2.5-mixtral-8x7b.Q4_K_M.gguf",
"disk_space": 26441544544.0
}
]
},
},
{
"name": "Mistral-7B-Instruct-v0_2",
"repo": "TheBloke/Mistral-7B-Instruct-v0.2-GGUF",
@@ -407,6 +412,22 @@
}
]
},
{
"name": "MistralLite",
"models": [
{
"name": "MistralLite-7B",
"repo": "TheBloke/MistralLite-7B-GGUF",
"files": [
{
"name": "q4_K_M",
"filename": "mistrallite.Q4_K_M.gguf",
"disk_space": 4368456032.0
}
]
}
]
},
{
"name": "Mixtral",
"models": [
@@ -421,6 +442,17 @@
}
]
},
{
"name": "Mixtral-8X7B-Dolphin-2_7",
"repo": "TheBloke/dolphin-2.7-mixtral-8x7b-GGUF",
"files": [
{
"name": "q4_K_M",
"filename": "dolphin-2.7-mixtral-8x7b.Q4_K_M.gguf",
"disk_space": 26441544512.0
}
]
},
{
"name": "Mixtral-8X7B-Instruct-v0_1",
"repo": "TheBloke/Mixtral-8x7B-Instruct-v0.1-GGUF",
@@ -465,7 +497,23 @@
]
}
]
},
},
{
"name": "Notux-8X7B",
"models": [
{
"name": "Notux-8X7B-v1",
"repo": "TheBloke/notux-8x7b-v1-GGUF",
"files": [
{
"name": "q4_K_M",
"filename": "notux-8x7b-v1.Q4_K_S.gguf",
"disk_space": 26442469696.0
}
]
}
]
},
{
"name": "OpenChat",
"models": [