alihan/text-generation-inference
1
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2023-08-23 10:47:54 +03:00
Code Issues Packages Projects Releases Wiki Activity
392 Commits 31 Branches 22 Tags
main
Commit Graph

4 Commits

Author SHA1 Message Date
OlivierDehaene
31e2253ae7 feat(server): use latest flash attention commit (#543) 
@njhill FYI
 2023-07-04 20:23:55 +02:00
OlivierDehaene
5ce89059f8 feat(server): pre-allocate past key values for flash causal LM (#412) 2023-06-12 18:30:29 +02:00
OlivierDehaene
53ee09c0b0 fea(dockerfile): better layer caching (#159) 2023-04-14 10:12:21 +02:00
OlivierDehaene
1883d8ecde feat(docker): improve flash_attention caching (#160) 2023-04-09 19:59:16 +02:00