Nicolas Patry e943a294bc fix(server): harden the weights choice to save on disk. (#561) ...

- Look at `transformers` base class to check for
  `_key_to_ignore_on_load_missing` or `_tied_weights` which are the
  standard attributes to select the keys to NOT save on disk (since they
  are ignored)

- Modified safetensors code (to be reflected in safetensors even if it's
  an internal function).
  
- Will not work for trust_remote_code=True repos (like santacoder).

Should help with :
https://github.com/huggingface/text-generation-inference/issues/555
and : https://github.com/huggingface/text-generation-inference/pull/501
and https://github.com/huggingface/text-generation-inference/issues/556
and
https://github.com/huggingface/text-generation-inference/issues/482#issuecomment-1623713593

2023-07-07 14:50:12 +02:00

..

models

feat(server): Rework model loading (#344)

2023-06-08 14:51:52 +02:00

utils

fix(server): harden the weights choice to save on disk. (#561)

2023-07-07 14:50:12 +02:00

conftest.py

feat: support typical sampling (#114)

2023-03-09 11:33:57 +01:00