Alex Cheema 6ee0547eff fix layer calculation for sharded llama

2024-07-13 15:39:31 -07:00

inference

fix layer calculation for sharded llama

2024-07-13 15:39:31 -07:00

networking

dynamically assign shards to nodes deterministically weighted by memory

2024-06-25 21:17:58 +01:00

orchestration

dynamically assign shards to nodes deterministically weighted by memory

2024-06-25 21:17:58 +01:00

topology

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

.gitignore

scaffolding for networking, inference and orchestration

2024-06-23 23:28:10 +01:00

example_user_2.py

dynamically assign shards to nodes deterministically weighted by memory

2024-06-25 21:17:58 +01:00

example_user.py

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

main_dynamic.py

dynamically assign shards to nodes deterministically weighted by memory

2024-06-25 21:17:58 +01:00

main.py

collect global topology with local peer visibility, ring memory weighted partitioning strategy

2024-06-25 12:32:16 +01:00

requirements.txt

add requirements.txt

2024-06-24 21:00:04 +01:00

Description

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

GPL-3.0 18 MiB

Languages

Python 87.8%

JavaScript 5.3%

HTML 3.6%

CSS 2.8%

Shell 0.5%