|
inference
|
6ee0547eff
fix layer calculation for sharded llama
|
1 year ago |
|
networking
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 year ago |
|
orchestration
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 year ago |
|
topology
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 year ago |
|
.gitignore
|
a21f59ff45
scaffolding for networking, inference and orchestration
|
1 year ago |
|
example_user.py
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 year ago |
|
example_user_2.py
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 year ago |
|
main.py
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 year ago |
|
main_dynamic.py
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 year ago |
|
requirements.txt
|
3a66a0a4a8
add requirements.txt
|
1 year ago |
Alex Cheema
6ee0547eff
fix layer calculation for sharded llama