inference
|
ca6095c04d
a generic test for every inference engine
|
1 tahun lalu |
networking
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 tahun lalu |
orchestration
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 tahun lalu |
topology
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 tahun lalu |
.gitignore
|
850b72d3ea
make StatefulShardedModel callable, add some tests for mlx sharded inference
|
1 tahun lalu |
example_user.py
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 tahun lalu |
example_user_2.py
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 tahun lalu |
main.py
|
36b8456798
collect global topology with local peer visibility, ring memory weighted partitioning strategy
|
1 tahun lalu |
main_dynamic.py
|
445eda156c
dynamically assign shards to nodes deterministically weighted by memory
|
1 tahun lalu |
requirements.txt
|
3a66a0a4a8
add requirements.txt
|
1 tahun lalu |