在家中使用日常设备运行自己的 AI 集群。由 exo labs 维护。

Alex Cheema ca6095c04d a generic test for every inference engine пре 1 година
inference ca6095c04d a generic test for every inference engine пре 1 година
networking 445eda156c dynamically assign shards to nodes deterministically weighted by memory пре 1 година
orchestration 445eda156c dynamically assign shards to nodes deterministically weighted by memory пре 1 година
topology 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy пре 1 година
.gitignore 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference пре 1 година
example_user.py 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy пре 1 година
example_user_2.py 445eda156c dynamically assign shards to nodes deterministically weighted by memory пре 1 година
main.py 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy пре 1 година
main_dynamic.py 445eda156c dynamically assign shards to nodes deterministically weighted by memory пре 1 година
requirements.txt 3a66a0a4a8 add requirements.txt пре 1 година