在家中使用日常设备运行自己的 AI 集群。由 exo labs 维护。

Alex Cheema ca6095c04d a generic test for every inference engine 1 年之前
inference ca6095c04d a generic test for every inference engine 1 年之前
networking 445eda156c dynamically assign shards to nodes deterministically weighted by memory 1 年之前
orchestration 445eda156c dynamically assign shards to nodes deterministically weighted by memory 1 年之前
topology 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy 1 年之前
.gitignore 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 年之前
example_user.py 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy 1 年之前
example_user_2.py 445eda156c dynamically assign shards to nodes deterministically weighted by memory 1 年之前
main.py 36b8456798 collect global topology with local peer visibility, ring memory weighted partitioning strategy 1 年之前
main_dynamic.py 445eda156c dynamically assign shards to nodes deterministically weighted by memory 1 年之前
requirements.txt 3a66a0a4a8 add requirements.txt 1 年之前