Alex Cheema ca6095c04d a generic test for every inference engine 1 год назад
..
models ca6095c04d a generic test for every inference engine 1 год назад
__init__.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 год назад
sharded_inference_engine.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 год назад
sharded_model.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 год назад
sharded_utils.py 563dcb56b0 mlx sharded implementation with example of distributed inference 1 год назад
test_sharded_llama.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 год назад
test_sharded_model.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 год назад