Alex Cheema ca6095c04d a generic test for every inference engine 1 jaar geleden
..
models ca6095c04d a generic test for every inference engine 1 jaar geleden
__init__.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 jaar geleden
sharded_inference_engine.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 jaar geleden
sharded_model.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 jaar geleden
sharded_utils.py 563dcb56b0 mlx sharded implementation with example of distributed inference 1 jaar geleden
test_sharded_llama.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 jaar geleden
test_sharded_model.py 850b72d3ea make StatefulShardedModel callable, add some tests for mlx sharded inference 1 jaar geleden