 Alex Cheema
|
706488732f
disable prefix matching on prompts. causes subsequent requests to fail with cannot be broadcast. hotfix for #130
|
1 jaar geleden |
|
Alex Cheema
|
35b7042e70
upgrade mlx to 0.16.1
|
1 jaar geleden |
|
Alex Cheema
|
b181f8aa82
handle writing responses errors
|
1 jaar geleden |
|
Alex Cheema
|
7ec660bba6
fix shard download
|
1 jaar geleden |
|
Alex Cheema
|
29f154597c
init active_downloadsa
|
1 jaar geleden |
|
Alex Cheema
|
6bddb2a9dc
download edge cases
|
1 jaar geleden |
|
Alex Cheema
|
f29963f41e
preemptively start downloads when any node starts processing a prompt. this fixes #104
|
1 jaar geleden |
|
Alex Cheema
|
7a65a96e52
download progress styling
|
1 jaar geleden |
|
Alex Cheema
|
c59ceab821
viz spacing
|
1 jaar geleden |
|
Alex Cheema
|
0a588d0443
viz styles
|
1 jaar geleden |
|
Alex Cheema
|
d9f232b313
cleaner download progress ui
|
1 jaar geleden |
|
Alex Cheema
|
476a714bbb
make a separate ShardDownloader abstract class w HFShardDownloader. this opens up plugging in different methods of downloading model shards e.g. #79 / #16
|
1 jaar geleden |
|
Alex Cheema
|
d22ed12e7b
bring tinygrad to parity with mlx on llama models, show progress of each download file
|
1 jaar geleden |
|
Alex Cheema
|
45142dab26
tests
|
1 jaar geleden |
|
Alex Cheema
|
545a486ed3
separate hf_helpers, make extra dir with download_hf script, unify downloading so tinygrad uses the same method as mlx and interoperable model formats
|
1 jaar geleden |
|
Alex Cheema
|
9014efae86
minimal script to download from hf async with progress
|
1 jaar geleden |
 Alex Cheema
|
4b4dfb7fd0
Merge pull request #117 from inksong/main
|
1 jaar geleden |
|
Alex Cheema
|
55bcad98e3
standardise tinygrad models/tokenizers so it can handle mlx hf
|
1 jaar geleden |
 jinke
|
6b1960baec
fix nvidia capabilities
|
1 jaar geleden |
|
Alex Cheema
|
4a5c6cc580
t
|
1 jaar geleden |
|
Alex Cheema
|
f93ae2b545
disable tinygrad test for now. need a larger runner or smalelr model
|
1 jaar geleden |
|
Alex Cheema
|
201996af8a
macos
|
1 jaar geleden |
|
Alex Cheema
|
0eb5c0c624
mac runners
|
1 jaar geleden |
|
Alex Cheema
|
e10aa581ac
cuda test
|
1 jaar geleden |
|
Alex Cheema
|
23d2432cb9
test cuda
|
1 jaar geleden |
|
Alex Cheema
|
fcdf57b873
t
|
1 jaar geleden |
|
Alex Cheema
|
f9c427467e
t
|
1 jaar geleden |
|
Alex Cheema
|
cf32ec9ab1
t
|
1 jaar geleden |
|
Alex Cheema
|
c5646ae00f
t
|
1 jaar geleden |
|
Alex Cheema
|
6b300112c8
t
|
1 jaar geleden |
