 Alex Cheema
|
aaf78f16cb
optimised bluetooth bench
|
hai 11 meses |
|
Alex Cheema
|
0ffb1827b8
bluetooth bench use uuids
|
hai 11 meses |
|
Alex Cheema
|
c931a0dfee
bluetooth bench
|
hai 11 meses |
|
Alex Cheema
|
57215041a0
todo for speculative model
|
hai 11 meses |
|
Alex Cheema
|
dc3b2bde39
use NousResearch/Meta-Llama-3.1-70B-Instruct as tinygrad llama-3.1-70b model, previously using non-instruct model
|
hai 11 meses |
|
Alex Cheema
|
5a9f4ba5c1
update examples: remove old llama3_distributed, add chatgpt_api
|
hai 11 meses |
|
Alex Cheema
|
581856897a
clean up unused, formatting
|
hai 11 meses |
|
Alex Cheema
|
62e3726263
add RTX 20 series to device capabilities
|
hai 11 meses |
|
Alex Cheema
|
ebff636a25
script ot start openwebui
|
hai 11 meses |
|
Alex Cheema
|
394935711b
add all chat endpoints without v1 prefix to support ollama / openwebui. related: #175
|
hai 11 meses |
|
Alex Cheema
|
70172d7cb9
add /v1/models endpoint and change Content-Type of stremed response to text/event-stream. fixes #175
|
hai 11 meses |
|
Alex Cheema
|
d917778e2b
update mlx to 0.17.1 (not sure where 0.17.0 went on PyPi disappeared)g
|
hai 11 meses |
|
Alex Cheema
|
2667c8af44
cleaner download_progress
|
hai 11 meses |
|
Alex Cheema
|
f46d077beb
fix font dependencies for tinychat. related: #172
|
hai 11 meses |
|
Alex Cheema
|
8a4928f80c
fix gitignore to not ignore tinychat static files
|
hai 11 meses |
|
Alex Cheema
|
d515d9efa3
explicitly use absolute paths for tinychat deps
|
hai 11 meses |
|
Alex Cheema
|
a386c35fde
script to update tinychat deps
|
hai 11 meses |
|
Alex Cheema
|
3791e669a4
download tinychat dependencies all to local dir so we dont need internet
|
hai 11 meses |
|
Alex Cheema
|
85bab25ac0
fix local check if dir does not exist
|
hai 11 meses |
|
Alex Cheema
|
59c4393d95
first try loading tokenizer from local path instead of always going to the internet first. significant speed ups
|
hai 11 meses |
|
Alex Cheema
|
784e6bae21
print traceback on topology collection error
|
hai 11 meses |
|
Alex Cheema
|
8cad0e1849
only use_fast tokenizer for Mistral Large until this inconsistency bug is fixed #171
|
hai 11 meses |
|
Alex Cheema
|
85279007b3
hotfix edge case where we try to render before tokenizer is set
|
hai 11 meses |
|
Alex Cheema
|
09a8468395
upgrade mlx to 0.17.0
|
hai 11 meses |
|
Alex Cheema
|
1f9d16ec78
run tokenizers test in ci, run all models available
|
hai 11 meses |
|
Alex Cheema
|
6243846eeb
ci logs
|
hai 11 meses |
|
Alex Cheema
|
cfe980bdaa
simplify ci
|
hai 11 meses |
|
Alex Cheema
|
9513c4fd17
ci tail log files
|
hai 11 meses |
|
Alex Cheema
|
7a02acdcd5
fix ci output streaming
|
hai 11 meses |
|
Alex Cheema
|
ad695696a5
run on every commit on main, reuqire approval on other branches
|
hai 11 meses |
