 Alex Cheema
|
e17e5f9a41
tests for tokenizers. unfortunately use_fast=False and use_fast=True give different behaviour
|
11 月之前 |
|
Alex Cheema
|
0d218e244e
use fast AutoProcessor fixes #164 tokenizer issues with mistral-large.
|
11 月之前 |
|
Alex Cheema
|
23ae5e92c5
hold circleci tests for approval on non-main branches
|
11 月之前 |
|
Alex Cheema
|
d54944f4ca
stream outputs from chatgpt api integration test
|
11 月之前 |
 Alex Cheema
|
1133e27ad3
Merge pull request #166 from exo-explore/formatting
|
11 月之前 |
|
Alex Cheema
|
f53056dede
more compact operator formatting
|
11 月之前 |
|
Alex Cheema
|
14f2846a9c
yapf set blank_line_before_nested_class_or_def to false
|
11 月之前 |
|
Alex Cheema
|
ea70c9fb76
reformat with yapf format.py
|
11 月之前 |
|
Alex Cheema
|
2e27076665
simplify formatting with yapf
|
11 月之前 |
|
Alex Cheema
|
417114fae4
fix mistral nemo
|
11 月之前 |
|
Alex Cheema
|
5101f03369
keep 4 in RotatingKVCache
|
11 月之前 |
|
Alex Cheema
|
6db73fab1c
laptop gpu device capabilites
|
11 月之前 |
|
Alex Cheema
|
647ffb94eb
increase cli generation timeout
|
11 月之前 |
|
Alex Cheema
|
dd24e7db1e
only ignore CancelledError inside stop
|
11 月之前 |
|
Alex Cheema
|
2e1233357c
ignore CancelledError when stopping the server
|
11 月之前 |
|
Alex Cheema
|
dfa3fdcf08
Merge pull request #161 from exo-explore/cli
|
11 月之前 |
|
Alex Cheema
|
ae35ada19b
fix headless mode with --disable-tui
|
11 月之前 |
|
Alex Cheema
|
b95916e0b5
show prompts and outputs in tui
|
11 月之前 |
|
Alex Cheema
|
e84304317c
add a cli that can be triggered with --run-model <model> --prompt <prompt>
|
11 月之前 |
|
Alex Cheema
|
cea9b48d24
update mlx-lm to 0.17.0, use lru caches for kv_cache with RotatingKVCache to optimise memory fixes #158
|
11 月之前 |
|
Alex Cheema
|
9c645b14f1
Merge pull request #157 from exo-explore/astra
|
1 年之前 |
|
Alex Cheema
|
430d4c0cf8
astra clarify readme, it's an example app
|
1 年之前 |
|
Alex Cheema
|
e87e7260f8
astra: live camera with overlay debug info / ui
|
1 年之前 |
|
Alex Cheema
|
1a419f1f00
astra better ui with camera vlm
|
1 年之前 |
|
Alex Cheema
|
8503543894
fix streaming, change default model to llava
|
1 年之前 |
|
Alex Cheema
|
c94ffa0e2b
fix audio buffering
|
1 年之前 |
|
Alex Cheema
|
23c713c012
better readme for astra
|
1 年之前 |
|
Alex Cheema
|
2fe3a52d60
readme for astra example
|
1 年之前 |
|
Alex Cheema
|
ff71ccc63d
send api request in astra example
|
1 年之前 |
|
Alex Cheema
|
b85d1956bc
open source astra example
|
1 年之前 |
