 Alex Cheema
|
ea70c9fb76
reformat with yapf format.py
|
8 月之前 |
|
Alex Cheema
|
2084784470
per-request kv cache, remove all explicit reset functionality as it wasnt used. fixes #67
|
9 月之前 |
|
Alex Cheema
|
54c98607ef
more robust grpc discovery with asyncio and proper error handling, add flops to device capabilities. fixes #23 and progress on #33
|
9 月之前 |
|
Alex Cheema
|
1d5c28aed4
(partially) restore exo node equality by forwarding prompts to the dynamically selected head
|
9 月之前 |
|
Alex Cheema
|
e17905e295
add global reset
|
9 月之前 |
|
Alex Cheema
|
a009f7d608
move examples to examples dir
|
9 月之前 |
