Commit History

Autor SHA1 Mensaxe Data
  Alex Cheema 2084784470 per-request kv cache, remove all explicit reset functionality as it wasnt used. fixes #67 hai 9 meses
  Alex Cheema 54c98607ef more robust grpc discovery with asyncio and proper error handling, add flops to device capabilities. fixes #23 and progress on #33 hai 9 meses
  Alex Cheema 1d5c28aed4 (partially) restore exo node equality by forwarding prompts to the dynamically selected head hai 9 meses
  Alex Cheema e17905e295 add global reset hai 9 meses
  Alex Cheema a009f7d608 move examples to examples dir hai 9 meses