浏览代码

one-line output buffering

Nel Nibcord 5 月之前
父节点
当前提交
10e9f44a10
共有 1 个文件被更改,包括 1 次插入2 次删除
  1. 1 2
      exo/orchestration/standard_node.py

+ 1 - 2
exo/orchestration/standard_node.py

@@ -119,8 +119,7 @@ class StandardNode(Node):
     if request_id not in self.buffered_logits:
       self.buffered_logits[request_id] = ([], False)
 
-    for i in np.reshape(result, (-1, 1, result.shape[-1])):
-      self.buffered_logits[request_id][0].append(i)
+    self.buffered_logits[request_id][0] += [i for i in np.reshape(result, (-1, 1, result.shape[-1]))]
 
     if shard.is_last_layer():
       result = await self.inference_engine.sample(result)