Browse Source

Okay let's turn no_grad back on. We'll worry about that when tinygrad training works

Nel Nibcord 6 months ago
parent
commit
bcf87e79b7
1 changed files with 1 additions and 1 deletions
  1. 1 1
      exo/inference/tinygrad/inference.py

+ 1 - 1
exo/inference/tinygrad/inference.py

@@ -16,7 +16,7 @@ from .losses import length_masked_ce_loss
 from collections import OrderedDict
 import asyncio
 
-Tensor.no_grad = False
+Tensor.no_grad = True 
 # default settings
 TEMPERATURE = int(os.getenv("TEMPERATURE", 0.85))
 TOP_K = 25