 Alex Cheema
|
d4cc2cf13d
Merge pull request #480 from blindcrone/train-working
|
7 månader sedan |
 Nel Nibcord
|
329efb2381
Model loading and saving for tinygrad
|
7 månader sedan |
|
Nel Nibcord
|
b1397b49be
Proper sharding in tinygrad
|
7 månader sedan |
|
Nel Nibcord
|
7f0c12a98d
embed fix
|
7 månader sedan |
|
Nel Nibcord
|
bd3114457f
Dummied up an abstact save_checkpoint
|
7 månader sedan |
|
Nel Nibcord
|
cc66a0b782
Missed one
|
7 månader sedan |
|
Nel Nibcord
|
124a0338b4
Slightly simplified waiting for outstanding requests
|
7 månader sedan |
|
Nel Nibcord
|
a4313da8d1
Removed statefulModel stuff from mlx impl too
|
8 månader sedan |
|
Nel Nibcord
|
0673d6452c
Removed ensure_session to clean stuff up. May revisit later
|
8 månader sedan |
|
Nel Nibcord
|
6aaea8c74c
Abstract load checkpoint method
|
8 månader sedan |
|
Nel Nibcord
|
2a3a2e5e67
circular include lol
|
8 månader sedan |
|
Nel Nibcord
|
0c5762d18a
Node rename
|
7 månader sedan |
|
Nel Nibcord
|
c2332e2478
Moved nodes around
|
7 månader sedan |
|
Nel Nibcord
|
763fbf8486
Updated node refs
|
7 månader sedan |
|
Nel Nibcord
|
59af2dd592
Do we need casting here?
|
8 månader sedan |
|
Nel Nibcord
|
b22c21ac16
Some session method cleanup
|
8 månader sedan |
|
Nel Nibcord
|
98edb393b2
Initialize inference engine session in base class
|
8 månader sedan |
|
Nel Nibcord
|
bcf87e79b7
Okay let's turn no_grad back on. We'll worry about that when tinygrad training works
|
8 månader sedan |
|
Nel Nibcord
|
b7bbda3348
Removed tinygrad StatefulModel class, as it's no longer used
|
8 månader sedan |
|
Nel Nibcord
|
67f5ae25a5
Fixing tinygrad model
|
8 månader sedan |
|
Nel Nibcord
|
bfa3b36be5
Fixing tinygrad model
|
8 månader sedan |
|
Nel Nibcord
|
37a75d6b96
Fixing tinygrad model
|
8 månader sedan |
|
Nel Nibcord
|
0d3abfca95
Made models save properly
|
8 månader sedan |
|
Nel Nibcord
|
9283f6d7bd
Correct loss propagation so we can see the actual loss instead of just the requestor shard's loss
|
8 månader sedan |
|
Nel Nibcord
|
9eadee310b
Basic model saving
|
8 månader sedan |
|
Nel Nibcord
|
38e368f00b
Fixed up the ops so that batches work
|
8 månader sedan |
|
Nel Nibcord
|
dd3d99043b
Working distributed training
|
8 månader sedan |
|
Nel Nibcord
|
175ebc1c42
Coordination biz
|
8 månader sedan |
|
Nel Nibcord
|
3e869051f6
Okay we should probably await the update
|
8 månader sedan |
|
Nel Nibcord
|
75c8650f1f
Naive network-propagated loss implementation on MLX
|
8 månader sedan |
