Warrior_EA/DirectML
Repository files (latest commit first)
Filename Latest commit message Latest commit date
AnimateDread 4f28165cd3 fix: remove broken DFA optimizer, use plain gradient descent
The DFA (Direct Feedback Alignment) option was never a correct implementation:
it deterministically flipped the sign of half of all gradients based on
connection index parity, causing permanent gradient ascent for those weights
and guaranteed divergence. The backward pass was also incompatible with the
OpenCL/DirectML neuron model (layer.Total() == 1). This change removes all DFA
logic, including the enum value and `DfaFeedbackSignal` method, and replaces it
with plain gradient descent in all momentum update kernels. The `optimizer`
kernel argument is retained for binary compatibility but is no longer used.
2026-07-29 00:03:54 -04:00
..
build.bat fix: handle OCL neuron types in gradient clipping and backprop loops 2026-07-28 20:46:27 -04:00
build_cpu.bat fix: handle OCL neuron types in gradient clipping and backprop loops 2026-07-28 20:46:27 -04:00
smoke_test.cpp fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorCPU.cpp fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorCPU.dll fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorCPU.exp fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorCPU.h feat(opencl): add feedback alignment support to weight update kernels 2026-07-28 15:01:40 -04:00
WarriorCPU.lib feat: add SGD+momentum optimizer and input-driven hyperparameters 2026-07-18 14:56:41 -04:00
WarriorCPU.obj fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorCPU.pdb fix(Expert/ExpertSignalAIBase): add feature cache and fix oversampling imbalance 2026-07-14 22:49:14 -04:00
WarriorDML.cpp fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorDML.dll fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorDML.exp fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00
WarriorDML.h feat(opencl): add feedback alignment support to weight update kernels 2026-07-28 15:01:40 -04:00
WarriorDML.lib feat: add SGD+momentum optimizer and input-driven hyperparameters 2026-07-18 14:56:41 -04:00
WarriorDML.obj fix: remove broken DFA optimizer, use plain gradient descent 2026-07-29 00:03:54 -04:00