PC-ALM brings layer-local learning close to backpropagation
Sakana AI researchers Jeffrey Seely and Julian Gould have introduced Augmented Lagrangian Predictive Coding, or PC-ALM, a training method designed as a layer-local alternative to backpropagation. The approach adds a Lagrange multiplier to each layer’s constraint while retaining predictive coding’s local updates. The researchers say these multipliers converge to exact backpropagation adjoints in linear networks under a stability condition.