Training neural networks with end-to-end optical backpropagation

Journal article

Optics is an exciting route for the next generation of computing hardware for machine learning, promising several orders of magnitude enhancement in both computational speed and energy efficiency. However, reaching the full capacity of an optical neural network necessitates the computing be implemented optically not only for inference, but also for training. The primary algorithm for network training is backpropagation, in which the calculation is performed in the order opposite to the information flow for inference. While straightforward in a digital computer, optical implementation of backpropagation has remained elusive, particularly because of the conflicting requirements for the optical element that implements the nonlinear activation function. In this work, we address this challenge for the first time with a surprisingly simple scheme, employing saturable absorbers for the role of activation units. Our approach is adaptable to various analog platforms and materials, and demonstrates the possibility of constructing neural networks entirely reliant on analog optical processes for both training and inference tasks.

Authors: Spall, J; Guo, X; Lvovsky, A

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Society of Photo-Optical Instrumentation Engineers
• Journal: Advanced Photonics
• Volume: 7
• Issue: 1
• Article number: 016004
• Publication date: 2025-02-04
• Acceptance date: 2024-12-11
• DOI: 10.1117/1.AP.7.1.016004
• ISSN: 2577-5421
• Language: English
• Keywords: machine learning; optical neural networks; optical computing