Rigorous Floating-Point to Fixed-Point Quantization of Deep Neural Networks on STM32 Micro-controllers
Résumé
Embedding artifcial intelligence onto lowpower devices is a challenging task that has been partially
overcome by recent advances in machine learning and
hardware design. Currently, deep neural networks can be
deployed on embedded targets to perform various tasks
such as speech recognition, object detection or human
activity recognition. However, it is still possible to optimize
deep neural networks on embedded devices. These optimizations mainly concern energy consumption, memory
and real-time constraints, but also easier deployment at
the edge. In addition, there is still a need for a better
understanding of what can be achieved for different use
cases. This work focuses on the quantization and deployment of deep neural networks on low-power 32-bit microcontrollers. In this article, the quantization method used is
based on solving an integer optimization problem derived
from the neural network model and concerning the accuracy of the computations and results at each point of the
network. We evaluate the performance of our quantization
method on a collection of neural networks measuring the
analysis time and time-to-solution improvement between
the foating- and fxed-point networks, considering a typical
embedded platform employing a STM32 Nucleo-144 microcontroller.
Origine | Fichiers produits par l'(les) auteur(s) |
---|