Rigorous Floating-Point to Fixed-Point Quantization of Deep Neural Networks on STM32 Micro-controllers - SCALP - Systèmes Critiques A Logiciel Prépondérant
Communication Dans Un Congrès Année : 2024

Rigorous Floating-Point to Fixed-Point Quantization of Deep Neural Networks on STM32 Micro-controllers

Résumé

Embedding artifcial intelligence onto lowpower devices is a challenging task that has been partially overcome by recent advances in machine learning and hardware design. Currently, deep neural networks can be deployed on embedded targets to perform various tasks such as speech recognition, object detection or human activity recognition. However, it is still possible to optimize deep neural networks on embedded devices. These optimizations mainly concern energy consumption, memory and real-time constraints, but also easier deployment at the edge. In addition, there is still a need for a better understanding of what can be achieved for different use cases. This work focuses on the quantization and deployment of deep neural networks on low-power 32-bit microcontrollers. In this article, the quantization method used is based on solving an integer optimization problem derived from the neural network model and concerning the accuracy of the computations and results at each point of the network. We evaluate the performance of our quantization method on a collection of neural networks measuring the analysis time and time-to-solution improvement between the foating- and fxed-point networks, considering a typical embedded platform employing a STM32 Nucleo-144 microcontroller.
Fichier principal
Vignette du fichier
CODIT24_0341_FI.pdf (536.2 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04608059 , version 1 (13-06-2024)

Identifiants

  • HAL Id : hal-04608059 , version 1

Citer

Dorra Ben Khalifa, Matthieu Martel. Rigorous Floating-Point to Fixed-Point Quantization of Deep Neural Networks on STM32 Micro-controllers. 10th International Conference on Control, Decision and Information Technologies (CoDIT), Jul 2024, Valetta, Malta, France. ⟨hal-04608059⟩
84 Consultations
76 Téléchargements

Partager

More