Your browser doesn't support javascript.
An ASIP for Neural Network Inference on Embedded Devices with 99% PE Utilization and 100% Memory Hidden under Low Silicon Cost.
Gao, Muxuan; Chen, He; Liu, Dake.
  • Gao M; School of Information and Electronics, Beijing Institute of Technology, Beijing 100811, China.
  • Chen H; School of Information and Electronics, Beijing Institute of Technology, Beijing 100811, China.
  • Liu D; School of Information and Electronics, Beijing Institute of Technology, Beijing 100811, China.
Sensors (Basel) ; 22(10)2022 May 19.
Article in English | MEDLINE | ID: covidwho-1875743
ABSTRACT
The computation efficiency and flexibility of the accelerator hinder deep neural network (DNN) implementation in embedded applications. Although there are many publications on deep neural network (DNN) processors, there is still much room for deep optimization to further improve results. Multiple dimensions must be simultaneously considered when designing a DNN processor to reach the performance limit of the architecture, including architecture decision, flexibility, energy efficiency, and silicon cost minimization. Flexibility is defined as the ability to support as many multiple networks as possible and to easily adjust the scale. For energy efficiency, there are huge opportunities for power efficiency optimization, which involves access minimization and memory latency minimization based on on-chip memory minimization. Therefore, this work focused on low-power and low-latency data access with minimized silicon cost. This research was implemented based on an ASIP (application specific instruction set processor) in which an ISA was based on the caffe2 inference operator and the hardware design was based on a single instruction multiple data (SIMD) architecture. The scalability and system performance of our SoC extension scheme were demonstrated. The VLIW was used to execute multiple instructions in parallel. All costs for data access time were thus eliminated for the convolution layer. Finally, the processor was synthesized based on TSMC 65 nm technology with a 200 MHz clock, and the Soc extension scheme was analyzed in an experimental model. Our design was tested on several typical neural networks, achieving 196 GOPS at 200 MHz and 241 GOPS/W on the VGG16Net and AlexNet.
Subject(s)
Keywords

Full text: Available Collection: International databases Database: MEDLINE Main subject: Silicon / Neural Networks, Computer Language: English Year: 2022 Document Type: Article Affiliation country: S22103841

Similar

MEDLINE

...
LILACS

LIS


Full text: Available Collection: International databases Database: MEDLINE Main subject: Silicon / Neural Networks, Computer Language: English Year: 2022 Document Type: Article Affiliation country: S22103841