Presentation information

General Session

General Session » GS-7 Vision, speech media processing

[3I4-GS-7a] 画像音声メディア処理:基礎

Thu. Jun 10, 2021 3:20 PM - 5:00 PM Room I (GS room 4)

座長:岡部 浩司(NEC)

3:40 PM - 4:00 PM

[3I4-GS-7a-02] Improvement of object detection inference speed and accuracy in edge environment

〇Yoshiyuki Konishi1, Daisuke Kunimune1, Yoshitaka Nishida1 (1. Miraxia Edge Technology Corporation)

Keywords:Object Detection, Edge AI, Speeding up Inference, Quantization, TensorFlowLite

In recent years, the demand for edge AI has been expanding from the viewpoint of real-time performance and data confidentiality. We use the QAT (Quantization Aware Training) method of TensorFlow and TensorFlow Lite to realize speed up and memory saving in edge AI. In the current situation where new AI models are being devised one after another, it is unlikely that the QAT will support all operations. Therefore, depending on the AI model used, there is a problem that speed and accuracy will decrease due to the inclusion of unsupported operations. In this paper, we will take YOLOv3-tiny, an object detection model in which such a problem occurs, as an example to propose methods for improving speed and accuracy. We were able to half the inference time on the Raspberry Pi 3 Model B+ and improve the inference accuracy to the same level as before quantization.

Authentication for paper PDF access

A password is required to view paper PDFs. If you are a registered participant, please log on the site from Participant Log In.
You could view the PDF with entering the PDF viewing password bellow.