Ajou University repository

EDeN: Enabling Low-Power CNN Inference on Edge Devices Using Prefetcher-assisted NVM Systems
Citations

SCOPUS

0

Citation Export

DC Field Value Language
dc.contributor.authorJang, Jihoon-
dc.contributor.authorLee, Hyokeun-
dc.contributor.authorKim, Hyun-
dc.date.issued2024-08-05-
dc.identifier.urihttps://aurora.ajou.ac.kr/handle/2018.oak/37155-
dc.identifier.urihttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85204942518&origin=inward-
dc.description.abstractThe accuracy of convolutional neural networks (CNNs) has significantly improved over the years. Meanwhile, due to the high portability and usefulness of edge devices, the demand for artificial intelligence (AI) based applications on edge computing devices has been soaring recently. Accordingly, CNN inference has become one of the mainstream AI applications on edge devices. However, the continually increasing leakage power of edge devices drags down the wide deployment of CNN inference applications, as the technology node scales down.In this work, we focus on reducing the power consumption in main memory, which consumes considerable power in CNN inference. Particularly, we observed that the idle state of memory is dominant in computationally intensive CNN inference. To achieve low-power CNN inference on edge devices, we first utilize next-generation nonvolatile memory (NVM) as the main memory device rather than dynamic random-access memory (DRAM) only for CNN inference tasks. To mitigate the increased latency caused by NVM, we propose a novel prefetcher that smartly leverages existing resources in commercial NVM system models; it is designed to predictably manage the locality-specific demands of CNN models while smartly leveraging existing resources in a modern NVM system. Furthermore, utilizing a prefetcher-based approach, we optimize the write allocation to enhance the data reuse and energy efficiency in CNN workloads. Based on simulation, our design improves the energy efficiency by 50% with a negligible impact on the performance compared with conventional DRAM-based platforms.-
dc.description.sponsorshipThis study was supported by the Research Program funded by the SeoulTech(Seoul National University of Science and Technology). Hyun Kim and Hyokeun Lee are the corresponding authors.-
dc.language.isoeng-
dc.publisherAssociation for Computing Machinery, Inc-
dc.subject.meshConvolutional neural network-
dc.subject.meshEdge device-
dc.subject.meshLow Power-
dc.subject.meshMemory systems-
dc.subject.meshNetwork inference-
dc.subject.meshNon-volatile memory-
dc.subject.meshPower-
dc.subject.meshPrefetcher-
dc.titleEDeN: Enabling Low-Power CNN Inference on Edge Devices Using Prefetcher-assisted NVM Systems-
dc.typeConference-
dc.citation.conferenceDate2024.8.5. ~ 2024.8.7.-
dc.citation.conferenceName29th ACM/IEEE International Symposium on Low Power Electronics and Design, ISLPED 2024-
dc.citation.editionProceedings of the 29th International Symposium on Low Power Electronics and Design, ISLPED 2024-
dc.citation.titleProceedings of the 29th International Symposium on Low Power Electronics and Design, ISLPED 2024-
dc.identifier.bibliographicCitationProceedings of the 29th International Symposium on Low Power Electronics and Design, ISLPED 2024-
dc.identifier.doi10.1145/3665314.3670801-
dc.identifier.scopusid2-s2.0-85204942518-
dc.identifier.urlhttp://dl.acm.org/citation.cfm?id=3665314-
dc.subject.keywordconvolutional neural network (CNN)-
dc.subject.keywordedge device-
dc.subject.keywordlow power-
dc.subject.keywordnon-volatile memory (NVM)-
dc.subject.keywordprefetcher-
dc.type.otherConference Paper-
dc.description.isoafalse-
dc.subject.subareaElectrical and Electronic Engineering-
Show simple item record

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Lee, Hyokeun  Image
Lee, Hyokeun 이효근
Department of Electrical and Computer Engineering
Read More

Total Views & Downloads

File Download

  • There are no files associated with this item.