Ajou University repository

Speed-Dedup: A New Deduplication Framework for Enhanced Performance and Reduced Overhead in Scale-Out Storageoa mark
Citations

SCOPUS

0

Citation Export

DC Field Value Language
dc.contributor.authorHamandawana, Prince-
dc.contributor.authorCho, Da Jung-
dc.contributor.authorChung, Tae Sun-
dc.date.issued2024-11-01-
dc.identifier.issn2079-9292-
dc.identifier.urihttps://aurora.ajou.ac.kr/handle/2018.oak/34622-
dc.identifier.urihttps://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85210272345&origin=inward-
dc.description.abstractConventional deduplication systems face critical challenges such as excessive write amplification, high read/write latency, and sub-optimal storage utilization. These limitations often undermine the performance benefits of deduplication by slowing down I/O acknowledgements due to amplified deduplication I/Os, excessive data chunk replication, and strict consistency requirements. To address these issues, we present Speed-Dedup, a novel deduplication framework that employs a deduplicated primary–semi-deduplicated replica object approach. This strategy reduces write amplification by restricting deduplication to the primary object while maintaining a semi-deduplicated replica object used for immediate read/write acknowledgements, thus enhancing I/O latency and storage efficiency. Speed-Dedup also replaces traditional strong consistency models with eventual consistency, allowing for non-blocking read operations and improving overall system throughput. Experimental results demonstrate that Speed-Dedup significantly outperforms traditional methods like GRATE and CAO, showing up to 21% improvement in I/O performance under low deduplication ratios and maintaining 14% or more gains under higher ratios. Additionally, write amplification is substantially reduced and latency improves by over 100% with faster recovery times during system failures. These findings highlight the effectiveness of Speed-Dedup as a scalable and efficient solution.-
dc.description.sponsorshipThis work was supported by Institute of Information and Communications Technology Planning and Evaluation (IITP) under the Artificial Intelligence Convergence Innovation Human Resources Development (IITP-2024-RS-2023-00255968) grant and the ITRC (Information Technology Research Center) support program (IITP-2021-0-02051) funded by the Korea government (MSIT). Additionally, this work was supported by the BK21 FOUR program of the National Research Foundation of Korea funded by the Ministry of Education (NRF5199991014091).-
dc.language.isoeng-
dc.publisherMultidisciplinary Digital Publishing Institute (MDPI)-
dc.titleSpeed-Dedup: A New Deduplication Framework for Enhanced Performance and Reduced Overhead in Scale-Out Storage-
dc.typeArticle-
dc.citation.number22-
dc.citation.titleElectronics (Switzerland)-
dc.citation.volume13-
dc.identifier.bibliographicCitationElectronics (Switzerland), Vol.13 No.22-
dc.identifier.doi10.3390/electronics13224393-
dc.identifier.scopusid2-s2.0-85210272345-
dc.identifier.urlwww.mdpi.com/journal/electronics-
dc.subject.keyworddata deduplication-
dc.subject.keyworddistributed storage system-
dc.subject.keywordfault tolerance-
dc.subject.keywordscale-out storage-
dc.subject.keywordwrite amplification-
dc.type.otherArticle-
dc.description.isoatrue-
dc.subject.subareaControl and Systems Engineering-
dc.subject.subareaSignal Processing-
dc.subject.subareaHardware and Architecture-
dc.subject.subareaComputer Networks and Communications-
dc.subject.subareaElectrical and Electronic Engineering-
Show simple item record

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

HAMANDAWANA PRINCE Image
HAMANDAWANA PRINCEHAMANDAWANA, PRINCE
Department of Software and Computer Engineering
Read More

Total Views & Downloads

File Download