arrow
Return

A Rolling Hash Algorithm and the Implementation to LZ4 Data Compression

delete2020-01-01
delete10
delete
OA
AI
H
Hao Jiang
S
Sian-Jheng Lin *
DOI:10.1109/ACCESS.2020.2974489delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
LZ77 is a dictionary compression algorithm by replacing the repeating sequence with the addresses of the previous referenced data in the stream. To find out these repetition, the LZ77 encoder maintains a hashing table, which have to frequently calculate hash values during the encoding process. In this paper, we present a class of rolling hash functions, that can calculate multiple hash values via a carry-less multiplication instruction. Then the proposed hash function is implemented in LZ4, which is a derivative of LZ77. The simulation shows that the encoding throughput of LZ4 has 15.7% improvement in average, and the compression ratio is +/- 1% in most cases.
Keywords:
Encoding
Data compression
Compression algorithms
Dictionaries
Indexes
Image coding
Image restoration
Carry-less multiplication
LZ4
LZ77
rolling hash
SIMD
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

IEEE Access cover
IEEE Access
IF:
3.6
Papers:
9.8W
Citations:
29.4W

Organization

C
chinese academy of sciences
Scholars:
56.2W
Papers: 44.8W
Citations: 704