arrow
返回

A General SIMD-Based Approach to Accelerating Compression Algorithms

delete2015-03-23
delete22
delete
OA
AI
赵鑫 (Wayne Xin Zhao) *
X
Xudong Zhang
D
Daniel Lemire
D
Dongdong Shan
J
Jian‐Yun Nie
H
Hongfei Yan
J
Ji-Rong Wen
DOI:10.1145/2735629delete
delete原文链接
delete分享
delete收藏
查看原文
摘要

摘要

En 中文
Compression algorithms are important for data-oriented tasks, especially in the era of Big Data. Modern processors equipped with powerful SIMD instruction sets provide us with an opportunity for achieving better compression performance. Previous research has shown that SIMD-based optimizations can multiply decoding speeds. Following these pioneering studies, we propose a general approach to accelerate compression algorithms. By instantiating the approach, we have developed several novel integer compression algorithms, called Group-Simple, Group-Scheme, Group-AFOR, and Group-PFD, and implemented their corresponding vectorized versions. We evaluate the proposed algorithms on two public TREC datasets, aWikipedia dataset, and a Twitter dataset. With competitive compression ratios and encoding speeds, our SIMD-based algorithms outperform state-of-the-art nonvectorized algorithms with respect to decoding speeds.
Keyword:
Algorithms
Performance
Measurement
Experimentation
SIMD
inverted index
index compression
integer encoding
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

ACM Transactions on Information Systems 封面图
ACM Transactions on Information Systems
IF:
9.1
论文数:
1.2K
被引数:
4.7K

机构

R
Renmin University of China
学者数:
8.1K
论文数: 7.7K
被引数: 1.1W
U
university of quebec montreal
学者数:
3.9K
论文数: 3.5K
被引数: 7
U
university of quebec
学者数:
2.0W
论文数: 1.9W
被引数: 19
P
peking university
学者数:
11.9W
论文数: 8.7W
被引数: 146
学者 查看更多机构
引用论文

引用论文

X-Ray Detected Optical Activity
err2010-03-03
err0
PREAI
errA. Rogalev; J. Goulon; F. Wilhelm; A. Bosak
err分享
err收藏
Methylation Marks of Blood Leukocytes of Native Hucul Mares Differentiated in Age
err2019-06-02
err0
errOAAI
errT. Ząbek; E. Semik-Gurgul; T. Szmatoła; A. Gurgul; A. Fornal; M. Bugno-Poniewierska
err分享
err收藏
A meta‐synthesis of qualitative studies on stress urinary incontinence in women for the development of a Core Outcome Set: A systematic review
err2021-10-11
err0
PREAI
errMaria Patricia Rada; Stephanie Jones; Cornelia Betschart; Gabriele Falconi; Jorge Milhem Haddad; Stergios K. Doumouchtsis
err分享
err收藏
Chemical cross‐linking of the chloroplast localized small heat‐shock protein, Hsp21, and the model substrate citrate synthase
err2009-01-02
err0
errOAAI
errEmma Åhrman; Wietske Lambert; J. Andrew Aquilina; Carol V. Robinson; Cecilia Sundby Emanuelsson
err分享
err收藏
MULTILOCUS GENOTYPING OF CRYPTOSPORIDIUM HOMINIS ASSOCIATED WITH DIARRHEA OUTBREAK IN A DAY CARE UNIT IN SÃO PAULO
err2006-04-01
err0
errOAAI
errElenice Messias do Nascimento Gonçalves; Alexandre J. da Silva; Maria Bernadete de Paula Eduardo; Iaiko Horroiva Uemura; Iaci N.S. Moura; Vera L. Pagliusi Castilho; Carlos Eduardo Pereira Corbett
err分享
err收藏
学者 查看更多内容