.png){kind=icon}
返回
Efficient Sentiment-Aware Web Crawling Methods for Constructing Sentiment Dictionary
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3129187.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
In traditional web crawling, all web pages crawled are first stored to databases. As a result, this approach can store unnecessary web pages and requires additional running time for the construction of a sentiment dictionary in a particular domain because sentiment words should be identified by scanning all web pages in the database. To address these problems, we first define the sentiment-aware web crawling problem and then propose two hash-based methods for the implementation. One is based on hash join and the other is bucket-sorted hash join. In particular, we propose a novel bucket-sorted hash join for the efficient sentiment-aware web crawling method. Our experimental results show that the proposed web crawling method using bucket-sorted hash join outperforms existing web crawling methods by significantly reducing the running time and storage space. In the proposed method, the time taken to execute the sentiment-aware task per web page is 0.016 seconds and the database space can be saved by 59% compared to the existing web crawling methods.
Keyword:
Web pages
Crawlers
Vocabulary
Dictionaries
Sentiment analysis
Uniform resource locators
Feature extraction
Hash join
sentiment analysis
sentiment lexicon
web crawling
期刊
IF:
3.6
论文数:
9.8W
被引数:
29.4W
机构
查看更多机构
引用论文
Automatic construction of domain-specific sentiment lexicon based on constrained label propagation
PREAI
分享收藏Development and validation of a computer-based algorithm to identify foreign-born patients with HIV infection from the electronic medical record基于计算机算法的开发与验证：用于从电子病历中识别HIV感染的外籍患者
OAAI
OAAI分享收藏Advanced Quantum Based Neural Network Classifier and Its Application for Objectionable Web Content Filtering.png)
IEEE ACCESSOAAI
IEEE ACCESSIF3.6
OAAI分享收藏分享收藏The entanglement of two moving atoms interacting with a single-mode field via a three-photon process
PREAI
分享收藏 没有更多内容