.png){kind=icon}
Return
Efficient Sentiment-Aware Web Crawling Methods for Constructing Sentiment Dictionary
.png){kind=icon}
OA
AI
DOI：10.1109/ACCESS.2021.3129187.png)
.png){kind=icon}
Original request for help.png){kind=icon}
Share.png){kind=icon}
Save
Abstract
En 中文
In traditional web crawling, all web pages crawled are first stored to databases. As a result, this approach can store unnecessary web pages and requires additional running time for the construction of a sentiment dictionary in a particular domain because sentiment words should be identified by scanning all web pages in the database. To address these problems, we first define the sentiment-aware web crawling problem and then propose two hash-based methods for the implementation. One is based on hash join and the other is bucket-sorted hash join. In particular, we propose a novel bucket-sorted hash join for the efficient sentiment-aware web crawling method. Our experimental results show that the proposed web crawling method using bucket-sorted hash join outperforms existing web crawling methods by significantly reducing the running time and storage space. In the proposed method, the time taken to execute the sentiment-aware task per web page is 0.016 seconds and the database space can be saved by 59% compared to the existing web crawling methods.
Keywords:
Web pages
Crawlers
Vocabulary
Dictionaries
Sentiment analysis
Uniform resource locators
Feature extraction
Hash join
sentiment analysis
sentiment lexicon
web crawling
Journal
IF:
3.6
Papers:
9.8W
Citations:
29.4W
Organization
View more organizations
Cited Papers
ShareSaveAutomatic construction of domain-specific sentiment lexicon based on constrained label propagation
PREAI
ShareSaveAdvanced Quantum Based Neural Network Classifier and Its Application for Objectionable Web Content Filtering.png)
IEEE ACCESS
OAAI
IEEE ACCESSIF3.6
OAAIShareSaveShareSaveShareSaveThe entanglement of two moving atoms interacting with a single-mode field via a three-photon process
PREAI
ShareSaveShareSave no more