.png){kind=icon}
返回
Quality metrics for search engine deterministic sort orders
.png){kind=icon}
PRE
AI
DOI：10.1016/j.ipm.2022.103102.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
eCommerce search engines such as eBay and Amazon often allow the user to order their search results on deterministic features such as price, time, or distance from the seller. Using metrics such as precision at 10 documents (P@10), others have already shown that the quality of deterministically sorted results is lower than that of best-match (or relevance) sorted results, and that work is needed in order to improve result quality. But metrics such as P@10 are based purely on relevance, and do not reflect the order-feature: cost (be it price, time, or otherwise) - and it is hard to see how to improve a system without a metric that reflects the quality of the ordering. In this contribution we introduce a set of metrics that, using relevance and cost, measure the quality of deterministically sorted search engine results. We examine metrics from the perspective of the buyer, the seller, and the systems engineer. Using our new metrics (buying power (bp), buying power for K (bp4k), selling power (sp), and cheapest precision (P-c)) we re-evaluate the results of the eBay SIGIR 2019 eCommerce Search Challenge: High Accuracy Recall Task'' and demonstrate how to include cost in a metric designed to evaluate the quality of deterministically ordered lists of results.
Keyword:
eCommerce
Evaluation
Metrics
期刊
I
IF:
6.9
论文数:
5.2K
被引数:
1.4W
机构
引用论文
The Role of Canine Distemper Virus and Persistent Organic Pollutants in Mortality Patterns of Caspian Seals (Pusa caspica).png)
PLoS ONE
OAAI
PLoS ONEIF0
OAAI分享收藏 没有更多内容
没有更多内容