arrow
返回

Querying for Interactions

delete2021-01-01
delete1
PRE
AI
I
Ioannis Xarchakos *
N
Nick Koudas
DOI:10.1109/TKDE.2021.3094997delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Deep Learning and Computer Vision advances enabled sophisticated information extraction out of images and videos. Recent research aims to make objects, their types and relative locations, first class citizens for query processing purposes. We initiate research to explore declarative queries for real time video streams involving objects and their interactions. We seek to efficiently identify frames in which an object is interacting with another in a specific way. We propose progressive filters (PF) algorithm which deploys a sequence of inexpensive and less accurate filters to detect the presence of query specified objects on frames. We demonstrate that PF derives a least cost sequence of filters given the query objects' current selectivities. Since selectivities may vary as the video evolves, we present a statistical test to determine when to trigger filters' re-optimization. Finally, we present Interaction Sheave, a filtering approach that uses learned spatial information about objects and interactions to prune frames that are unlikely to involve the query specified action between them, thus improving the frame processing rate. We present the results of a thorough experimental evaluation involving real datasets. We experimentally demonstrate that our techniques can improve query performance (up to an order of magnitude) while maintaining competitive F1-score.
Keyword:
Videos
Query processing
Heuristic algorithms
Surveillance
Object recognition
Filtering algorithms
Proposals
video stream
filter optimization
human-object interaction
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

IEEE Transactions on Knowledge and Data Engineering 封面图
IEEE Transactions on Knowledge and Data Engineering
IF:
10.4
论文数:
6.8K
被引数:
3.2W

机构

U
university of toronto
学者数:
14.8W
论文数: 12.0W
被引数: 165
引用论文

引用论文

err1997-01-01
err0
PREAI
errHerman Depeweg; Khaled Hussein Bekheit
err分享
err收藏
err分享
err收藏
Multimodal control for human-robot cooperation
err2013-11-01
err0
errOAAI
errAndrea Cherubini; Robin Passama; Arnaud Meline; Andre Crosnier; Philippe Fraisse
err分享
err收藏
Intercomparison of SWAT and ANN techniques in simulating streamflows in the Astore Basin of the Upper Indus
err2023-09-22
err0
errOAAI
errSunaid Khan; Afed Ullah Khan; Mehran Khan; Fayaz Ahmad Khan; Sohail Khan; Jehanzeb Khan
err分享
err收藏
A Procedure for Scaling Perceptions of Lodging Quality
err2018-04-24
err0
PREAI
errJuliet M. Getty; Kenneth N. Thompson
err分享
err收藏
学者 查看更多内容