.png){kind=icon}
返回
Medical object detector jointly driven by knowledge and data
.png){kind=icon}
PRE
AI
DOI：10.1016/j.neunet.2023.12.038.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Most of the existing object detection algorithms are trained on medical datasets and then used for prediction. When the features of an object are not obvious in an image, these models are prone to mislocalize and misclassify it. In this paper, we propose a medical Object Detection algorithm jointly driven by Knowledge and Data (ODKD). It enables medical semantic knowledge provided by specialized physicians to be effective and helpful when traditional models have difficulty in correctly detecting objects relying on features alone. Our model consists of a base object detector together with a fusion module: the base object detector is trained based on medical datasets to obtain data-driven results; then we use a graph to represent external semantic knowledge and map the data-driven results to the nodes embedding of this graph structure. In the fusion module, a graph convolution network is used to fuse the data-driven results with the external semantic knowledge to output category adjustment coefficients. Finally, the adjustment coefficients are used to adjust the data-driven results to obtain results jointly driven by knowledge and data. Experiments show that professional medical semantic knowledge can effectively correct the erroneous results of the base detector, and the effect of our model outperforms Faster Rcnn, YOLOv5, YOLOv7, etc. on three medical datasets, Camus, Synapse, and AMOS.
Keyword:
Object detection
GCN
Semantic relations
Jointly driven
期刊
IF:
6.3
论文数:
8.3K
被引数:
3.0W
机构
引用论文
Synthesis and Characterization of an Efficient New Liquid Laser Dye Material - Chalcone (DMAPPP)
OAAI
OAAI分享收藏Multi-layer information fusion based on graph convolutional network for knowledge-driven herb recommendation基于图卷积网络的多层信息融合知识驱动草药推荐.png)
NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏Merged-nets enumeration for the systematic design of multicomponent reticular structuresScience
ScienceIF0
PREAI
分享收藏Attentional feature pyramid network for small object detection基于注意特征金字塔网络的小目标检测NEURAL NETWORKS
NEURAL NETWORKSIF6.3
PREAI
分享收藏
查看更多内容