logo
科言猫学术研究的AI总结
language
手机端手机端
  • Phone Feature微信小程序
简体中文简体中文
notice消息通知
博客博客
delete
arrow
返回

Zero-shot medical image classification via large multimodal models and knowledge graphs-driven processing

delete2025-10-13
delete0
PRE
AI
X
Xinfu Liu
Y
Yirui Wu *
Y
Yuting Zhou
DOI：10.1016/j.ymeth.2025.09.006delete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
• 我们提出CMKR，一种用于零样本医学图像分类任务的跨模态知识表示框架。该框架充分利用了大模态模型提供的隐式知识以及知识图谱提供的显式知识，成功提高了医学图像诊断的成功率。 • 我们提出了一种跨模态对齐策略，通过设计适当的损失函数，严格对齐跨模态和模内特征，包括图像-文本对、图像-图像对和文本-文本对。 • 我们通过在公开数据集上的大量实验证明，我们的方法能够显著提升零样本医学图像分类任务的性能。

期刊

Methods 封面图
Methods
IF:
4.3
论文数:
4.9K
被引数:
2.4W

机构

H
Hohai University
学者数:
2.3W
论文数: 1.8W
被引数: 2.1W
引用论文

引用论文

Multi-Modal Cross-Domain Alignment Network for Video Moment Retrieval用于视频矩检索的多模态跨域对齐网络
errIEEE TRANSACTIONS ON MULTIMEDIA
IF9.7
err2023-01-01
err7
errOAAI
errFang, Xiang; Liu, Daizong; Zhou, Pan; Hu, Yuchong
err分享
err收藏
Cross-Attention Enhanced Pyramid Multi-Scale Networks for Sensor-Based Human Activity Recognition
errIEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
IF6.8
err2024-05-01
err2
PREAI
errPang, Hongsen; Zheng, Li; Fang, Hongbin
err分享
err收藏
APRNet: A 3D Anisotropic Pyramidal Reversible Network With Multi-Modal Cross-Dimension Attention for Brain Tissue Segmentation in MR Images
errIEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
IF6.8
err2022-02-01
err9
PREAI
errZhuang, Yuzhou; Liu, Hong; Song, Enmin; Ma, Guangzhi; Xu, Xiangyang; Hung, Chih-Cheng
err分享
err收藏
End-to-End Pre-Training With Hierarchical Matching and Momentum Contrast for Text-Video Retrieval
errIEEE Transactions on Image Processing
IF0
err2023-01-01
err0
PREAI
errWenxue Shen; Jingkuan Song; Xiaosu Zhu; Gongfu Li; Heng Tao Shen
err分享
err收藏
Structure-Guided Cross-Attention Network for Cross-Domain OCT Fluid Segmentation
errIEEE TRANSACTIONS ON IMAGE PROCESSING
IF13.7
err2023-01-01
err2
PREAI
errHe, Xingxin; Zhong, Zhun; Fang, Leyuan; He, Min; Sebe, Nicu
err分享
err收藏
USER: Unified Semantic Enhancement With Momentum Contrast for Image-Text Retrieval
errIEEE TRANSACTIONS ON IMAGE PROCESSING
IF13.7
err2024-01-01
err7
errOAAI
errZhang, Yan; Ji, Zhong; Wang, Di; Pang, Yanwei; Li, Xuelong
err分享
err收藏
Visualizing and Understanding Contrastive Learning
errIEEE TRANSACTIONS ON IMAGE PROCESSING
IF13.7
err2024-01-01
err5
errOAAI
errSammani, Fawaz; Joukovsky, Boris; Deligiannis, Nikos
err分享
err收藏
Toward General Cross-Modal Signal Reconstruction for Robotic Teleoperation
errIEEE TRANSACTIONS ON MULTIMEDIA
IF9.7
err2024-01-01
err3
PREAI
errChen, Yanan; Li, Ang; Wu, Dan; Zhou, Liang
err分享
err收藏
A Weakly Supervised Segmentation Network Embedding Cross-Scale Attention Guidance and Noise-Sensitive Constraint for Detecting Tertiary Lymphoid Structures of Pancreatic Tumors
errIEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
IF6.8
err2024-02-01
err0
errOAAI
errWang, Bingxue; Zou, Liwen; Chen, Jun; Cao, Yingying; Cai, Zhenghua; Qiu, Yudong; Mao, Liang; Wang, Zhongqiu; Chen, Jingya; Gui, Luying; Yang, Xiaoping
err分享
err收藏
B2C-AFM: Bi-Directional Co-Temporal and Cross-Spatial Attention Fusion Model for Human Action Recognition
errIEEE TRANSACTIONS ON IMAGE PROCESSING
IF13.7
err2023-01-01
err5
PREAI
errGuo, Fangtai; Jin, Tianlei; Zhu, Shiqiang; Xi, Xiangming; Wang, Wen; Meng, Qiwei; Song, Wei; Zhu, Jiakai
err分享
err收藏
学者 查看更多内容