.png){kind=icon}
返回
Tumor detection under cystoscopy with transformer-augmented deep learning algorithm
.png){kind=icon}
OA
AI
DOI：10.1088/1361-6560/ace499.png)
.png){kind=icon}
原文求助.png){kind=icon}
分享.png){kind=icon}
收藏
摘要
En 中文
Objective. Accurate tumor detection is critical in cystoscopy to improve bladder cancer resection and decrease recurrence. Advanced deep learning algorithms hold the potential to improve the performance of standard white-light cystoscopy (WLC) in a noninvasive and cost-effective fashion. The purpose of this work is to develop a cost-effective, transformer-augmented deep learning algorithm for accurate detection of bladder tumors in WLC and to assess its performance on archived patient data. Approach. 'CystoNet-T', a deep learning-based bladder tumor detector, was developed with a transformer-augmented pyramidal CNN architecture to improve automated tumor detection of WLC. CystoNet-T incorporated the self-attention mechanism by attaching transformer encoder modules to the pyramidal layers of the feature pyramid network (FPN), and obtained multi-scale activation maps with global features aggregation. Features resulting from context augmentation served as the input to a region-based detector to produce tumor detection predictions. The training set was constructed by 510 WLC frames that were obtained from cystoscopy video sequences acquired from 54 patients. The test set was constructed based on 101 images obtained from WLC sequences of 13 patients. Main results. CystoNet-T was evaluated on the test set with 96.4 F1 and 91.4 AP (Average Precision). This result improved the benchmark of Faster R-CNN and YOLO by 7.3 points in F1 and 3.8 points in AP. The improvement is attributed to the strong ability of global attention of CystoNet-T and better feature learning of the pyramids architecture throughout the training. The model was found to be particularly effective in highlighting the foreground information for precise localization of the true positives while favorably avoiding false alarms Significance. We have developed a deep learning algorithm that accurately detects bladder tumors in WLC. Transformer-augmented AI framework promises to aid in clinical decision-making for improved bladder cancer diagnosis and therapeutic guidance.
Keyword:
AI-assisted diagnosis
cystoscopy
tumor detection
deep learning
transformer
期刊
IF:
3.4
论文数:
1.4W
被引数:
3.1W
机构
引用论文
Photodynamic Diagnosis of Non-muscle-invasive Bladder Cancer with Hexaminolevulinate Cystoscopy: A Meta-analysis of Detection and Recurrence Based on Raw Data.png)
EUROPEAN UROLOGY
EUROPEAN UROLOGYIF25.2
PREAI
分享收藏Thermal comfort, perceived air quality, and cognitive performance when personally controlled air movement is used by tropically acclimatized persons当热带适应的人使用个人控制的空气运动时，热舒适性，感知的空气质量和认知表现Indoor Air
OAAI
Indoor AirIF0
OAAI分享收藏Hexaminolevulinate blue-light cystoscopy in non-muscle-invasive bladder cancer: review of the clinical evidence and consensus statement on appropriate use in the USANATURE REVIEWS UROLOGYOAAI
NATURE REVIEWS UROLOGYIF14.6
OAAI分享收藏分享收藏
查看更多内容