arrow
返回

Code Localization in Programming Screencasts

delete2020-01-20
delete13
PRE
AI
M
Mohammad D. Alahmadi *
A
Abdulkarim Khormi
B
Biswas Parajuli
J
Jonathan Hassel
S
Sonia Haiduc
P
Piyush Kumar
DOI:10.1007/s10664-019-09759-wdelete
delete原文链接
delete原文求助
delete分享
delete收藏
摘要

摘要

En 中文
Programming screencasts are growing in popularity and are often used by developers as a learning source. The source code shown in these screencasts is often not available for download or copy-pasting. Without having the code readily available, developers have to frequently pause a video to transcribe the code. This is time-consuming and reduces the effectiveness of learning from videos. Recent approaches have applied Optical Character Recognition (OCR) techniques to automatically extract source code from programming screencasts. One of their major limitations, however, is the extraction of noise such as the text information in the menu, package hierarchy, etc. due to the imprecise approximation of the code location on the screen. This leads to incorrect, unusable code. We aim to address this limitation and propose an approach to significantly improve the accuracy of code localization in programming screencasts, leading to a more precise code extraction. Our approach uses a Convolutional Neural Network to automatically predict the exact location of code in an image. We evaluated our approach on a set of frames extracted from 450 screencasts covering Java, C#, and Python programming topics. The results show that our approach is able to detect the area containing the code with 94% accuracy and that our approach significantly outperforms previous work. We also show that applying OCR on the code area identified by our approach leads to a 97% match with the ground truth on average, compared to only 31% when OCR is applied to the entire frame.
Keyword:
Programming video tutorials
Software documentation
Source code
Deep learning
Video mining
AI总结

AI总结

对已上传原文的论文进行重点信息的提取,主要内容包括:简要概述、研究摘要、背景介绍、关键亮点、图文解析、展望与总结。

期刊

Empirical Software Engineering 封面图
Empirical Software Engineering
IF:
3.6
论文数:
2.0K
被引数:
5.3K

机构

State University System of Florida 封面图
State University System of Florida
学者数:
12.7W
论文数: 10.9W
被引数: 130
引用论文

引用论文

Community-Based Coral Reef Rehabilitation in a Changing Climate: Lessons Learned from Hurricanes, Extreme Rainfall, and Changing Land Use Impacts
err2014-01-01
err0
errOAAI
errEdwin A. Hernández-Delgado; Alex E. Mercado-Molina; Pedro J. Alejandro-Camis; Frances Candelas-Sánchez; Jaime S. Fonseca-Miranda; Carmen M. González-Ramos; Roger Guzmán-Rodríguez; Pascal Mège; Alfredo A. Montañez-Acuña; Iván Olivo Maldonado; Abimarie Otaño-Cruz; Samuel E. Suleimán-Ramos
err分享
err收藏
err分享
err收藏
Selective Search for Object Recognition
err2013-04-02
err3.9K
PREAI
errUijlings, J. R. R.; van de Sande, K. E. A.; Gevers, T.; Smeulders, A. W. M.
err分享
err收藏
Documenting and sharing software knowledge using screencasts
err2017-03-30
err27
PREAI
errMacLeod, Laura; Bergen, Andreas; Storey, Margaret-Anne
err分享
err收藏
err分享
err收藏
On optimal delivery lags
err1973-04-01
err0
PREAI
errLouis J Maccini
err分享
err收藏
学者 查看更多内容