An example of annotator disagreement: a tiny popup (highlighted with the red rectangle)

An example of annotator disagreement: a tiny popup (highlighted with the red rectangle)

Source publication
Preprint
Full-text available
In this paper, we propose an approach named psc2code to denoise the process of extracting source code from programming screencasts. First, psc2code leverages the Convolutional Neural Network based image classification to remove non-code and noisy-code frames. Then, psc2code performs edge detection and clustering-based image segmentation to detect s...

Context in source publication

Context 1
... the two annotators. The Kappa value is 0.98, which indicates almost perfect agreement between the two annotators. There are a small number of frames that the two annotators disagree with each other. For example, one annotator sometimes does not consider the frames with a tiny popup window such as the parameter hint when using functions (see Fig. 5) as noisy-code frames. For such frames, the two annotators discuss to determine the final label. Table 1 presents the results of the labeled frames. There are 1,864 invalid frames and 3,324 valid code frames, ...

Similar publications

Article
Full-text available
Deep Learning-based methods have emerged to be one of the most effective and practical solutions in a wide range of medical problems, including the diagnosis of cardiac arrhythmias. A critical step to a precocious diagnosis in many heart dysfunctions diseases starts with the accurate detection and classification of cardiac arrhythmias, which can be...