The study reported in this paper challenges current models of measuring second language fluency by comparing monologic versus dialogic task performance, and providing a novel insight into the measurement of the interactive aspects of dialogic performance. The data that constitute 35 monologic and dialogic task performances from second language learners were coded using a battery of established measures known to tap different aspects of fluency, and subjected to statistical analysis to test for overlaps or differences. Interactive aspects of fluency in dialogue, e. g. interruptions, overlap and unclaimed between turn pauses were also investigated to compare with common measures of monologic speech. While the results confirm previous research findings suggesting that performance is in general statistically more fluent in a dialogue in terms of speed, length of pause and repair measures, they indicate that performances in the two modes are not different in terms of number and location of pauses. The analysis of the dialogues indicates that the decisions researchers make about measuring the interactive aspects of fluency would have an impact on the outcome of measurements of fluency. These findings highlight the need for developing a more systematic and reliable approach to measuring second language (L2) fluency.