Conference PaperPDF Available

Voice over IP (VoIP) speech quality measurement with open-source software components

Authors:

Abstract and Figures

This paper proposes an alternative to expensive means for VoIP speech quality measurement. While current applications and measurement devices on the market are very expensive, the authors propose a solution based on open-source components that allows the determination of the Mean Opinion Score (MOS) value according the Perceptual Evaluation of Speech Quality (PESQ) test methodology.
Content may be subject to copyright.
A preview of the PDF is not available
... They also discuss the limitations and advantages of both approaches, but the correlation of results from different models were not given. Similar to the work that was presented in [7] that proposed speech quality measurement using PESQ based on open source VoIP software in a lab environment, we conducted the entire set of experiments based on enterprise VoIP product in real network environment and also discussed about misleading points when comparing PESQ results with E-Model results. PESQ and E-Model, as the most commonly used QoE measurement in VoIP, are also presented in detail along with other popular measurements in [10]. ...
Conference Paper
Full-text available
Voice over IP (VoIP) now has tremendous influence on the telecommunication market with its flexibility and price advantage. Users of VoIP expect call quality to be as good as, if not better than the traditional Public Switched Telephone Network (PSTN). However in VoIP, factors that are related to the IP transport network such as packet loss, delay, bandwidth, jitter, and voice encoding (codec) all affect call quality. Call quality assessment in VoIP systems is mainly conducted with off-line tests using the Perceptual Evaluation of Speech Quality (PESQ) [1] methodology. Another method that can be utilised is an on-line approach using the E-Model, which can be used in real time. However, these two methods have limits and inaccuracy, and often do not give the same results. Call quality assessment is often used to adjust system and codec parameters. Therefore, given inaccurate results, the system would decrease the adjustment efficiency or even inadvertently decrease call quality. The primary contribution of this paper is a comparison between the accuracy of PESQ and the E-Model investigated by conducting an extensive set of experiments in a real enterprise network using a widely deployed Voice over IP (VoIP) product. Experiments were conducted under varying controlled network conditions. The results show that under various conditions, loss rates, codecs and across a range of languages that there can be significant differences between the call quality measurement obtained when using the E-model versus a PESQ analysis.
... The focal point of this work is monitoring widespread networks on defined points and their impact in the quality of delivered voice communication. For monitoring the quality impact of voice communication processors (e.g., Public Branch Exchange (PBX), announcement services, etc.) as such, the presented measurement setup may be extended by the work the authors presented in [2]. Existing commercial voice quality measurement solutions offer mainly multiple analyzing functions for several purposes and are not focused solely on VoIP QoS/QoE monitoring (e.g., [3]). ...
Conference Paper
Full-text available
This paper describes an implementation for monitoring the QoS and expecting the QoE of a voice communication in a Real-time Transport Protocol (RTP) based telecommunication environment. The resulting QoS parameters are evaluated; the QoE is determined with the E-Model and processed for graphical presentation. With the use of some open-source programming libraries, the presented prototype can be a helpful alternative for expensive measurement devices and is ready to be deployed in a widespread telecom environment at low cost.
Source test tool / traffic generator for the SIP protocol
  • Sipp
SIPp, a free Open Source test tool / traffic generator for the SIP protocol, http://sipp.sourceforge.net
Open Source telephony switching and private branch exchange (PBX) daemon
  • Asterisk
Asterisk, Open Source telephony switching and private branch exchange (PBX) daemon, http://www.asterisk.org
Open SIP Server), a mature Open Source implementation of a SIP server
  • Opensips
OpenSIPS (Open SIP Server), a mature Open Source implementation of a SIP server, http://www.opensips.org