Martha Kyrillidou

Martha Kyrillidou
University of Illinois, Urbana-Champaign | UIUC · Graduate School of Library and Information Science

Doctor of Philosophy

About

97
Publications
9,989
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
1,173
Citations
Citations since 2017
1 Research Item
255 Citations
201720182019202020212022202301020304050
201720182019202020212022202301020304050
201720182019202020212022202301020304050
201720182019202020212022202301020304050
Introduction
Martha is the founder of QualityMetrics LLC and a Research Associate at the iSchool at the University of Illinois, Urbana-Champaign, bridging research and practice. She is the co-founder of the Library Assessment Conference launched in 2016 and the co-principal investigator for LibQUAL+. She worked at the Association of Research Libraries for 22+ years before establishing her own research company focusing on helping libraries achieve success. She taught at the U of Maryland iSchool and at Kent State University where she led the redesign of this course for the SLIS core curriculum team.
Additional affiliations
April 1994 - December 2016
Association of Research Libraries
Position
  • Managing Director

Publications

Publications (97)
Article
Full-text available
Academic library assessment has grown as a field over the last 20 years. The pressures of increased competition over scarce resources and rapid technological changes have put pressures on academic libraries as they have on their parent institutions. In the midst of all the pressures and transformations lies a strong desire to be user-focused and re...
Article
Purpose – The purpose of this paper is to describe a model of digital library (DL) work that surfaced through the ARL Profiles 2010 and resonates current work underway by the large-scale DL projects like DPLA, SHARE, Hathitrust, Academic Preservation Trust, and Digital Preservation Network. Design/methodology/approach – In total, 86 ARL members su...
Article
LibQUAL+® is a well-known and widely used tool to measure library service quality. This tool has been developed by the Association of Research Libraries (ARL) in partnership with Texas A&M University. The present study aims to present the implementation of a locally modified LibQUAL+® survey in Pakistan; its Urdu translation experience, and the rel...
Article
Full-text available
Purpose The purpose of this paper is to define a framework and categorization of the types of evidence required to prove the value and impact of libraries. It questions the limitations of current measurement for library value, and hence for contributing to academic and research library planning and advocacy. The paper describes and draws on some of...
Article
Purpose Entering into its 11th year, the Ontario Council of University Libraries' Scholars Portal ( www.scholarsportal.info/ ) is in its second year of systematic evaluation of its content and services. This paper aims to examine this iteration. Design/methodology/approach This paper focuses on the 2010‐2011 results and provides a brief descriptio...
Article
Full-text available
The purpose of the study was twofold: (a) identifying whether item sampling using matrix sampling methods improved the well-known survey protocol, LibQUAL+®, and produced a viable alternative, LibQUAL+ ® Lite; in particular, improvements regarding participation rates, completion time for the survey, and results comparisons are examined in the Lite...
Article
Full-text available
This article presents a literature review of methods for evaluating serials, or networked electronic resources, usage, and focuses on point-of-use intercept Web surveys. In the context of the MINES for Libraries protocol administered by the Association of Research Libraries (ARL) and derived from the indirect cost study methodologies developed by F...
Article
Purpose As libraries are developing a larger Web presence, issues regarding the utility, accessibility, and impact of the usage of their networked resources and services are gaining critical importance. The need to assess systematically the networked electronic services and resources is great as increasing amounts of financial resources are dedicat...
Article
Full-text available
The Association of Research Libraries(ARL) has engaged in the implementation of the Task Force on New Ways of Measuring Collections' recommendations and developed a new index, the Library Investment Index, originally called the 'Expenditures-Focused Index' which was published in the Chronicle of Higher Education for the first time in 2007. The Expe...
Article
Purpose In 2009, in Performance Measurement and Metrics , the authors reported results of LibQUAL+® experiments at four universities in which the use of the LibQUAL+® Lite protocol was investigated. The purpose of this article is to briefly report related results for the first use of LibQUAL+® in Hebrew. The authors also take the opportunity to pro...
Article
Full-text available
Purpose – Survey researchers sometimes develop large pools of items about which they seek participants' views. As a general proposition, library participants cannot reasonably be expected to respond to 100+ items on a given service quality assessment protocol. This paper seeks to describe the use of matrix sampling to reduce that burden on the part...
Article
Full-text available
ClimateQUAL™ is the latest assessment tool in the assessment toolkit development by ARL and accessible through the StatsQUAL® gateway to li-brary assessment tools. The tools available through StatsQUAL® are combining the power of both quan-titative and qualitative methods and are integrated into a platform that allows easy data collection, analy-si...
Article
Full-text available
Article
Full-text available
Purpose – The purpose of this study is to report on the findings of the two‐year Association of Research Libraries (ARL) sponsored project, “Making Library Assessment Work: Practical Approaches to Effective and Sustainable Assessment,”; it aims to examine the organizational factors that facilitate and impede effective data use and the implications...
Article
Purpose – The work described in this paper aims to reflect the natural evolution of longstanding dialogue between the Association of Research Libraries (ARL), Johns Hopkins University (JHU), and Bielefeld University. Design/ methodology/approach – This study looks at how each institution has combined library and assessment expertise and developed...
Article
Full-text available
Purpose This paper aims to explain how the integrity or trustworthiness of library service quality assessment data can be evaluated. Using the metaphor of a bathroom scale, the paper also aims to present the ideas underlying score reliability and score validity in an accessible manner. Design/methodology/approach The use of the software, SPSS, to...
Conference Paper
Full-text available
Οι βιβλιοθήκες εδώ και πολλά χρόνια προσφέρουν σε μεγάλο ποσοστό στους χρήστες τους τη δυνατότητα της πληροφόρησης τους με τη χρήση ηλεκτρονικών πηγών. Η πρόσβαση στις πηγές αυτές γίνεται πάντοτε μέσω του διαδικτύου, με διάφορους τρόπους, όπως πύλες (portals), συμπράξεις, ή συμφωνίες κοινοπραξιών. Ωστόσο, με την αύξηση της χρήσης των ηλεκτρονικών π...
Article
Full-text available
This paper reviews the evolution of measurement and evaluation in libraries from the perspectives of three important figures who have shaped the history of library assessment activities: James Gerould, F. Wilfrid Lancaster, and Duane Webster. Although Lancaster is about a decade older than Webster and almost half a century removed from Gerould, the...
Article
"ARL Statistics 2005-06" is the latest in a series of annual publications that describe collections, staffing, expenditures, and service activities for the 123 members of the Association of Research Libraries (ARL). Of these, 113 are university libraries and 10 are public, governmental, and nonprofit research libraries. Data reported by libraries a...
Article
Full-text available
This document presents data that describe collections, expenditures, personnel, and services in 65 medical libraries at Association of Research Libraries (ARL) member institutions throughout North America. In 2006-2007, the reporting health sciences libraries held a median of 244,188 volumes, spent a total of $244,188,020, and employed 2,395 FTE st...
Article
The present study was conducted to explore library users' desired service quality levels on the twenty-two core LibQUAL+ items. Specifically, we explored similarities and differences in users' desired library service quality levels across user groups (i.e., undergraduate students, graduate students, and faculty), across geographic locations (i.e.,...
Article
To explore how the library service expectations and perceptions of users might differ across health-related libraries as against major research libraries not operating in a medical context; to determine whether users of medical libraries demand better library service quality, because the inability of users to access needed literature promptly may l...
Article
Using LibQUAL+® data provided by 295,355 of the participants who completed the LibQUAL+® survey in 2003, 2004, and 2005, the present study was conducted to address three research questions. First, what differences, if any, have occurred across time in the use by (a) undergraduates, (b) graduate students/postgraduates, and (c) faculty of on-premises...
Article
This document presents data from 123 U.S. and Canadian research libraries that were members of the Association of Research Libraries (ARL) during the 2004-2005 fiscal year. Since 1987-1988, the number of preservation programs managed by a preservation administrator has grown 66 to as many as 80 in more recent years, with 74 in 2004-2005. Shifting t...
Article
Purpose This paper aims to report on the first phase of a two‐year project sponsored by the Association of Research Libraries, “Making Library Assessment Work: Practical Approaches for Developing and Sustaining Effective Assessment”. Design/methodology/approach This paper reports on the project, which is intended to provide libraries with the know...
Article
Full-text available
The LibQUAL+TM protocol solicits open-ended comments from users with regard to library service quality, gathers data on 22 core items, and, at the option of individual libraries, also garners ratings on five items drawn from a pool of more than 100 choices selected by libraries. In this article, the relationship of scores on these locally selected...
Article
Full-text available
LibQUAL+TM is a web-administered library service quality assessment protocol that has been used around the world in hundreds of different types of libraries. Data have been collected from almost 500,000 library users. The protocol has been used in several language variations. The purpose of the present study is to characterize the stability of LibQ...
Article
Purpose To examine how the library user emerges in the context of the LibQUAL+™ application in Sweden in 2004. Design/methodology/approach The paper examines the following aspects: how the information control dimension is depicted in the results of the Swedish participants; how the information control dimension compares between the Swedish impleme...
Article
The Association of Research Libraries is developing the DigiQUAL™ protocol to assess the service quality provided by digital libraries (DLs). In 2005, statements about DL service quality were put through a two-step validation process with DL developers and then with users in an online survey..
Article
The present study investigated the validity of LibQUAL+(TM) scores, and specifically how total and subscale LibQUAL+(TM) scores are associated with self-reported, library-related satisfaction and outcomes scores. Participants included 88,664 students and faculty who completed the American English (n(AE) = 69,494) or the British English (n(BE) = 19,...
Article
This paper focuses primarily on the collaborative partnerships that have shaped the ARL Statistics and Measurement Program, which currently serves the objective of “describing and measuring the performance of research libraries and their contribution to teaching, research, scholarship, and community service.” Over the last ten years, the ARL Statis...
Conference Paper
Full-text available
The distributed, project-oriented nature of digital libraries (DLs) has made them difficult to evaluate in aggregate. By modifying the methods and tools used to evaluate physical libraries' content and services, measures can be developed whose results can be used across a variety of DLs. The DigiQUAL protocol being developed by the Association of R...
Article
2005) Εισαγωγή 1 Ποια είναι η σηµασία της κοινωνικής προσφοράς των υπηρεσιών µιας βιβλιοθήκης; Πώς αξιολογούµε την ποιότητα του έργου που παράγουν οι βιβλιοθήκες; Πώς µπορούµε να βελτιώσουµε την ποιότητα παροχής των υπηρεσιών; Πώς µπορούµε να καταγράψουµε µε συστηµατικό τρόπο τις γνώµες, τις προσδοκίες και την άποψη που έχουν οι χρήστες µιας βιβλιο...
Article
The Association of Research Libraries' (ARL) E-Metrics Project is an ongoing effort to develop new measures that describe and measure networked electronic resources and also to underscore the need for measuring the value of such resources. This article presents results from an ongoing iterative qualitative study with the following goals: (a) to und...
Article
The relationship between library institutional characteristics such as volumes held, volumes added gross, current serials, total staff and expenditures, and the scores on the four LibQUAL+(™) service quality dimensions (Affect of Service, Access to Collections, Information Control and Library as Place) are analyzed across a group of 130+ libraries...
Article
This report presents statistics on how Association of Research Libraries (ARL) member libraries spend money on electronic resources. This report indicates that expenditures for electronic resources account for 25%, on average, of ARL institutions' library materials budgets. ARL libraries reported spending more than $228 million on electronic resour...
Article
Full-text available
At this workshop we wish to share our experiences gained from conducting the user-based assessment project known as LibQUAL+™ across libraries over the last four years. We believe that the development of LibQUAL+™ provides important lessons that are informing our development of a similar protocol for digital libraries, particularly from the perspec...
Article
Full-text available
The paper describes ways to examine how digital libraries are valued by their users, and explores ways of permitting the allocation of resources to areas of user-identified need. Pertinent models from marketing, economics, and library assessment and evaluation are reviewed, focussing on the application of the LibQUAL+TM and CAPM methodologies. Each...
Article
En 1994, en accord avec leur nouveau programme de statistiques et de mesures, les membres de l'ARL (Association of Research Libraries) ont adopte un nouvel objectif strategique consistant a decrire et mesurer les performances des bibliotheques de recherche ainsi que leurs contributions a l'enseignement, a la recherche, au savoir et au service pour...
Article
This paper discusses library models and user roles in relation to the transformative effects of technology. It explores how these models are changing our conceptualization of library assessment models from a linear to a more cyclical and dynamic perspective shaping relations among input, output, quality and outcome indicators.
Article
Full-text available
The present study was conducted to address five research questions bearing upon the psychometric validity of LibQUAL+TM scores using data provided by 20,416 participants. It was found that LibQUAL+TM subscale and total scores were highly correlated with satisfaction scores in two independent subsamples. As expected, respondents who reported never u...
Article
This paper discusses the emergence and forging of consensus in relation to the LibQUAL+ project as it developed from the winter of 1999 to summer of 2001.A rich history of assessment in the service sector using the SERVQUAL instrument over the last twenty years, a fertile ground in the library field where various institutions including Texas A&M ex...
Article
Aux Etats-Unis, avec le passage a l'âge de l'information et les transformations fondamentales du systeme d'enseignement superieur, le controle de la qualite et l'etablissement de mesures de performance sont devenus des preoccupations majeures au sein des etablissements d'enseignement superieur. Les bibliotheques de recherche academiques subissent u...
Article
Les bibliotheques de recherche consacrent une part de plus en plus importantes de leur budget aux ressources electroniques. Un tableau reprenant des donnees fournies par les statistiques de l'ARL (Association of Research Libraries) illustre ces tendances dans les depenses de 1992 a 1999.
Article
Les 20 et 21 octobre 2000 s'est tenu a Washington un symposium patronne par l'ARL (Assocation of Research Libraries) sur le theme de La nouvelle culture de l'evaluation dans les bibliotheques academiques : mesurer la qualite du service. Au cours du symposium ont ete abordes les themes suivants : la dimension internationale et la cooperation ; le mo...
Article
L'article presente succintement diverses initiatives visant a developper des mesures d'utilisation des ressources electroniques dans les bibliotheques : le projet de la Digital Library Federation, le projet EQUINOX de la Commission Europeenne, l'examen des statistiques d'usage fournies par les vendeurs au Royaume-Uni, la revision du guide de l'ICOL...
Article
L'introduction trace l'histoire de statistiques de l'Association des Bibliotheques de Recherche (ARL). La gamme actuelle de statistiques publiees est ensuite decrite. Ces dernieres annees recentes leur presentation sur le web s'est developpee de sorte que bon nombre d'entre elles sont maintenant disponibles pour l'utilisateur en mode interactif et...
Article
Full-text available
Πρόκειται για συγχαρητήρια επιστολή προς την Κα Μερσίνη Μορελέλη-Κακούρη. Conratulations letter to Mrs Mersini Moreleli-Cacouris.
Article
The workshop, “New Collections: New Marketplace Relationships,” was held on Monday, August 17, 1998 at the 64th IFLA General Conference. Five speakers, who represented different consortia from Australia, Europe, and the United States, described their experiences in managing the transformation in collection development activities caused by the purch...
Article
Full-text available
The ARL Statistics datafiles, with accompanying documentation, are available at
Article
Full-text available
The ultimate use of library data is to help library managers in their decision making activities so that the organization works more effectively and efficiently. Focus on how libraries use statistics at the cross-institutional level. There are a variety of organizations that collect data on libraries in general and academic libraries in particular....
Article
This annual publication describes the collections, staffing, expenditures, and public service activities for the 108 university and 11 nonuniversity members of the Association of Research Libraries (ARL) during the 1994-95 fiscal year. This particular edition offers instructions for locating interactive ARL statistics on the world wide web, a 35-it...
Article
Salary and related data are reported for 8,231 professional staff members in the 108 Association of Research Libraries (ARL) university member libraries, including law and medical libraries; for the 11 nonuniversity ARL members, data were reported for 4,016 professional staff members. Data, summarized in 42 tables, includes: distribution by salary...
Article
Full-text available
Traduit de l'anglais par Jimmy Légaré et Olivier Paradis (Direction des bibliothèques de l'UdeM). Cet article présente une analyse contextuelle des problèmes interculturels et linguistiques de traduction reliés à la version française du questionnaire LibQUAL+MC, tel qu’utilisé dans des bibliothèques canadiennes à l’automne 2003. On répond par l’aff...
Article
Περίληψη Oι βιβλιοθήκες εδώ και πολλά χρόνια προσφέρουν σε μεγάλο ποσοστό στους χρήστες τους τη δυνατότητα της πληροφόρησής τους με τη χρήση ηλεκτρονικών πηγών. H πρόσβαση στις πηγές αυτές γίνεται πάντοτε μέσω του διαδικτύου, με διάφορους τρόπους, όπως πύλες (portals), συμπράξεις, ή συμφωνίες κοινοπραξιών. Ωστόσο, με την αύξηση της χρήσης των ηλεκτ...
Article
Full-text available
This paper presents a contextual analysis of cross-cultural and linguistic translation issues related to the French version of the LibQUAL+™ instrument as implemented in Canadian libraries in Canada during spring 2003. The research question of whether the French translation process has produced scores that are equivalent to the English versions of...
Article
Full-text available
Program Officer for Statistics and Measurement The ARL Annual Salary Survey provides useful data for tracking trends in ARL library professionals' salaries over the last 20 years. The Salary Survey is the most comprehensive and thorough guide to current salaries in large U.S. and Canadian academic and research libraries, and has proven to be a valu...

Network

Cited By

Projects

Projects (4)
Project
The premier international tools for measuring library service quality! Research on this well established protocol offered by the Association of Research Libraries is continuing in partnership with QualityMetrics LLC.
Archived project