Article

Addressing levels issues in IS qualitative research

Authors:
To read the full-text of this research, you can request a copy directly from the authors.

Abstract

In this study, we investigate levels of analysis employed in IS qualitative research. Five years of IS literature reviewed yields patterns across research activities supporting the multilevel nature of IS research settings. While level issues have been discussed in the context of quantitative research, this study specifically addresses the previously unexplored area of qualitative IS research. We put forth that qualitative research is also susceptible to issues regarding level specification. We illustrate the multilevel nature of IS qualitative research. We specifically highlight the analysis level conformity of research activities with the inferences of the research. We urge researchers to be sensitive to level-related issues in order to produce more rigorous IS qualitative research.

No full-text available

Request Full-text Paper PDF

To read the full-text of this research,
you can request a copy directly from the authors.

ResearchGate has not been able to resolve any citations for this publication.
Article
Full-text available
In this paper we examine the use of electronic patient records (EPR) by clinical specialists in their development of multidisciplinary care for diagnosis and treatment of breast cancer. We develop a practice theory lens to investigate EPR use across multidisciplinary team practice. Our findings suggest that there are oppositional tendencies towards diversity in EPR use and unity which emerges across multidisciplinary work, and this influences the outcomes of EPR use. The value of this perspective is illustrated through the analysis of a yearlong, longitudinal case study of a multidisciplinary team of surgeons, oncologists, pathologists, radiologists, and nurse specialists adopting a new EPR. Each group adapted their use of the EPR to their diverse specialist practices, but they nonetheless orientated their use of the EPR to each others' practices sufficiently to support unity in multidisciplinary teamwork. Multidisciplinary practice elements were also reconfigured in an episode of explicit negotiations, resulting in significant changes in EPR use within team meetings. Our study contributes to the growing literature that questions the feasibility and necessity of achieving high levels of standardized, uniform health information technology use in healthcare.
Article
Full-text available
Qualitative research involves the use of qualitative data, such as interviews, documents, and participant observation, to understand and explain social phenomena As the focus of information systems research shifts from technological to managerial and organizational issues, qualitative research methods become increasingly useful. This example of ''living scholarship'' within MISQ Discovery's worldwide web archive prov,des an overview of qualitative research for the newcomer and a set of resources for those more experienced. The work discusses philosophical perspectives that can inform qualitative research, qualitative research methods, techniques, and modes of analysis. Links to citation lists, Internet resources, software tools, and calls for papers are also included.
Article
Full-text available
Two important gaps exist in the information systems (IS) alignment research. First, there is scant research on the potential of organizational culture, and specifically subcultures to influence the strategic alignment of IS and organizations. Second, there is a dearth of literature that considers the relationship between alignment and implementation success. In this paper, we address both of these gaps by considering the influence of organizational subcultures on the alignment of a specific IS—a knowledge management system (KMS)—with organizational strategy. Our analysis demonstrates the important roles played by three different subcultures— enhancing, countercultural, and chameleon—in the alignment of the KMS. The analysis also underscores the complementary nature of the alignment and implementation literatures and suggests that they should be used in concert to explain the success of an IS. Drawing on our analysis, we build a subculture model, which depicts the intersection of alignment and implementation. From a managerial perspective, the subculture model highlights three different approaches to managing alignment and implementation. From a theoretical perspective, our paper highlights the need for IS alignment models to be modified, so that subunit-level analyses are incorporated. It also illustrates that organizations confront challenges of alignment and implementation simultaneously rather than sequentially.
Article
Full-text available
Despite growing recognition of the need for qualitative methods in health services research, there have been few attempts to define quality standards for assessing the results. This article acknowledges the desirability of a plurality of standards. However, it is argued that three interrelated criteria can be identified as the foundation of good qualitative health research: interpretation of subjective meaning, description of social context, and attention to lay knowledge. These criteria can be examined in relation to different dimensions of any research report, including theoretical basis, sampling strategy, scope of data collection, description of data collected, and concern with generalizability or typicality. But if the concern is with the appropriateness of care and with understanding the factors that shape lay and clinical behavior, then these criteria must form the basis of a hierarchy of qualitative research evidence.
Article
Despite the significant potential for performance gains from health IT (HIT), there has been limited study of the mechanisms underlying successful HIT implementations. We conducted an extensive longitudinal field study to gain an understanding of the interplay between technology and patterns of clinical work embodied in routines. We use the analytical device of narrative networks to identify where and how HIT influences patterns of work. We further draw upon adaptive structuration theory to conceptualize HIT as an intervention that alters the flow of events in a narrative network. Our findings suggest that the key to successful implementation is to manage the co-evolution process between routines and HIT and to actively orchestrate a virtuous cycle through agentic action. We propose a dynamic process model of adaptive routinization of HIT that delineates the major channels through which HIT and routines interact, identifies the different stages in the dynamic co-evolution process, and isolates the pivotal role of two forms of agency in enabling the virtuous cycle of co-evolution. This is one of the first studies to offer a processual, microlevel analysis of HIT implementation in a clinical setting.
Article
This study investigates the relationships of attitudes and behavior to characteristics of departments, positions, and individuals for 271 employees in nineteen departments of two organizations. This study also considers whether job characteristics are potential mediators in these relationships. Once a month for four months, the 271 employees completed identical forms of a questionnaire in which they describe their jobs, their positions within their organizations, their values, and their responses to work. Company records yielded monthly absenteeism data. Measures of department structure and technology were derived from company records and interviews. Results indicate that departmental characteristics, positional characteristics, and individual characteristics predict attitudes and behavior, with individual characteristics being the best predictor. By themselves, job characteristics are related most highly to departmental characteristics. Job characteristics associated with organizational position account entirely for the relation of positional characteristics (such as shift) to attitudes and behavior. Job characteristics also account for a substantial part of the relationship of departmental characteristics to attitudes and behavior, but do not explain the relation of individual characteristics to these responses. Finally, this study discusses the need to assess individual perceptions as well as objective characteristics of contexts.
Article
Narrative inquiry refers to a subset of qualitative research designs in which stories are used to describe human action. The term narrative has been employed by qualitative researchers with a variety of meanings. In the context of narrative inquiry, narrative refers to a discourse form in which events and happenings are configured into a temporal unity by means of a plot. Bruner (1985) designates two types of cognition: paradigmatic, which operates by recognizing elements as members of a category; and narrative, which operates by combining elements into an emplotted story. Narrative inquiries divide into two distinct groups based on Bruner's types of cognition. Paradigmatic‐type narrative inquiry gathers stories for its data and uses paradigmatic analytic procedures to produce taxonomies and categories out of the common elements across the database. Narrative‐type narrative inquiry gathers events and happenings as its data and uses narrative analytic procedures to produce explanatory stories.
Article
We argue in this chapter that quantitative techniques alone cannot enable appropriate verification of the levels in which a construct should be defined and validated. We propose a process model that takes advantage of qualitative and quantitative methods when specifying and measuring the level(s) of analysis in construct development. The model implies that operationalizing a construct and its measurement should involve both qualitative and quantitative methods. Level specification begins with induction of constructs and continues with qualitative or quantitative operationalizations that are verified through the convergence of using triangulation and aggregation tests. Construct development continues until the level of analysis is accurately specified. We provide a theoretical example of construct development from the leadership literature and an empirical example to represent the verification process.
Article
This article presents a comprehensive and qualitative review of how levels of analysis issues have been addressed in the diversity and demography literature. More than 180 conceptual and empirical publications (i.e. book chapters and journal articles) in this field are reviewed and coded regarding the specific incorporation of levels of analysis in theory and hypothesis formulation, representation of levels of analysis in measurement of constructs and variables, appropriateness of data-analytic techniques given the explicit or implied levels of analysis, and alignment between levels of analysis in theory and data in regard to drawing inferences and conclusions. Although the body of diversity and demography literature continues to grow, levels of analysis issues are rarely considered. Only a few reviewed studies address levels of analysis issues in theory development, and no reviewed studies employ appropriate multi-level data analytic techniques. Implications for future research are discussed, and recommendations for incorporating levels of analysis into diversity and demography research are provided.
Article
This paper examines the use of action research in information systems (IS) studies reported in literature over the last twenty-five years. Thirty such field studies and discussion papers on information technology, system design/use or socio-technical systems were reviewed and compared with those from social science. Evolving patterns are noted among these IS studies in terms of their underlying assumptions, study designs and presentation styles. A contemporary IS action research framework is proposed as a conceptual foundation and practical guide for researchers and practitioners interested in action research for IS studies. Its implications in IS research and practice are discussed.
Article
Building on prior work on levels of analysis, we present an approach for understanding changes in multiple levels of analysis or entities over time. The conceptual framework describes how entities may remain stable over time, shift toward independence at a lower level of analysis, or change to homogeneous or heterogeneous interdependence at a higher level of analysis. We discuss examples and implications of the approach for theory building.
Article
Despite past entreaties to organizational theorists and researchers to address levels issues more carefully, levels issues continue to arouse confusion and controversy within the organizational literature. We highlight three alternative assumptions that underlie the specification of levels of theory throughout organizational behavior: (a) homogeneity within higher level units, (b) independence from higher level units, and (c) heterogeneity within higher level units. These assumptions influence the nature of theoretical constructs and propositions and should, ideally, also influence data collection, analysis, and interpretation. Greater attention to levels issues will strengthen organizational theory development and research.
Article
This article concerns theories about why and how information technology affects organizational life. Good theory guides research, which, when applied, increases the likelihood that information technology will be employed with desirable consequences for users, organizations, and other interested parties. But what is a good theory? Theories are often evaluated in terms of their content—the specific concepts used and the human values served. This article examines theories in terms of their structures—theorists' assumptions about the nature and direction of causal influence. Three dimensions of causal structure are considered—causal agency, logical structure, and level of analysis. Causal agency refers to beliefs about the nature of causality: whether external forces cause change, whether people act purposefully to accomplish intended objectives, or whether changes emerge unpredictably from the interaction of people and events. Logical structure refers to the temporal aspect of theory—static versus dynamic—and to the logical relationships between the “causes” and the outcomes. Level of analysis refers to the entities about which the theory poses concepts and relationships—individuals, groups, organizations, and society. While there are many possible structures for good theory about the role of information technology in organizational change, only a few of these structures can be seen in current theorizing. Increased awareness of the options, open discussion of their advantages and disadvantages, and explicit characterization of future theoretical statements in terms of the dimensions and categories discussed here should, we believe, promote the development of better theory.
Article
The objective of this paper is to contribute to a deeper understanding of system usage in organizations by examining its multilevel nature. Past research on system usage has suffered from a levels bias, with researchers studying system usage at single levels of analysis only (e.g., the individual, group, or organizational level). Although single-level research can be useful, we suggest that studying organizations one level at a time will ultimately lead to an unnatural, incomplete, and very disjointed view of how information systems are used in practice. To redress this situation, we draw on recent advances in multilevel theory to present system usage as a multilevel construct and provide an illustration for what it takes for researchers to study it as such. The multilevel perspective advanced in this article offers rich opportunities for theoretical and empirical insights and suggests a new foundation for in-depth research on the nature of system usage, its emergence and change, and its antecedents and consequences.
Article
No longer the exclusive domain of technology experts, information security is now a management issue. Through a grounded approach using interviews, observations, and secondary data, we advance a model of the information security compromise process from the perspective of the attacked organization. We distinguish between deliberate and opportunistic paths of compromise through the Internet, labeled choice and chance , and include the role of countermeasures, the Internet presence of the firm, and the attractiveness of the firm for information security compromise. Further, using one year of alert data from intrusion detection devices, we find empirical support for the key contributions of the model. We discuss the implications of the model for the emerging research stream on information security in the information systems literature.
Article
Using an interpretive grounded theory research approach, we investigate the utilization of organization-wide information systems in the competitive actions and responses undertaken by top managers to sustain their firms' leading competitive position. Our central contribution is a model that explicates the role of information systems in the process by which competitive actions or responses are conceived, enacted, and executed, and resulting impacts on firm performance—issues that have been largely missing from contemporary research in both the information systems and competitive dynamics domains. This study has important implications for both research and practice. Specifically, researchers should consider organizational context; the intentions and actions of key players; and the process of conceiving, enacting, and executing competitive actions or responses carried out by the organization to account for the impact of information systems on firm performance. Findings suggest that when managers envision information systems as a resource that provides opportunities for competitive actions rather than viewing information systems in a service role, competitive advantages will evolve. Furthermore, practitioners will be better able to leverage information systems investments if they recognize the embedded role of information systems within the competitive actions or responses a firm undertakes to maintain or improve relative performance.
Book
Most writing on sociological method has been concerned with how accurate facts can be obtained and how theory can thereby be more rigorously tested. In The Discovery of Grounded Theory, Barney Glaser and Anselm Strauss address the equally Important enterprise of how the discovery of theory from data--systematically obtained and analyzed in social research--can be furthered. The discovery of theory from data--grounded theory--is a major task confronting sociology, for such a theory fits empirical situations, and is understandable to sociologists and laymen alike. Most important, it provides relevant predictions, explanations, interpretations, and applications. In Part I of the book, "Generation Theory by Comparative Analysis," the authors present a strategy whereby sociologists can facilitate the discovery of grounded theory, both substantive and formal. This strategy involves the systematic choice and study of several comparison groups. In Part II, The Flexible Use of Data," the generation of theory from qualitative, especially documentary, and quantitative data Is considered. In Part III, "Implications of Grounded Theory," Glaser and Strauss examine the credibility of grounded theory. The Discovery of Grounded Theory is directed toward improving social scientists' capacity for generating theory that will be relevant to their research. While aimed primarily at sociologists, it will be useful to anyone Interested In studying social phenomena--political, educational, economic, industrial-- especially If their studies are based on qualitative data.
Article
http://deepblue.lib.umich.edu/bitstream/2027.42/55435/1/Diez Roux AV, Bringing context back into epidemiology, 1998.pdf
Article
This article presents a framework for thinking about the fundamental activities of inference--data analysis and interpretation--by researchers using qualitative data. I contrast these two activities. For analysis I describe seven operations: categorization, abstraction, comparison, dimensionalization, integration, iteration, and refutation. For interpretation I suggest metaphor and other literary devices as models for understanding the meanings of others, identifying patterns in these meanings, and representing how systems of meanings reproduce culture. The purpose of these descriptions is to suggest a vocabulary for and stimulate discussion about how researchers using qualitative analytical techniques arrive at conclusions and make sense of data. Copyright 1994 by the University of Chicago.
Article
This paper presents a general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies. The procedure essentially involves the construction of functions of the observed proportions which are directed at the extent to which the observers agree among themselves and the construction of test statistics for hypotheses involving these functions. Tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interobserver agreement are developed as generalized kappa-type statistics. These procedures are illustrated with a clinical diagnosis example from the epidemiological literature.
Article
This paper outlines a role-based approach for conceptualizing and investigating the contention in some previous research that technologies change organizational and occupational structures by transforming patterns of action and interaction. Building on Nadel's theory of social structure, the paper argues that the microsocial dynamics occasioned by new technologies reverberate up levels of analysis in an orderly manner. Specifically, a technology's material attributes are said to have an immediate impact on the nonrelational elements of one or more work roles. These changes, in turn, influence the role's relational elements, which eventually affect the structure of an organization's social networks. Consequently, roles and social networks are held to mediate a technology's structural effects. The theory is illustrated by ethnographic and sociometric data drawn from a comparative field study of the use of traditional and computerized imaging devices in two radiology departments.
Article
New medical imaging devices, such as the CT scanner, have begun to challenge traditional role relations among radiologists and radiological technologists. Under some conditions, these technologies may actually alter the organizational and occupational structure of radiological work. However, current theories of technology and organizational form are insensitive to the potential number of structural variations implicit in role-based change. This paper expands recent sociological thought on the link between institution and action to outline a theory of how technology might occasion different organizational structures by altering institutionalized roles and patterns of interaction. In so doing, technology is treated as a social rather than a physical object, and structure is conceptualized as a process rather than an entity. The implications of the theory are illustrated by showing how identical CT scanners occasioned similar structuring processes in two radiology departments and yet led to divergent forms of organization. The data suggest that to understand how technologies alter organizational structures researchers may need to integrate the study of social action and the study of social form.
Article
There has been a proliferation of competing explanations regarding the inconsistent results reported by the e-collaboration literature since its inception. This study advances another possible explanation by investigating the range of multilevel issues that can be encountered in research on the use of synchronous or asynchronous group support systems. We introduce concepts of levels of analysis from the management literature and then examine all empirical studies of e-collaboration from seven information systems journals for the period 1999-2003. We identified a total of 54 studies of e-collaboration in these journals, and after excluding 18 nonconforming studies - those that were primarily conceptual, qualitative, or exploratory only-we analyzed the levels of analysis issues in the remaining 36 empirical studies. Based on our analysis and classification of these studies into six different clusters according to their levels of analysis, we found that a majority of these studies contain one or more problems of levels incongruence that cast doubts on the validity of their results. It is indeed possible that these methodological problems are in part responsible for the inconsistent results reported in this literature, especially since researchers' frequent decisions to analyze data at the individual level - even when the theory was formulated at the group level and when the research setting featured individuals working in groups -may very well have artificially inflated the authors' chances of finding statistically significant results. Based on our discussion of levels of analysis concepts, we hope to provide guidance to empirical researchers who study e-ollaboration.
Developing a research sequence: Notes from " Learning to Work Paper presented at the University of Georgia's Faculty Research Symposium
  • M D Lecompte
LeCompte, M. D. 1986. " Developing a research sequence: Notes from " Learning to Work. " " Paper presented at the University of Georgia's Faculty Research Symposium, Athens.
Supporting a Network of Practice with an Information Infrastructure
  • Trans-Situated Learning
Trans-Situated Learning: Supporting a Network of Practice with an Information Infrastructure
Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences Interpretive case studies in IS research: nature and method
  • C B Teddlie
  • A G Tashakkori
Teddlie, C. B. and Tashakkori, A. (eds.) 2009. Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences (4th ed.). Sage Publications Walsham, G. 1995. " Interpretive case studies in IS research: nature and method, " European Journal of Information Systems, (4:2), pp. 74-81.
Social Science Research: Principles, Methods, and Practices " , USF Tampa Bay Open Access Textbooks Collection. Book 3. http://scholarcommons.usf
  • A Bhattacherjee
Bhattacherjee, A. 2012. " Social Science Research: Principles, Methods, and Practices ", USF Tampa Bay Open Access Textbooks Collection. Book 3. http://scholarcommons.usf.edu/oa_textbooks/3 (current June 1, 2013)