No full-text available
To read the full-text of this research,
you can request a copy directly from the author.
Emergence of a new method: The Grounded Delphi method
Abstract
This paper reports on the Grounded Delphi method (GDM), a relatively new methodological extension of the Delphi method, achieved by incorporating aspects of Grounded Theory, as used in a recent doctoral dissertation. The research explored the skills, knowledge, qualities and professional education needs of information professionals in galleries, libraries, archives and museums (GLAM) in Australia, with a view to determining relevant educational requirements to enable information professionals to operate across these blurred cultural heritage boundaries. Implications of using GDM for LIS research, and for research methods in general, is that it improves the rigour of theory building in Delphi studies, while the consensus, or force ranking, aspect of Delphi assists in improving the relevant level of importance of categories derived from Grounded Theory.
... It seeks to compile a list of skills that third-year students should learn and practice during their clinical postings using the consensus-building approach of the Delphi method (20)(21)(22). The Delphi method, a well-established research technique (23)(24)(25)(26)(27)(28), enables the systematic generation of expert consensus through iterative rounds of feedback and evaluation. Importantly, this study utilizes a modified Delphi technique by incorporating a pre-recommended item list (26,27). ...
... The study invited clinical supervisors and senior faculty members from departments such as medicine, surgery, emergency medicine, obstetrics and gynaecology, and dermatology. The panel consisted of 30 experts, aligning with the recommended panel size in the literature, which suggests a range between 10 and 50 experts (24,28). The inclusion criterion was a minimum of ten years of experience in teaching undergraduate medical students at the researcher's institute. ...
... The research findings align with the recommended skill lists of the UK General Medical Council and the US and Canadian clerkship Directors of Internal Medicine (CDIM) (7,28). There is consistency in the inclusion of four procedural skills and one interpretative skill in all three recommendations. ...
Introduction
While medical students are expected to learn procedural skills during their training, there is no consensus on their level of learning. Further, the most essential procedural skills across medical curricula which need to be taught during their III-year clinical posting are often not considered. The purpose of this study was to identify the core procedural skills needed to be taught during the III-year undergraduate medical students clinical posting.
Methods
A three-round, online Modified Delphi method was used to identify consensus on selecting the most essential procedural skills prescribed in National Medical Commission (NMC) curriculum 2019. In Round 1, a list of 54 procedural skills from the National Medical Commission's (NMC) Graduate Medical Education Regulations (GMER) 2019 curriculum was distributed to 22 experts in pre-clinical medical education and multidisciplinary clinicians.They rated the skills in terms of importance. In Round 2, the skills that received consensus in Round 1 were presented, resulting in 13 skills for evaluation. Round 3 further narrowed down the skills to a final consensus of 6. An interclass correlation coefficient of 0.767 among experts indicates a substantial level of reliability.
Results
Consensus was achieved for six procedural skills, each demonstrating over 80% agreement among the experts. These skills include basic life support, intravenous cannulation, urinary catheterization for both male and female patients, nasogastric tube insertion, oxygen administration, and basic suturing. Notably, all these skills received the highest level of agreement, surpassing 90% consensus.
Conclusions
The results of the modified Delphi study offer crucial insights into the procedural skills that should be included in the curriculum for third-year undergraduate medical students during their clinical rotations in a tertiary care teaching hospital. Faculty members at these institutions differ in their opinions regarding the importance of teaching specific procedural skills, influenced by their teaching background and the student cohorts they instruct. From a comprehensive list, six skills have been pinpointed as the most vital through the modified Delphi technique. Moreover, the Delphi technique is acknowledged as a valuable method for achieving a consensus on prioritizing the training of certifiable skills.
... The current study adopted the Grounded Delphi Method (GDM; Howard, 2018), which is a relatively new methodology incorporating aspects of grounded theory into Delphi study processes (Päivärinta et al., 2011). The combination of Delphi method, useful in areas with little established literature (Howard, 2018), and grounded theory, useful for theory building (Päivärinta et al., 2011), was well-suited to address the aims of the current study. ...
... The current study adopted the Grounded Delphi Method (GDM; Howard, 2018), which is a relatively new methodology incorporating aspects of grounded theory into Delphi study processes (Päivärinta et al., 2011). The combination of Delphi method, useful in areas with little established literature (Howard, 2018), and grounded theory, useful for theory building (Päivärinta et al., 2011), was well-suited to address the aims of the current study. ...
Although commonly described on social media by autistic people, there is little recognition of autistic burnout in the academic literature. Anecdotally, autistic burnout is described as a debilitating condition that severely impacts functioning, is linked to suicidal ideation and is driven by the stress of masking and living in an unaccommodating neurotypical world. We sought to define autistic burnout using the Grounded Delphi method. Autistic adults, experts by the lived experience of autistic burnout (n = 23), co-produced and agreed to a definition intended for clinicians and the autistic and autism communities. A thick description and conceptual framework were developed from the open-ended round 1 survey, with a high majority of agreement reached in the round 3 survey. Autistic burnout was defined as a highly debilitating condition characterised by exhaustion, withdrawal, executive function problems and generally reduced functioning, with increased manifestation of autistic traits – and distinct from depression and non-autistic burnout. Further work is needed to differentiate autistic burnout from other conditions and to build clinician understanding of the accompanying complexity to be considered in treatment planning.
Lay abstract
Autistic burnout has been commonly described in social media by autistic people. There is little mention of autistic burnout in the academic literature. Only one recent study has used interviews and reviews of social media descriptions to try to understand autistic burnout. Anecdotally, autistic burnout is a very debilitating condition that reduced people’s daily living skills and can lead to suicide attempts. It is suggested that autistic burnout is caused by the stress of masking and living in an unaccommodating neurotypical world. We wanted to create a definition of autistic burnout that could be used by clinicians and the autism community. We used the Grounded Delphi method, which allowed autistic voice to lead the study. Autistic adults who had experienced autistic burnout were considered as experts on the topic, in the co-production of this definition. The definition describes autistic burnout as a condition involving exhaustion, withdrawal, problems with thinking, reduced daily living skills and increases in the manifestation of autistic traits. It is important for future research that there is a specific description of the condition. In practice, it is important for clinicians to be aware that autistic burnout is different from depression. Psychological treatments for depression potentially could make autistic burnout worse. Further awareness of autistic burnout is needed, as well as further research to prove this condition is separate from depression, chronic fatigue and non-autistic burnout.
... It enhances content validity by ensuring the questionnaire comprehensively covers key aspects of the given phenomenon 15,16 and improves construct validity by ensuring that the questionnaire accurately measures the theoretical construct it intends to assess. 17,18 Thus, we would expect to see that items on a questionnaire that measures loneliness among children and youth can accurately identify the specific dimensions and manifestations of loneliness that are pertinent to them. Furthermore, they should include context-specific factors that influence loneliness for people at those ages (i.e., peers, parents, political and social contexts), and developmental understanding of those factors. ...
The overall goal of this paper is to enhance the understanding and measurement of loneliness by identifying key experiential characteristics of loneliness in children and adolescents, and determine whether there is a need for refined assessment tools that accurately capture that experience. In Study 1, we synthesized the qualitative research on the child and youth experience of loneliness and found shared characteristics of loneliness, with some differences related to developmental changes (e.g., understanding of contexts influencing the experience of loneliness). In Study 2, we reviewed the items from loneliness questionnaires for children and youth and found they do not fully capture the affective dimension of loneliness, that is, the breadth of emotions associated with loneliness. That gap could lead to an incomplete understanding of the phenomenon, potentially undermining the validity of research findings and the effectiveness of interventions designed to alleviate loneliness because they underplay the distress of the experience for children and young people. Addressing this shortcoming should include the development and/or refinement of measurements of loneliness for children and youth, enhancing the accuracy and relevance of loneliness assessments.
... The second study on autistic burnout also suggested that autistic burnout is distinct from clinical depression (Higgins et al., 2021). This study, co-led by an autistic adult with lived experience of autistic burnout, developed a consensus definition of autistic burnout using Grounded Delphi Method (GDM; Howard, 2018). GDM combines grounded-theory methods, useful for theory building, with Delphi, useful for expert consensus building in areas with little established literature. ...
Autistic burnout is an experience commonly described by autistic people (#AutBurnout and #AutisticBurnout on social media). Recently, two definitions of this syndrome have been published. Both describe debilitating exhaustion with onset related to various stressors including masking, though several differences exist, such as the characteristic of interpersonal withdrawal. We sought to explore the content validity of these definitions including duration and frequency criteria, using descriptive statistics, content analysis and reflexive thematic analysis. A co-produced survey of 141 autistic adults with experience of autistic burnout showed strong endorsement of the definition by Higgins et al., where exhaustion and interpersonal withdrawal occur alongside reduced functioning, executive functioning difficulties, and increased manifestation of autistic traits. Duration and frequency criteria were unresolved, with qualitative data highlighting varying (both acute and chronic) experiences. Autistic burnout is frequently misdiagnosed as depression, anxiety, bipolar disorder, borderline personality disorder or other conditions. Work is needed to increase community and clinician awareness, as well as initiatives to improve unaccommodating neurotypical environments. More research and validation are needed in larger samples not restricted to autistic adults who have experienced autistic burnout to determine prevalence and risk factors as well as duration and frequency.
Lay abstract
Autistic burnout is something autistic people have been talking about for a while (see #AutBurnout and #AutisticBurnout on social media). Recently, researchers published two different definitions of autistic burnout. We wanted to test these definitions. We wanted to confirm the duration and frequency of autistic burnout. That is, how long and how often do people get autistic burnout? We surveyed 141 autistic adults who had autistic burnout. We used descriptive statistics, content analysis and reflexive thematic analysis to analyse the survey responses. Autistic adults strongly agreed with the definition published by Higgins et al. How long and how often people get autistic burnout was not clear. Participants told us they have both short and long episodes. Participants told us that autistic burnout leads to exhaustion. They needed to withdraw from being with other people. They needed to stay away from autism unfriendly places. Many had been misdiagnosed as having depression, anxiety, bipolar disorder, borderline personality disorder or other conditions. We need increased awareness of autistic burnout. Autistic people need more help. More research is needed, we need to have bigger studies to understand autistic burnout.
... Study in [8] reviews the framework for evaluating Enterprise Data Models (EDM) as part of EA implementation. The framework proposed in [8] is based on the Grounded Delphi Method (GDM) [9] [10]. This method is the development of the Delphi method that is enriched with specific data collection methods. ...
Global oil prices have encouraged the development of the oil and gas industry. The passion for the revival of the oil and gas industry needs to be followed by solid steps. Efficiency is a theme in all business aspects. Enterprise Architecture (EA) is believed to be able to help realize the achievement of the company's goal. But EA implementation is challenging. The company must provide sufficient resources to ensure the EA implementation goal is achieved. It is therefore necessary to estimate the EA implementation to detect any gaps. This research offers a method to estimate the EA in the upstream petroleum industry. The method is a combined approach of Systematic Literature Review (SLR) and structured interviews. Interviews were conducted with a modified System Usability Scale (SUS) using the perspective of effectiveness, efficiency, agility, and durability. The evaluation results concluded that the EA implementation was still below the usability threshold. This fact encourages further EA development efforts, including the selection and utilization of specific and simple EA components.
... This study employed an iterative qualitative design based on the Grounded Delphi Method (GDM), which amalgamates the theoretical principles of two commonly used exploratory research theories, namely the Delphi method and Grounded Theory [60]. The stepwise research process of GDM was selected as compared to the aforementioned theories, it yields richer data that is conducive to theory building by providing a more rigorous criteria selection, based upon the consensus and item ranking of experts [61]. An overview of the methodological framework of the GDM is provided in Figure 1 below. ...
In recent years, smart grids have attracted considerable attention. However, despite the promising potential of the technologies encompassed within such systems, their adoption has been slow, geographically varied, and in the context of residential demand response, often subject to public scrutiny. The heterogeneous evolution of the smart grid is not only the product of technological limitations but is additionally sensitive to socio-political considerations prevalent at the national or provincial level. Through expert interviews that were conducted in Ontario, Canada, this study provides insights into which smart grid factors are considered as most important for its development, and also what are the drivers, inhibitors, benefits, and drawbacks that a smart grid provides and / or entails, placing particular emphasis on residential demand response programs. The constructs scrutinized were adapted from previous studies, and the information collected was analyzed following the procedure of the Grounded Delphi Method. The findings indicate that a consensus was reached, in that smart grids pave the way for increased demand flexibility and loss reductions, though these are contingent on measures being implemented regarding the creation of investment opportunities, engagement of consumers, and ensuring the security of private data. Relevant policy implications and research recommendations are also explored.
... There are various recommendations on the best number of participants for the Delphi method. This number could be in the range of 5-20, 15-20, 10-15, 10-18, not more than 25, not more than 50, not less than 8, according to various authors (Crance, 1987;Hasson et al., 2000;Howard, 2018;Hsu and Sandford, 2007;Murry and Hammons, 1995;Okoli and Pawlowski, 2004). Surveying a number of Delphi studies, Boulkedid et al. (2011) found that half of them had a number of participants in the range from 11 to 31. ...
Purpose
This study aims to develop a competency model for the Vietnamese workforce in the era of Industry 4.0.
Design/methodology/approach
A combination of an online survey and a Delphi study was conducted to identify a set of skills, abilities, knowledge and personalities that are critical for effective performance in the future workplace.
Findings
A set of 26 competencies was identified. Similar to previous findings in the context of developed countries, the set centres around a group of competencies commonly called “21st century competencies”. It also includes characteristics unique to a developing nation.
Research limitations/implications
The proposed framework of competencies may not cover all human capabilities necessitated by the workplace and may include items with overlapping definitions. The study only represents the view of the business community, and its survey sample was limited in size and location. The impact of COVID-19 on the competency model was not explicitly covered during the study.
Practical implications
The competency model could serve as a basis for the educator to reform curricula, the policy maker to devise policies and the employer to develop training programmes. It can be used as a reference for other nations at similarly-developmental level.
Originality/value
The present study is among a few empirical studies regarding a model for Industry 4.0 competencies in the context of low middle-income countries and probably provides one of the first Industry 4.0 competency models for Vietnam. It also provides a novel framework for identifying and analyzing competencies.
Background
Climate change and its impact have taken centre stage in contemporary political economic discourse. Climate change is posing complex problems that far outweighs the solutions suggested by the conventional analytical tools used for guiding responses to major environmental challenges. This is particularly the case in developing countries like Nigeria. Unsurprisingly the concept of community resilience towards climate change has received a great deal of attention from researchers and policy makers. However, community resilience is a contested concept, which leads to disagreement about the methods of achieving it. The nature of community resilience makes the measurement of the efficiency of the policies designed to increase community resilience problematic, particularly in developing countries where limited funds must be prioritised.
Methods
The research presented uses a Grounded Delphi Method (GDM) to identify how experts in Nigeria define community resilience and reach a consensus on its measurement in Nigeria’s context and other developing nations. The data collection involved three rounds of Delphi with a panel of 21 experts, the first round employed semi-structured interviews, following the exploratory Delphi approach, and subsequent rounds employed online surveys.
Findings
The findings indicate that there is a process of stages that communities need to go through to become resilient to climate change. These begin with coping with climate change, followed by adaptation to climate change with the final stage being transformation in the face of climate change. Twenty indicators are identified categorised under eight elements that are suitable for measuring community resilience at the different stages of this process. It is interesting to note that the experts in Nigeria who participated in the study excluded notions of transformation in their conceptualisation of community resilience illustrating a potential gap in their perceptions of the requirements for how communities can become fully resilient.
Conclusion
This research provides a method of prioritising specific, measurable indicators to inform policies designed to reduce the impacts of climate change by supporting community resilience in the context of developing countries with limited funding.
Purpose
This article describes the third part of a three-stage study investigating the information behaviour of fans and fan communities, the first stage of which is described in the study by Price and Robinson (2017).
Design/methodology/approach
Using tag analysis as a method, a comparative case study was undertaken to explore three aspects of fan information behaviour: information gatekeeping; classifying and tagging and entrepreneurship and economic activity. The case studies took place on three sites used by fans–Tumblr, Archive of Our Own (AO3) and Etsy. Supplementary semi-structured interviews with site users were used to augment the findings with qualitative data.
Findings
These showed that fans used tags in a variety of ways quite apart from classification purposes. These included tags being used on Tumblr as meta-commentary and a means of dialogue between users, as well as expressors of emotion and affect towards posts. On AO3 in particular, fans had developed a practice called “tag wrangling” to mitigate the inherent “messiness” of tagging. Evidence was also found of a “hybrid market economy” on Etsy fan stores. From the study findings, a taxonomy of fan-related tags was developed.
Research limitations/implications
Findings are limited to the tagging practices on only three sites used by fans during Spring 2016, and further research on other similar sites are recommended. Longitudinal studies of these sites would be beneficial in understanding how or whether tagging practices change over time. Testing of the fan-tag taxonomy developed in this paper is also recommended.
Originality/value
This research develops a method for using tag analysis to describe information behaviour. It also develops a fan-tag taxonomy, which may be used in future research on the tagging practices of fans, which heretofore have been a little-studied section of serious leisure information users.
Purpose
This article presents an introduction to the Delphi method and review of Delphi studies published in the literature of library and information science (LIS).
Design/methodology/approach
A review of Delphi studies published between the years of 1971 and 2019 is performed, using studies retrieved from the Library and Information Science Source database. A total of 122 articles were retrieved and evaluated based on the population studied, means of identifying experts, number of participants for each study round, type of Delphi, and type of findings.
Findings
General librarians (any type), academic librarians, and information science researchers are the most common populations in LIS Delphi studies. On average (middle 50 percent of studies), 14–36 experts are used in the first round of LIS Delphi studies (median n = 23). Employment in a specific role and publications in scholarly journals are the most common means of identifying experts. Variants of the e-Delphi (online survey/email) method are increasingly common, particularly in LIS Delphi studies that focus on general information science, rather than library, topics. Though LIS Delphi studies are relatively few in number, they have a consistent record of being published in some of the most prestigious LIS journals.
Originality/value
This paper provides an introduction to the Delphi method for LIS research and presents an overview of existing literature in LIS that utilizes the research method. No overview of this extent exists in the LIS literature, and, thus, this paper may serve as an important information source about the method for LIS researchers.
Focus groups are widely used in qualitative research. Recently, focus groups that are held online have become increasingly popular despite the objection by some researchers that the Internet is a poor medium for focus group research. The present study was conducted to reveal differences in the characteristics of focus group discussions in the online and face-to-face formats. Participants in 4 online focus groups and 4 face-to-face focus groups discussed their opinions about several health-related Web sites. Statistical analysis of the transcripts suggested that online participants tended to contribute shorter comments and were more likely to say just a few words of agreement. In the online focus groups, participation levels tended to be more uniform; in the face-to-face groups, some participants tended to contribute a disproportionately large number of words, whereas other participants were relatively silent. The results suggest different roles for online and face-to-face focus groups in qualitative research.
This paper presents the case of a non-traditional use of the Delphi method for theory evaluation. On the basis of experience gained through secondary and primary research, a generic decision toolkit for Delphi studies is proposed, comprising of taxonomy of Delphi design choices, a stage model and critical methodological decisions. These research tools will help to increase confidence when adopting the Delphi alternative and allow for a wider and more comprehensive recognition of the method within both scientific and interpretivist studies.
The Delphi method is recommended for exploratory research in emerging research areas. Despite earlier suggestions for using the Delphi method for theory creation, few analytical tools are provided for this purpose. However, Grounded Theory is especially devoted to creating theories from qualitative data. This paper describes an enhanced Delphi method which integrates data analysis techniques from Grounded Theory. The resulting Grounded Delphi Method (GDM) improves Delphi studies by bringing in a data collection technique that focuses explicitly on the identification of the reasons and consequences for issues, ranked by experts. Moreover, the techniques of open and axial coding support the discovery of theoretical concepts from the initial Delphi issues. In turn, the ranking process of the Delphi method provides a rigorous means for selecting core categories for theory development, which decreases researcher interference on this issue. © (2011) by the AIS/ICIS Administrative Office All rights reserved.
The Delphi method has proven a popular tool in information systems research for identifying and prioritizing issues for managerial decision-making. However, many past studies have not adopted a systematic approach to conduct a Delphi study. This article provides rigorous guidelines for the process of selecting appropriate experts for the study and gives detailed principles for making design choices during the process that ensure a valid study. A detailed example of a study to identify key factors affecting the diffusion of e-commerce in Sub-Saharan Africa illustrates the design choices that may be involved. We conclude with suggestions for theoretical applications.
Introduction:
The specific skills, attitude, knowledge, and personality characteristics, which should define the competent GP-trainer have been subject of research for many years. What are the most important of these characteristics have yet to be delineated.
Aim:
The aim of this study is to identify which characteristics are prerequisite for a competent GP-trainer.
Method:
A modified Delphi procedure was used to answer the research question. Earlier qualitative research using focus groups identified 43 characteristics defining the competent GP-trainer. These characteristics were the subject of the Delphi procedure in which 48 experts chosen from the entire field of Dutch General Practice Training participated.
Results:
After two rounds of the Delphi procedure, 37 characteristics were identified as being important for a competent GP-trainer. The characteristics which were ranked as the most important were 1. a competent GP-trainer is good at giving feedback, 2. dares to give feedback, 3. is critical of the GP-trainee and the learning process, 4. is good at communicating with the GP-trainee, and 5. has respect for the trainee. An important new characteristic has been identified: "being able to inspire reflection in the trainee".
Conclusion:
The core characteristics of the GP-trainer as identified in this research project, form a profile for the ideal GP-trainer to be used as a blueprint for objectives of schooling and for the assessment of GP-trainers.
Since its introduction as a research approach in the late 1940s the Delphi technique has had over 1000 published research utilizations. Most of these have been in the field of social policy. However, a review of contemporary nursing literature suggests that it is becoming a popular choice among nurse researchers. With its focus on maximizing participant's judgements and decision-making abilities the Delphi technique is a useful tool in the research armoury of a young profession. However, questions remain about its scientific respectability. This paper gives an overview of what the Delphi technique is, the criteria for selecting it as a research approach, the studies where it has been used and its advantages and disadvantages.
This article describes the Delphi method, how it is used, its underlying assumptions, its strengths and limitations, its potential benefits to higher education research, and some key considerations in its use. The authors illustrate the Delphi method by discussing a recent national study to develop a set of management audit assessment criteria. Their focus is on often overlooked and unique aspects of this versatile qualitative research methodology.
This paper gives an account of an experiment in the use of the so-called DELPHI method, which was devised in order to obtain the most reliable opinion consensus of a group of experts by subjecting them to a series of questionnaires in depth interspersed with controlled opinion feedback.
This paper presents the findings of an empirical study into two organizations' experiences with the adoption and use of CASE tools over time. Using a grounded theory research approach, the study characterizes the organizations' experiences in terms of processes of incremental or radical organizational change. These findings are used to develop a theoretical framework for conceptualizing the organizational issues around the adoption and use of these tools-issues that have been largely missing from contemporary discussions of CASE tools. The paper thus has important implications for research and practice. Specifically, the framework and findings suggest that in order to account for the experiences and outcomes associated with CASE tools, researchers should consider the social context of systems development, the intentions and actions of key players, and the implementation process followed by the organization. Similarly, the paper suggests that practitioners will be better able to manage their organizations' experiences with CASE tools if they understand that such implementations involve a process of organizational change over time and not merely the installation of a new technology.
The Delphi technique is a widely used and accepted method for gathering data from respondents within their domain of expertise. The technique is designed as a group communication process which aims to achieve a convergence of opinion on a specific real-world issue. The Delphi process has been used in various fields of study such as program planning, needs assessment, policy determination, and resource utilization to develop a full range of alternatives, explore or expose underlying assumptions, as well as correlate judgments on a topic spanning a wide range of disciplines. The Delphi technique is well suited as a method for consensus-building by using a series of questionnaires delivered using multiple iterations to collect data from a panel of selected subjects. Subject selection, time frames for conducting and completing a study, the possibility of low response rates, and unintentionally guiding feedback from the respondent group are areas which should be considered when designing and implementing a Delphi study.
This paper is concerned with describing the principal uses of the Delphi method in higher education. These areas of use are found to be (1) searching out goals and objectives, (2) campus and curriculum planning, and (3) development of evaluation criteria. Important to understanding the use of Delphi in a higher education setting are the methodological adaptations that have been employed. Delphi as used in technological forecasting requires modification when used in the generation and assessment of goals. Three principal problems in methodology are examined here. They are (1) selection of the panel, (2) the character of round one and (3) the consequences of feedback.
This paper examines critically the Delphi technique to determine whether it succeeds in alleviating the “process loss” typical of interacting groups. After briefly reviewing the technique, we consider problems with Delphi from two perspectives. First, we examine methodological and technical difficulties and the problems these have brought about in experimental applications. We suggest that important differences exist between the typical laboratory Delphi and the original concept of Delphi. These differences, reflecting a lack of control of important group characteristics/factors (such as the relative level of panelist expertise), make comparisons between Delphi studies unrealistic, as are generalizations from laboratory studies to the ideal of Delphi. This conclusion diminishes the power of those former Delphi critiques that have largely dismissed the procedure because of the variability of laboratory study results. Second, having noted the limited usefulness of the majority of studies for answering questions on the effectiveness of Delphi, we look at the technique from a theoritical/ mechanical perspective. That is, by drawing upon ideas/findings from other areas of research, we attempt to discern whether the structure of the Delphi procedure itself might reasonably be expected to function as intended. We conclude that inadequacies in the nature of feedback typically supplied in applications of Delphi tend to ensure that any small gains in the resolution of “process loss” are offset by the removal of any opportunity for group “process gain”. Some solutions to this dilemma are advocated; they are based on an analysis of the process of judgment change within groups and a consideration of factors that increase the validity of statistical/ nominal groups over their constituent individual components.
Delphi is a popular, long-range, qualitative forecasting technique that has been extensively applied to a wide variety of problems in different domains. Since the method was conceived in the early 1950s at the Rand Corporation, different variations of Delphi have evolved in an effort to meet the unique forecasting needs of different decision makers. This bibliographic study surveys the literature on the methodology and applications of Delphi over a period of two decades (1975–1994). A total of 463 papers were identified out of which 254 papers treat Delphi as a primary subject while the remaining 209 papers treat Delphi as a secondary subject. The study concludes with a brief commentary on the Delphi technique that may be useful for researchers and practitioners in qualitative forecasting.
C. Urquhart, H. Lehmann and M. Myers. Putting the theory back into grounded theory: guidelines for grounded theory studies in information systems. Information systems journal, 2009. Published by and copyright Wiley-Blackwell Publishing. The definitive version of this article is available from http://www.blackwell-synergy.com/ Over the past decade, there has been increasing interest in the use of grounded theory in information systems research. Grounded theory is a qualitative research method that seeks to develop theory that is grounded in data systematically gathered and analysed. The purpose of this paper is to suggest guidelines for grounded theory studies in information systems. Our guidelines are based on a framework for theorizing in grounded theory studies that focuses on conceptualization and theory scope. Our hope is that the guidelines will help to raise the quality and aspirations of grounded theory studies in information systems.
A pragmatic agreed definition of adverse events in manual therapy is required to explore incidence and prevalence. We aimed to identify and describe such adverse events and seek a consensus definition. A focus group identified issues surrounding the definition of adverse events and generated the content for a questionnaire. This questionnaire was used to conduct a modified Delphi consensus survey with an expert panel (n=50). Consensus was defined as >74% agreement. Three consensus rounds were executed. There was a 50% response rate for round one, 62% for round two and 55% for round three. A layered pragmatic definition was agreed: 'Major' adverse events are medium to long term, moderate to severe and unacceptable, they normally require further treatment and are serious and distressing; 'Moderate' adverse events are as 'major' adverse events but only moderate in severity; and 'Mild' and 'not adverse' adverse events are short term and mild, non-serious, the patient's function remains intact, and they are transient/reversible; no treatment alterations are required because the consequences are short term and contained. We concluded that classifying adverse events was difficult without context or detail. Classification may be improved by using the taxonomy and descriptions suggested in this study.
Studies of key issues in IS management around the world
- P Gottschalk
Gottschalk, P. (2000). Studies of key issues in IS management around the world.
International Journal of Information Management, 20(3). doi:
10.1016/S0268-4012(00)00003-7
In what ways does prayer create integration between intuitive and logical decision making processes for the Christian business leader? A Grounded Delphi Method exploration
- D S Hussey
Hussey, D. S. (2012). In what ways does prayer create integration between
intuitive and logical decision making processes for the Christian business
leader? A Grounded Delphi Method exploration. Ann Arbor, MI: UMI
Dissertation Publishing.