Working PaperPDF Available

EVIDENT Guidance for Reviewing the Evidence: a compendium of methodological literature and websites

Authors:

Figures

Content may be subject to copyright.
A preview of the PDF is not available
... A mapping review with a two-sources scope The literature review aims to map existing research on CT in mathematics education at the K-12 level. This type of review seeks to map and categorize the existing literature on a particular topic and contextualize the findings within broader literature (Booth, 2016). The purpose of the literature review is to map the relation between CT and mathematics. ...
... I restricted the search to articles published after 2010 to ensure timeliness and a certain degree of applicability for CT in mathematics. However, applying such a narrow scope entails an obvious risk of bias and neglect (Booth, 2016). The intention was to form a basic understanding of the field to investigate the research question. ...
Article
Full-text available
I løbet af de sidste to årtier er computationel tankegang blevet mere populært i under­visningsmiljøer. Denne artikel har til formål at udfolde computationel tankegang i rela­tion til matematik. Undersøgelsen gennemgik 19 artikler publiceret mellem 2014 og 2021 og giver nye muligheder for at forstå, hvordan man kan involvere sig i og intro­ducere computationel tankegang i matematikundervisningen. Det blev fundet, at com­putationel tankegang og matematisk tænkning havde en relation, og at problemløsning kunne være en tilgang til at relatere dem. Resultaterne afslører, at forholdet primært er teoretisk, og at lærerne finder det udfordrende at skabe en forbindelse mellem compu­tationel tankegang og matematik. Udover at give et struktureret eksempel på forskning, der er udført på området, og identificere mangler, rejser undersøgelsen også nye forsk­ningsmuligheder.
... A mapping review is a systematic search of a broad topic to identify gaps in knowledge and directions for future research (Booth, 2016). Search results are displayed in a user-friendly format such as a graphic, diagram, or searchable database (Miake-Lye et al., 2016). ...
... They do, however, allow researchers to systematically identify literature from a broad field for a specific topic (Grant & Booth, 2009;Hetrick et al., 2010), and provide a summary of available data, and visually present findings as related to a framework of interest (Miake-Lye et al., 2016). By identifying gaps in the research literature, the results of a mapping review can be used to initiate more comprehensive systematic reviews or a more in-depth primary study (Booth, 2016;Grant & Booth, 2009;Katz et al., 2003). Mapping reviews consolidate information and are useful to policy makers, researchers, and rehabilitation providers (Bayley et al., 2014;Bragge et al., 2011). ...
Article
Full-text available
Adolescence is a critical period for developing a sense of identity, an iterative process that relies on the development of skills such as self-reflection and self-appraisal. Outcomes of identity development include personal ethics, knowledge of one's strengths and challenges, and, ultimately, independence. Traumatic brain injury (TBI) affects these outcomes in adults, when identity has been established and may need to be redefined; but what happens when an injury occurs while identity is being formed? To answer this question, we used mapping review methodology to explore TBI effects on adolescent identity formation, mapping the evidence onto a biopsychosocial framework for rehabilitation. We reviewed studies on identity in adolescents with mild to severe TBI ages 13-18 years, published from inception to 2021, with a focus on outpatient rehabilitation settings. Key findings of the mapping review noted adolescents post-TBI are likely to: (1) question their identity considering dissonance between the current self and their pre-injury self; and (2) seek to establish new, adaptive meanings and identities. All studies drew conclusions regarding identity and participation of adolescents post-TBI. Results provided insight into the importance of considering individualized rehabilitation interventions for adolescents, given their unique developmental path towards identity formation.
... As a large variety of methods and designs, including both quantitative and qualitative, were used in selected studies, the narrative synthesis approach was adopted to summarise and explain findings with text (Booth, 2016). The narrative synthesis process adhered to the guidance provided by Popay, Roberts, Sowden, Petticrew, and Ara (2006), and included a preliminary synthesis of the data using tabulation and thematic analysis, exploring relationships in the data using a mind map, and assessing the robustness of the synthesis by incorporating quality assessment into the discussion and conclusions on direction of findings. ...
Article
Background: Up to 80% of children with autism experience behavioural sleep problems, predominantly relating to bedtime resistance, sleep anxiety, sleep dysregulation, and shorter duration, which are associated with increased autistic symptom expression and emotional and behavioural difficulties. Researchers predicted the COVID-19 pandemic would worsen sleep and behavioural difficulties for autistic children, due to their need for routine and certainty. This systematic review is the first to focus on delineating the role of sleep disturbance in exacerbating autistic symptoms and internalising and externalising behaviours during the pandemic. Method: In this PROSPERO registered systematic review, we aggregated and synthesised findings from empirical studies from 2020 onwards that included children with autism and examined sleep outcomes, using narrative and framework synthesis due to the variety of methods and designs employed. We identified additional relevant themes through inductive thematic analysis. Results: Seventy-one studies met the search criteria, and we selected seventeen for review following screening and quality assessment. These studies reported mixed findings; with strongest support for worsening of sleep problems typically experienced by autistic children, including difficulties with sleep regulation and shorter sleep duration. Further, sleep problems were associated with increased expression of autistic characteristics. Conclusions: Preliminary findings of worsening sleep and increased autistic characteristics for autistic children throughout the COVID-19 pandemic highlight the need for ongoing, accessible and flexible service provision during exposure to environmental stressors. We propose that behavioural sleep interventions are well suited to telehealth adaptation and play an important role in supporting families when in-person treatment for sleep problems is not possible.
... Mapping reviews provide an opportunity to examine the bigger picture of a research area to pinpoint specific gaps in knowledge that might require more complete systematic reviews or propose guidelines to be considered in future practices [99]. In Table 3, we summarize some of the topics that can benefit from systematic or scoping reviews. ...
Article
Full-text available
Background: Two fields of research and development targeting the needs of the aging population of the world are flourishing, successful aging and assistive information and communication technologies (A-ICTs). The risks of ageist stereotypes emerging from how we communicate in both discourses are long known. This raises questions about whether using specific age criteria in the context of "aging deficits" can bias participation in, or compliance with, the research process by older adults who try to avoid age-related stigma. Objective: This study aimed to examine subject recruitment, study designs (based on age >65 years criteria), as well as discourses in research objectives and conclusions in health research on affordances of A-ICTs for older adults. Methods: A systematic mapping approach was used to characterize rationales, methods, stated objectives, and expected outcomes of studies indexed in PubMed and retrieved through the search logic (["Older Adults" OR Seniors OR Elderly] AND [ICT OR gerontechnology OR "Assistive Technology")] AND ("Healthy Aging" OR "Successful Aging" OR "healthy ageing" OR "successful ageing"). Inclusion criteria were as follows: the study should have recruited older participants (aged >65 years), been qualitative or quantitative research, and involved the introduction of at least one A-ICT for health-related improvements. Exclusion criteria were as follows: reviews, viewpoints, surveys, or studies that used information and communication technology for data collection instead of lifestyle interventions. Content, thematic, and discourse analyses were used to map the study characteristics and synthesize results with respect to the research question. Results: Of 180 studies that passed the search logic, 31 (17.2%) satisfied the inclusion criteria (6 randomized controlled trials, 4 purely quantitative studies, 9 focus groups, 2 observational studies, and 10 mixed methods studies). In all but one case, recruitment was pragmatic and nonrandom. Thematic analysis of rationales revealed a high likelihood of emphasis on the burdens of aging, such as rising costs of care (12/31, 39%) and age-related deficits (14/31, 45%). The objectives of the research fell under 4 categories: promotion of physical activity, acceptance and feasibility of robots and remote health monitoring systems, risk detection, and the future of A-ICTs in health care for older adults. Qualitative studies were more attentive to the nonageist research guidelines. Heterogeneity in the study results (both qualitative and quantitative) was not related to age but to individual agency, acceptance, and adherence. A combination of research strategies (participatory, longitudinal, playful, flexible, and need-based designs) proved successful in characterizing variations in study outcomes. Studies that documented recruitment dynamics revealed that fear of stigma was a factor that biased participants' engagement. Conclusions: This review indicates that age is not an informative criterion for recruitment and retention of participants. Charting the dynamics of adoption of, and interaction with, A-ICTs is critical for advancing research and technology development.
... A mapping review was chosen as the most acceptable methodology because it aims to categorise, classify, characterise patterns, trends, or themes in evidence production, particularly in numerous publications. [47][48][49] This mapping review will provide an overview of the available research evidence by aggregating and interpreting the literature, including identifying research gaps in ergonomics in oral health professions. The study embarks on a mapping review of research on ergonomics in oral health professions to determine the existing degree of research used to identify research gaps and inform future research. ...
Article
Full-text available
p class="abstract"> Background: Ergonomics is a multidisciplinary science that studies how humans and other system elements interact and a profession that uses theory, concepts, data, and methodologies to improve human well-being and overall system performance. Oral health professionals need good working ergonomics to preserve their work competence, efficiency, and high clinical level of treatment throughout their careers. For various working practices, clinical procedures, and patient types, they must adjust and ensure proper working postures, adequate illumination, and easy access to essential apparatus and materials. Although some systematic studies and original research have been conducted about different aspects of “ergonomics in oral health professions,” no mapping review has been shown. The authors believe a broad overview of existing literature is required to map existing research, determine research gaps, and guide future research. Methods: The protocol for this mapping review has been designed by the Preferred Reporting Items for Systematic reviews and Meta-Analysis extension for scoping studies (PRISMA-SCR) and the Joanna Briggs Institute (JBI) guidelines. A comprehensive search strategy developed with an experienced liaison librarian for health will be used to search four databases and eight sources of unpublished literature. JBI’s proposed search approach will be used. A PRISMA-SCR flowchart will be used to track the number of recognised, screened, and excluded sources. A data extraction table will be used to collate critical information, supplemented with a narrative explanation, and presented in a tabular style. Conclusions: This mapping review will identify research gaps in this field and guide further studies.</p
... Thirdly, mapping can provide useful contextual information to inform future syntheses. Booth (2016) add that where there is an abundant but diverse area of research, mapping reviews are able to help create a visual synthesis of trends, patterns and themes in evidence. ...
Article
Full-text available
Both the ethics of simulation and how it may be used to explore, train and assess ethical issues in a clinical context have received growing interest in recent years. As ethical considerations permeate almost every element of simulation and clinical practice, the emerging literature in this field remains relatively fragmented, lacking a common vocabulary or standardized practice and methodology. Given this, the primary aim of this paper was to systematically map the literature related to ethics in healthcare simulation, guided by the research question of ‘how is ethics in healthcare simulation recorded in current literature?’. Our secondary aim was to explore the feasibility of conducting a systematic mapping review. One hundred four papers were included and analyzed. Results suggest that this is relatively small, but rapidly growing field. Most research was carried out in the US and with variety of research methods employed. Research involving samples of nurses relied more heavily on qualitative methods and students in their samples than that of medical doctors or other professions. Keyword co-occurrence suggested that studies utilized simulation overwhelmingly in an educational context.
... The purpose of this mapping review is not to paint a complete picture of all the available research within the field, nor to be as rigorous and thorough as a systematic review. Instead, the goal is to identify gaps and overlaps in research literature, while categorizing existing literature from which further research can be commissioned [20][21][22]. Initially, a search string was developed with a focus on laundry and consumer motivations connected to laundering. ...
Article
Full-text available
Today’s washing appliances are much more efficient than those of a decade ago, but the environmental benefits of this efficiency are counteracted by shifts in consumer behavior. Initiatives to reverse these shifts have often proven futile, indicating a basic lack of clarity on why we clean our clothes. This article is an explorative review with the aim of identifying dominant factors that shape how we do our laundry. The results can be used both as an introduction to laundry research in general, as well as a baseline for future interdisciplinary research. Three guiding principles are presented that describe the most influential factors underlying laundering: (1) technology changes conventions, while social context dictates technology acceptance; (2) technological solutions are often suggested to influence consumers, but individual concerns seem to override the effect of such interventions; (3) consumers are guided by social conventions, rooted in underlying psychological dynamics (e.g. moral dimensions of cleanliness). Looking at these principles it is understandable why interventions for sustainability are failing. Many interventions address only a part of a principle while disregarding other parts. For example, consumers are often informed of the importance of sustainability (e.g. “washing at lower temperature is good for the environment”), while questions of social belonging are left out (e.g. “many of your neighbors and friends wash at lower temperature”). To increase the possibility of a lasting change, it would be beneficial if instead all of the three principles could be addressed given the specific consumer group of interest.
Article
Virtual (screen-based) simulations have been utilized to help progress pre-licensure nursing students’ remote clinical learning during the recent pandemic. This mapping review, reports an anthology of virtual simulation technology sources from simulation education web sites and library sources. Two authors verified available sources and categorized these based on cost; either open access, or subscription-based. A list of 40 virtual simulation sources including virtual simulations, virtual reality simulations and virtual games, is presented. These provide faculty with a choice of virtual simulation modalities for various levels of nurse learners. Numerous virtual simulation technology applications are available for educators to utilize in teaching nursing students. Results from this review meet a need for educators to access virtual simulation applications to include in their education curricula.
Preprint
Full-text available
Background Increasing availability of big data presents new opportunities for researchers. Yet, navigating national data sources is challenging. We aimed to review and summarize federally-sponsored, publicly available, health-related data sources. Methods We conducted a systematic mapping review of government sources of health-related data on U.S. populations and with active or recent (previous 10 years) data collection. Key measures were: government sponsor, overview and purpose of data, population of interest, sampling design, sample size, data collection methodology, type and description of data, and cost to obtain data. Convergent synthesis was used to aggregate findings. Results Among 106 unique data sources, 57 met inclusion criteria. Data sources were classified as survey or assessment data (53%), trends data (47%), summative processed data (47%), primary registry data (30%), and evaluative data (19%). Most (68%) served more than one purpose. The population of interest included individuals/patients (70%), providers (26%), and healthcare sites/systems (25%). The sources collected data on demographic (77%) and clinical information (61%), health behaviors (42%), provider or practice characteristics (39%), healthcare costs (30%), and laboratory tests (14%). Most (75%) offered free datasets. Discussion A broad scope of national health data is accessible to researchers. These data provide insights into important health issues and the nation’s healthcare system, while eliminating the burden of primary data collection. Data standardization and uniformity were uncommon across government entities, highlighting a need to improve data consistency. Conclusion Secondary analyses of national data are a feasible, cost-efficient means to address national health concerns.
Article
Background Randomized clinical trials (RCTs) represent the highest level of scientific evidence. The aim of this review was to map and summarize the main characteristics and publication trends of RCTs with a statistically significant effect on mortality in critically ill and perioperative patients. Methods A mapping review of RCTs published between January 1982 and January 2021. We searched PubMed/MEDLINE and EMBASE for RCTs reporting mortality data. A descriptive analysis was conducted, including general and methodological information of all these RCTs with a statistically significant difference (p<0.05) in mortality. Results We identified 340 studies published in 115 journals and from 42 countries. The most represented clinical areas were ventilatory support (n=58, 17%) and hemodynamics (n=56, 16%). Detrimental effect on survival was described in 47 (14%) RCTs. Denmark had the highest number of published trials per million inhabitants. A total of 40 (10%) RCTs were led by a female author. The intention to treat principle was applied overall in 60% of RCTs, though this percentage increased up to 75% when the study was published in journals with high IF. Conclusion In the largest contemporary RCT database of interventions significantly influencing mortality, we found an increase in scientific production. US, China, France, Italy, and the UK contributed with 172 (51%) RCTs over 40 years. Only 20% of the studies were multinational collaborations, though this percentage increased over time. The presence of women as first authors, was one out of 8 RCTs.
Article
Full-text available
In this article, we provide a framework for analyzing and interpreting sources that inform a literature review or, as it is more aptly called, a research synthesis. Specifically, using Leech and Onwuegbuzie's (2007, 2008) frameworks, we delineate how the following four major source types inform research syntheses: talk, observations, drawings/photographs/videos, and documents. We identify 17 qualitative data analysis techniques that are optimal for analyzing one or more of these source types. Further, we outline the role that the following five qualitative data analysis techniques can play in the research synthesis: constant comparison analysis, domain analysis, taxonomic analysis, componential analysis, and theme analysis. We contend that our framework represents a first step in an attempt to help literature reviewers analyze and interpret literature in an optimally rigorous way. © 2012: Anthony J. Onwuegbuzie, Nancy L. Leech, Kathleen M. T. Collins and Nova Southeastern University.
Chapter
Comparative research is exploding with alternative methodological and theoretical approaches. In this book, experts in each one of these methods provide a comprehensive explanation and application of time-series, pooled, event history and Boolean methods to substantive problems of the welfare state. Each section of the book focuses on a different method with a general introduction to the methods and then two papers using the method to deal with analysis concerning welfare state problems in a political economy perspective. Scholars concerned with methodology in this area cannot afford to overlook this book because it will help them keep up on proliferating methodologies. Graduate students in political science and sociology will find this book extremely useful in their careers.
Article
The author is currently conducting two rapid Realist Syntheses, one to identify the theoretical bases of closed-circuit television (CCTV) to reduce alcohol-related assault in the night time economy, and the other to identify dimensions of evaluation to improve the effectiveness and efficiency of a number of services in northern Australia which address homelessness and alcohol-harm reduction. The CCTV project grew out of a "completed" Realist Evaluation; the homelessness and alcohol-harm project is the foundation for a future Realist Evaluation. This paper will examine how the Realist Synthesis protocols have been applied both retrospectively, and to inform the future Realist Evaluation. Each evaluation aims to understand how specific interventions work, or don't work, using the explanatory structure of generative causation. Key findings are: that precise definitions of the programs' outcomes are crucial to retrospectively applying the Realist Synthesis methodology; that the realist methodology can embed a continuous improvement process in the funding organisation once these outcomes are defined, making research engagement more effective; that the outcomes (and causal mechanisms) lie at different systemic levels, both internal and external to the organisation; and that this last point is something people within funding organisations intuitively grasp, but have difficulty understanding.
Article
This article is about the use of systematic reviews as a research methodology in library and information studies (LIS). A systematic review is an attempt to gather all of the research on a given topic in order to answer a specific question. They have been used extensively in the health care field and have more recently found their way into the social sciences, including librarianship. Examples of the use of systematic reviews in LIS illustrate the benefits and challenges to using this methodology. Included is a brief description of how to conduct a review and a reading list for further information.
Chapter
Slums are densely populated, neglected parts of cities where housing and living conditions are exceptionally poor. In situ slum upgrading, at its basic level, involves improving the physical environment of the existing area, such as improving and installing basic infrastructure like water, sanitation, solid waste collection, electricity, storm water drainage, access roads and footpaths, and street lighting, as well as home improvements and securing land tenure. To explore the effects of slum upgrading strategies involving physical environment and infrastructure interventions on the health, quality of life and socio-economic wellbeing of urban slum dwellers in low and middle income countries (LMIC). Where reported, data were collected on the perspectives of slum dwellers regarding their needs, preferences for and satisfaction with interventions received. We searched for published and unpublished studies in 28 bibliographic databases including multidisciplinary (for example Scopus) and specialist databases covering health, social science, urban planning, environment and LMIC topics. Snowballing techniques included searching websites, journal handsearching, contacting authors and reference list checking.