No full-text available
To read the full-text of this research,
you can request a copy directly from the authors.
Search Strategies for [Systematic] Literature Reviews
Abstract
After setting review questions as discussed in the previous chapter, the search for relevant publications is the next step of a literature review.
... Search strategies for systematic literature reviews: Iterative search strategy [33] The review process adopts the iterative search strategy for systematic literature reviews [33] as illustrated by figure 2.1. This strategy is selected to ensure comprehensive coverage, minimise bias, address heterogeneity in sources, and adapt to emerging research. ...
... Search strategies for systematic literature reviews: Iterative search strategy [33] The review process adopts the iterative search strategy for systematic literature reviews [33] as illustrated by figure 2.1. This strategy is selected to ensure comprehensive coverage, minimise bias, address heterogeneity in sources, and adapt to emerging research. ...
The tensions between prototype iteration and its associated costs, both in terms of time and resource, are identified as a critical challenge in contemporary prototyping practices. Whilst it is acknowledged that increased prototyping correlates to improved products and greater product innovation, the cost of prototype iteration, particularly in the later stages of the development process is a key factor in determining the extent of prototyping that is undertaken, thus the potential for product success.
Addressing this challenge, the research presented in this thesis investigates the development of a methodology for prototype remanufacturing in New Product Development (NPD). Remanufacturing, defined as the restoration of used products to a like-new functional state, emerges as a strategic approach with potential to significantly improve the efficiency of prototype iteration. By remanufacturing, an existing prototype could be ’edited’ to embody only the necessary change between design iterations, promising to reduce not only the time and cost associated with prototyping but also aligning with the shift towards sustainable practices in NPD.
This thesis therefore aims to investigate the unique challenges and opportunities that remanufacturing presents when applied in the context of prototyping in NPD. The research adopts a methodological framework encompassing: a comprehensive analysis of design change between high-fidelity prototype iterations, exploring the potential benefits of remanufacturing, and the formalisation of remanufacturing strategies for prototype remanufacturing. Central to this research is the development and optimisation of a computational-remanufacturing tool, designed to enhance the computational efficiency of the prototype remanufacturing process. The research addresses key issues such as the fidelity-efficiency trade-off in prototyping and the need for rapid iteration processes, particularly in the later stages of NPD. Through a series of case studies, simulations, and empirical evaluations, the thesis demonstrates the practical feasibility and benefits of implementing a remanufacturing method in prototype development.
In conclusion, the research establishes remanufacturing as a method with significant potential to augment the prototyping process. Findings show remanufacturing to yield significant time and resource savings whilst maintaining a relative level of prototype fidelity and functionality between design iterations. The research offers a novel approach to prototype development, in particular towards iteration, marked by increased efficiency and sustainability. The thesis concludes with guidance for the integration of remanufacturing strategies to support design and engineering practitioners.
... However, literature searches are (Haraldstad & Christophersen, 2015;Vimal, 2022), computerized and organized (Pisters & Hoffman, 1998), optimal (Bramer et al., 2017) and comprehensive (Hazari, 2023). Moreover, research databases (e.g., Google Scholar, PubMed, ResearchGate, Scopus, and Web of Science, etc.) are multiple, and selecting the best search engines is also part of the challenge of literature searches (Dekkers et al., 2022). In the context of online education research, bibliometric analyses have highlighted its growing complexity, emphasizing the urgent need for tools that can streamline access to high-quality literature (Permadi & Tiarto, 2022). ...
In the domain of academic research, the ongoing discourse centers around the intersection between the integration of artificial intelligence (AI) and some critical phenomena including early-career researchers' challenges, the co-evolution of AI and research methodologies, continuous innovation, reorientation, and multi-modal advancement of various AI tools. Against this backdrop, Open AI's GPT Search has just emerged as a versatility step towards its Chat GPT 4.0. The present perspective paper explores how this novel search engine can make broader paradigm shifts in traditional research approaches in literature search, data analysis, and writing discussions. Grounded in the authors' scholarship, subjective insights (authorial experimental observations), critical appraisal of the extant literature, and experiential engagement, this paper perspectivizes that with its mediation and multi-modality functioning GPT Search promises to support conducting literature searches that are uniquely helpful for semantic relevance, large search syntaxes, and aggregated and index-specific results from multi-databases in one single search command. Additionally, GPT Search can also transform early-career researchers' labor-intensive manual data analysis into automatic but more efficient qualitative data analysis. Furthermore, this search engine offers a reverse approach to writing discussions for articles and theses. The paper is the preliminary perspective that is supposed to trigger further empirical studies to advance the ongoing discourse around AI-integrated research with special attention to the novel research tool i.e., GPT Search.
... Typically, there is no rigid minimum requirement for the number of studies. Some rigorous systematic reviews may incorporate just a limited number of studies or, in certain instances, none at all if there is a dearth of adequate research in the field (Dekkers et al., 2022). For specific topics, a reduced sample size is adequate as long as they align with the aims and focus of the review where the quality of the articles are more significant than the quantity (Gough et al., 2017;Moher et al., 2010). ...
Communication apprehension, which refers to the fear or anxiety experienced in classrooms, is a considerable obstacle for Malaysian tertiary learners, especially in public speaking scenarios. This paper presents a general overview of published studies of communication apprehension in public speaking among Malaysian learners since 2019. This systematic literature review examines two research questions: what are the causes of communication apprehension among Malaysian tertiary learners and what are the most effective strategies to overcome communication apprehension in public speaking. Fifteen studies were thoroughly reviewed. The results indicate that the majority of tertiary learners in Malaysia generally have a moderate level of communication apprehension, which is mostly caused by the fear of being evaluated, anxiousness, and a lack of self-efficacy abilities. It also showed female learners were more courageous to face apprehension in public speaking than males. Several strategies suggested to address communication apprehension are by modifying teaching methods, creating positive and stress-free classroom environments and giving positive and constructive feedback
... An integrative review method was considered suitable as the purpose of our study is to provide an overview of the knowledge base, combine insights and perspectives from different fields, and expand on the theoretical foundation of tokenizing circularity (Snyder, 2019). To identify relevant literature, our search strategy consists of a combination of 'snowballing' and 'comprehensive pearl growing approach' (Dekkers et al., 2022). This means initial studies (or 'pearls') that are known to be relevant are used for further search by tracking articles that cite these studies. ...
This paper presents a conceptual framework that reflects the current state of thinking on tokenizing circularity in agri-food systems. The framework is built upon classifications of tokens and the key principles of circular economy and shows how tokenization can support circularity in agri-food systems through the flows of information and flows of value. Based on an integrative review of literature on tokenization, blockchain and the circular economy and multiple case studies in the agri-food domain, we show the relevance of tokenization to the circular economy in three ways: 1) enhancing traceability of physical and digital objects in supply chains; 2) improving transparency and credibility of circularity claims; 3) facilitating collaborative business ecosystems with incentives for more circular production and distribution. Based on the framework, we derive important research questions for future research agenda on tokenizing circularity in agri-food systems.
In the construction industry, traditional methods of cost estimation are inefficient and cannot reflect real-time changes. Modern techniques are essential to create new tools that outperform current cost estimation. This study introduced the Least Square Moment Balanced Machine (LSMBM), AI-based inference engine, to improve construction cost prediction accuracy. LSMBM considers moments to determine the optimal hyperplane and uses the Backpropagation Neural Network (BPNN) to assign weights to each data point. The effectiveness of LSMBM was tested by predicting the construction costs of residential and reinforced concrete buildings. Correlation analysis, PCA, and LASSO were used for feature selection to identify the most relevant variables, with the combination of LSMBM-PCA giving the best performance. When compared to other machine learning models, the LSMBM model achieved the lowest error values, with an RMSE of 0.016, MAE of 0.010, and MAPE of 4.569%. The overall performance measurement reference index (RI) further confirmed the superiority of LSMBM. Furthermore, LSMBM performed better than the Earned Value Management (EVM) method. LSMBM model has proven to enhanced the precision in predicting cost estimates, facilitating project managers to anticipate potential cost overruns and optimize resource allocation, provide information for strategic and operational decision-making processes in construction projects.
Purpose
Despite increasing focus among scholars and practitioners on the design of product-service systems (PSS), there exists no compilation of current knowledge on the role played by small and medium-sized enterprises (SMEs) in designing such systems. Thus, this paper sets out to identify and organise the existing research and suggest questions for future research.
Design/methodology/approach
A systematic literature review was performed to identify and provide in-depth details on key themes in the literature addressing the design of PSS in SMEs.
Findings
This paper identifies five themes in the literature on the design of PSS in SMEs: motives, challenges, SME characteristics, methods and digitalisation. The themes are interrelated, and SME characteristics seem to be at the core as they are related to all the other themes. Gaps in the current knowledge are identified, and questions for future research are suggested.
Originality/value
The suggestions for future research provide a starting point for expanding the research on PSS design and devising practical support for SMEs.
Objectives:
Search filters can support qualitative evidence information retrieval. Various search filters are available for the bibliographic databases PsycINFO and CINAHL. To date, no comparative overview of validation results of search filters verified with an independent gold standard exists.
Study design and setting:
Identified search filters for PsycINFO and CINAHL were tested for plausibility. Gold standards were generated according to the relative recall approach using references included in an overview of systematic reviews of qualitative studies. All included references were collected and checked for indexing in PsycINFO and CINAHL. Validation tests for each search filter were conducted in both databases to determine whether the references of the gold standards could be retrieved or not.
Results:
Twelve search filters for PsycINFO and fifteen for CINAHL were validated. Complexity and design of these search filters vary, as well as the validation results for the databases. When locating primary studies of qualitative research, best sensitivity and precision ratio (among filters with a sensitivity of > 80%) was achieved with a filter by McKibbon et al. for PsycINFO and a filter by Wilczynski et al. for CINAHL.
Conclusion:
Project-specific requirements and resources influence the choice of a specific search filter for PsycINFO and CINAHL.
The search strategy used in systematic reviews is an important consideration, as the comprehensiveness and representativeness of studies identified influences the quality of conclusions derived from the review. Despite the importance of this step, little in the way of best practice recommendations exist. In an effort to inform future reviews, we report the results of two studies. In Study 1, we outline a series of recommendations for designing comprehensive systematic literature searches. We review the search strategies used in 152 recent systematic reviews published in top applied psychology (including organizational psychology, counseling psychology, and management) journals and evaluate them against these criteria. In Study 2, we build on the findings of our review, carrying out an original meta-analysis, which we use as an opportunity to empirically demonstrate effects of database selection and inclusion of a complementary search protocol on search outcomes. Our results suggest that database selection could have a large effect on conclusions from reviews. Implications and recommendations for carrying out comprehensive literature reviews are described.
Rigorous evidence identification is essential for systematic reviews and meta‐analyses (evidence syntheses), because the sample selection of relevant studies determines a review's outcome, validity, and explanatory power. Yet, the search systems allowing access to this evidence provide varying levels of precision, recall, and reproducibility and also demand different levels of effort. To date, it remains unclear which search systems are most appropriate for evidence synthesis and why. Advice on which search engines and bibliographic databases to choose for systematic searches is limited and lacking systematic, empirical performance assessments. This study investigates and compares the systematic search qualities of 28 widely used academic search systems, including Google Scholar, PubMed and Web of Science. A novel, query‐based method tests how well users are able to interact and retrieve records with each system. The study is the first to show the extent to which search systems can effectively and efficiently perform (Boolean) searches with regards to precision, recall and reproducibility. We found substantial differences in the performance of search systems, meaning that their usability in systematic searches varies. Indeed, only half of the search systems analysed and only a few Open Access databases can be recommended for evidence syntheses without adding substantial caveats. Particularly, our findings demonstrate why Google Scholar is inappropriate as principal search system. We call for database owners to recognise the requirements of evidence synthesis, and for academic journals to re‐assess quality requirements for systematic reviews. Our findings aim to support researchers in conducting better searches for better evidence synthesis.
Background:
Systematic reviews are essential for decision-making. Systematic reviews on observational studies help answer research questions on aetiology, risk, prognosis, and frequency of rare outcomes or complications. However, identifying observational studies as part of systematic reviews efficiently is challenging due to poor and inconsistent indexing in literature databases. Search strategies that include a methodological filter focusing on study design of observational studies might be useful for improving the precision of the search performance.
Objectives:
To assess the sensitivity and precision of a search strategy with a methodological filter to identify observational studies in MEDLINE and Embase.
Search methods:
We searched MEDLINE (1946 to April 2018), Embase (1974 to April 2018), CINAHL (1937 to April 2018), the Cochrane Library (1992 to April 2018), Google Scholar and Open Grey in April 2018, and scanned reference lists of articles.
Selection criteria:
Studies using a relative recall approach, i.e. comparing sensitivity or precision of a search strategy containing a methodological filter to identify observational studies in MEDLINE and Embase against a reference standard, or studies that compared two or more methodological filters.
Data collection and analysis:
Two review authors independently screened articles, extracted relevant information and assessed the quality of the search strategies using the InterTASC Information Specialists' Sub-Group (ISSG) Search Filter Appraisal Checklist.
Main results:
We identified two eligible studies reporting 18 methodological filters. All methodological filters in these two studies were developed using terms from the reference standard records.The first study evaluated six filters for retrieving observational studies of surgical interventions. The study reported on six filters: one Precision Terms Filter (comprising terms with higher precision while maximum sensitivity was maintained) and one Specificity Terms Filter (comprising terms with higher specificity while maximum sensitivity was maintained), both of which were adapted for MEDLINE, for Embase, and for combined MEDLINE/Embase searches. The study reported one reference standard consisting of 217 articles from one systematic review of which 83.9% of the included studies were case seriesThe second study reported on 12 filters for retrieving comparative non-randomised studies (cNRSs) including cohort, case-control, and cross-sectional studies. This study reported on 12 filters using four different approaches: Fixed method A (comprising of a fixed set of controlled vocabulary (CV) words), Fixed method B (comprising a fixed set of CV words and text words (TW)), Progressive method (CV) (a random choice of study design-related CV terms), and Progressive method (CV or TW) (a random choice of study design-related CV terms, and title and abstracts-based TWs). The study reported four reference standards consisting of 89 cNRSs from four systematic reviews.The six methodological filters developed from the first study reported sensitivity of 99.5% to 100% and precision of 16.7% to 21.1%. The Specificity Terms Filter for combined MEDLINE/Embase was preferred because it had higher precision and equal sensitivity to the Precision Terms Filter. The 12 filters from the second study reported lower sensitivity (48% to 100%) and much lower precision (0.09% to 4.47%). The Progressive method (CV or TW) had the highest sensitivity.There were methodological limitations in both included studies. The first study used one surgical intervention-focused systematic review thus limiting the generalizability of findings. The second study used four systematic reviews but with less than 100 studies. The external validation was performed only on Specificity Terms Filter from the first study Both studies were published 10 years ago and labelling and indexing of observational studies has changed since then.
Authors' conclusions:
We found 18 methodological filters across two eligible studies. Search strategies from the first study had higher sensitivity and precision, underwent external validation and targeted observational studies. Search strategies from the second study had lower sensitivity and precision, focused on cNRSs, and were not validated externally. Given this limited and heterogeneous evidence, and its methodological limitations, further research and better indexation are needed.
Across the Global South, community-based adaptation (CBA) projects are increasingly being implemented in an effort to respond effectively and sustainably to the impacts of climate change, with a particular focus on people’s livelihoods. Despite an increase in the number of CBA projects being implemented, detailed analysis and evaluation of their efficacy and the barriers faced in achieving successful outcomes is lacking. This study draws on an analysis of grey literature (i.e. project and donor reports) to explore the barriers faced in achieving effective CBA. An extensive global search of online project evaluations yielded 25 documents comprising 69 projects from which this analysis is based. This paper first presents an overview of the 69 projects and highlights any trends. Second, this paper describes the barriers to CBA according to three broad themes: socio-political, resource, and physical systems and processes. Following this is a discussion of the most prevalent barriers: cognitive and behavioural, financial, and human resources. Third, this paper discusses the key findings elucidated from this review. This includes the need for greater sharing of project reports and findings so lessons can be learned across spatial and temporal scales, and the disparity between critical academic literature on CBA and what is implemented in practice.
Background
Healthcare professionals and researchers in the field of palliative care often have difficulties finding relevant articles in online databases. Standardized search filters may help improve the efficiency and quality of such searches, but prior developed filters showed only moderate performance.
Aim
To develop and validate a specific search filter and a sensitive search filter for the field of palliative care.
Design
We used a novel, objective method for search filter development. First, we created a gold standard set. This set was split into three groups: term identification, filter development, and filter validation set. After creating the filters in PubMed, we translated the filters into search filters for Ovid MEDLINE, Embase, CINAHL, PsychINFO, and Cochrane Library. We calculated specificity, sensitivity and precision of both filters.
Results
The specific filter had a specificity of 97.4%, a sensitivity of 93.7%, and a precision of 45%. The sensitive filter had a sensitivity of 99.6%, a specificity of 92.5%, and a precision of 5%.
Conclusion
Our search filters can support literature searches in the field of palliative care. Our specific filter retrieves 93.7% of relevant articles, while 45% of the retrieved articles are relevant. This filter can be used to find answers to questions when time is limited. Our sensitive filter finds 99.6% of all relevant articles and may, for instance, help conducting systematic reviews. Both filters perform better than prior developed search filters in the field of palliative care.
Background. There are increasing demands on health and social care (HSC) professionals to make decisions based on best evidence to inform their practice. To do this, they must be skilled in searching the literature. A robust approach to literature reviewing that results in optimal outcomes is highly desirable in a climate where time and resources are limited. Aim. This paper explores the processes of undertaking a structured literature search and measuring the effectiveness of five commonly used health and social care databases. Method. A review question was posed using the qualitative version of PICO (Population, Interest, Context and Outcome): 'How do HSC professionals (P) make decisions (I) in relation to pregnant women (C) where there is a safeguarding concern (O) regarding an unborn child?' Databases selected for review were: ASSIA, CINAHL Plus, Ovid MEDLINE, PsycINFO and Social Care Online. Searches were undertaken from October 2014 to April 2015. A rapid update was undertaken in March 2016 prior to publication. Papers were screened for their suitability for inclusion using a screening tool developed by the research team. Papers were required to report empirical research; to have been published in peer-reviewed journals, as an indicator of a measure of quality; and to be available in the English language. Full-text papers were chosen if the data were gathered from or about decision-making regarding safeguarding in pregnancy by midwives, nurses, social workers and professional managers. The quality of the chosen databases was determined by sensitivity (capacity to retrieve a satisfactory number of papers), precision (to prevent the retrieval of too many irrelevant papers) and Number Needed to Read (NNR) - number of papers needed to read to find one paper to include. Results. A total of 866 papers were identified, titles and abstracts were reviewed by the researcher and full-text papers were further reviewed by the research team, both using a screening tool. These results were discussed and nine papers were identified for review. Sensitivity was greatest on CINAHL Plus and Ovid MEDLINE. Precision scores were generally low; CINAHL Plus scored the highest at 4%. CINAHL Plus was found to be most effective with an NNR score of 26%, followed by PsycINFO with an NNR score of 36% and Ovid MEDLINE was the lowest precision with an NNR score of 45%. Implications. The challenges of robust searching for literature indicate that if evidence-based practice is to become a reality, regular training for midwives, social workers and other healthcare professionals in database searching is essential.
Objectives
To evaluate the existing evidence for associations between coffee consumption and multiple health outcomes.
Design
Umbrella review of the evidence across meta-analyses of observational and interventional studies of coffee consumption and any health outcome.
Data sources
PubMed, Embase, CINAHL, Cochrane Database of Systematic Reviews, and screening of references.
Eligibility criteria for selecting studies
Meta-analyses of both observational and interventional studies that examined the associations between coffee consumption and any health outcome in any adult population in all countries and all settings. Studies of genetic polymorphisms for coffee metabolism were excluded.
Results
The umbrella review identified 201 meta-analyses of observational research with 67 unique health outcomes and 17 meta-analyses of interventional research with nine unique outcomes. Coffee consumption was more often associated with benefit than harm for a range of health outcomes across exposures including high versus low, any versus none, and one extra cup a day. There was evidence of a non-linear association between consumption and some outcomes, with summary estimates indicating largest relative risk reduction at intakes of three to four cups a day versus none, including all cause mortality (relative risk 0.83, 95% confidence interval 0.83 to 0.88), cardiovascular mortality (0.81, 0.72 to 0.90), and cardiovascular disease (0.85, 0.80 to 0.90). High versus low consumption was associated with an 18% lower risk of incident cancer (0.82, 0.74 to 0.89). Consumption was also associated with a lower risk of several specific cancers and neurological, metabolic, and liver conditions. Harmful associations were largely nullified by adequate adjustment for smoking, except in pregnancy, where high versus low/no consumption was associated with low birth weight (odds ratio 1.31, 95% confidence interval 1.03 to 1.67), preterm birth in the first (1.22, 1.00 to 1.49) and second (1.12, 1.02 to 1.22) trimester, and pregnancy loss (1.46, 1.06 to 1.99). There was also an association between coffee drinking and risk of fracture in women but not in men.
Conclusion
Coffee consumption seems generally safe within usual levels of intake, with summary estimates indicating largest risk reduction for various health outcomes at three to four cups a day, and more likely to benefit health than harm. Robust randomised controlled trials are needed to understand whether the observed associations are causal. Importantly, outside of pregnancy, existing evidence suggests that coffee could be tested as an intervention without significant risk of causing harm. Women at increased risk of fracture should possibly be excluded.
To evaluate the associations between coffee and caffeine consumption and various health outcomes, we performed an umbrella review of the evidence from meta-analyses of observational studies and randomized controlled trials (RCTs). Of the 59 unique outcomes examined in the selected 112 meta-analyses of observational studies, coffee was associated with a probable decreased risk of breast, colorectal, colon, endometrial, and prostate cancers; cardiovascular disease and mortality; Parkinson's disease; and type-2 diabetes. Of the 14 unique outcomes examined in the 20 selected meta-analyses of observational studies, caffeine was associated with a probable decreased risk of Parkinson's disease and type-2 diabetes and an increased risk of pregnancy loss. Of the 12 unique acute outcomes examined in the selected 9 meta-analyses of RCTs, coffee was associated with a rise in serum lipids, but this result was affected by significant heterogeneity, and caffeine was associated with a rise in blood pressure. Given the spectrum of conditions studied and the robustness of many of the results, these findings indicate that coffee can be part of a healthful diet.
Background:
A high-quality search strategy is considered an essential component of systematic reviews but many do not contain reproducible search strategies. It is unclear if low reproducibility spans medical disciplines, is affected by librarian/search specialist involvement or has improved with increased awareness of reporting guidelines.
Objectives:
To examine the reporting of search strategies in systematic reviews published in Pediatrics, Surgery or Cardiology journals in 2012 and determine rates and predictors of including a reproducible search strategy.
Methods:
We identified all systematic reviews published in 2012 in the ten highest impact factor journals in Pediatrics, Surgery and Cardiology. Each search strategy was coded to indicate what elements were reported and whether the overall search was reproducible. Reporting and reproducibility rates were compared across disciplines and we measured the influence of librarian/search specialist involvement, discipline or endorsement of a reporting guideline on search reproducibility.
Results:
272 articles from 25 journals were included. Reporting of search elements ranged widely from 91% of articles naming search terms to 33% providing a full search strategy and 22% indicating the date the search was executed. Only 22% of articles provided at least one reproducible search strategy and 13% provided a reproducible strategy for all databases searched in the article. Librarians or search specialists were reported as involved in 17% of articles. There were strong disciplinary differences on the reporting of search elements. In the multivariable analysis, only discipline (Pediatrics) was a significant predictor of the inclusion of a reproducible search strategy.
Conclusions:
Despite recommendations to report full, reproducible search strategies, many articles still do not. In addition, authors often report a single strategy as covering all databases searched, further decreasing reproducibility. Further research is needed to determine how disciplinary culture may encourage reproducibility and the role that journal editors and peer reviewers could play.
The information stored in healthcare systems has increased over the last ten years, leading it to be considered Big Data. There is a wealth of health information ready to be analysed. However, the sheer volume raises a challenge for traditional methods. The aim of this article is to conduct a cutting-edge study on Big Data in healthcare from 2005 to the present. This literature review will help researchers to know how Big Data has developed in the health industry and open up new avenues for research. Information searches have been made on various scientific databases such as Pubmed, Science Direct, Scopus and Web of Science for Big Data in healthcare. The search criteria were “Big Data” and “health” with a date range from 2005 to the present. A total of 9724 articles were found on the databases. 9515 articles were discarded as duplicates or for not having a title of interest to the study. 209 articles were read, with the resulting decision that 46 were useful for this study. 52.6 % of the articles used were found in Science Direct, 23.7 % in Pubmed, 22.1 % through Scopus and the remaining 2.6 % through the Web of Science. Big Data has undergone extremely high growth since 2011 and its use is becoming compulsory in developed nations and in an increasing number of developing nations. Big Data is a step forward and a cost reducer for public and private healthcare.
Background:
In the development of search strategies for systematic reviews, "conceptual approaches" are generally recommended to identify appropriate search terms for those parts of the strategies for which no validated search filters exist. However, "objective approaches" based on search terms identified by text analysis are increasingly being applied.
Aim:
To prospectively compare an objective with a conceptual approach for the development of search strategies.
Methods:
Two different MEDLINE search strategies were developed in parallel for 5 systematic reviews covering a range of topics and study designs. The Institute for Quality and Efficiency in Health Care (IQWIG) applied an objective approach and external experts applied a conceptual approach for the same research questions. For each systematic review, the citations retrieved were combined and the overall pool of citations screened to determine sensitivity and precision.
Results:
The objective approach yielded a weighted mean sensitivity and precision of 97% and 5%. The corresponding values for the conceptual approach were 75% and 4%.
Conclusion:
Our findings indicate that the objective approach applied by IQWiG for search strategy development yields higher sensitivity than and similar precision to a conceptual approach. The main advantage of the objective approach is that it produces consistent results across searches.
Objective:
To develop an evidence-based guideline for Peer Review of Electronic Search Strategies (PRESS) for systematic reviews (SRs), health technology assessments, and other evidence syntheses.
Study design and setting:
An SR, Web-based survey of experts, and consensus development forum were undertaken to identify checklists that evaluated or validated electronic literature search strategies and to determine which of their elements related to search quality or errors.
Results:
Systematic review: No new search elements were identified for addition to the existing (2008-2010) PRESS 2015 Evidence-Based Checklist, and there was no evidence refuting any of its elements. Results suggested that structured PRESS could identify search errors and improve the selection of search terms. Web-based survey of experts: Most respondents felt that peer review should be undertaken after the MEDLINE search had been prepared but before it had been translated to other databases. Consensus development forum: Of the seven original PRESS elements, six were retained: translation of the research question; Boolean and proximity operators; subject headings; text word search; spelling, syntax and line numbers; and limits and filters. The seventh (skilled translation of the search strategy to additional databases) was removed, as there was consensus that this should be left to the discretion of searchers. An updated PRESS 2015 Guideline Statement was developed, which includes the following four documents: PRESS 2015 Evidence-Based Checklist, PRESS 2015 Recommendations for Librarian Practice, PRESS 2015 Implementation Strategies, and PRESS 2015 Guideline Assessment Form.
Conclusion:
The PRESS 2015 Guideline Statement should help to guide and improve the peer review of electronic literature search strategies.
Background:
Grey literature is an important source of information for large-scale review syntheses. However, there are many characteristics of grey literature that make it difficult to search systematically. Further, there is no 'gold standard' for rigorous systematic grey literature search methods and few resources on how to conduct this type of search. This paper describes systematic review search methods that were developed and applied to complete a case study systematic review of grey literature that examined guidelines for school-based breakfast programs in Canada.
Methods:
A grey literature search plan was developed to incorporate four different searching strategies: (1) grey literature databases, (2) customized Google search engines, (3) targeted websites, and (4) consultation with contact experts. These complementary strategies were used to minimize the risk of omitting relevant sources. Since abstracts are often unavailable in grey literature documents, items' abstracts, executive summaries, or table of contents (whichever was available) were screened. Screening of publications' full-text followed. Data were extracted on the organization, year published, who they were developed by, intended audience, goal/objectives of document, sources of evidence/resources cited, meals mentioned in the guidelines, and recommendations for program delivery.
Results:
The search strategies for identifying and screening publications for inclusion in the case study review was found to be manageable, comprehensive, and intuitive when applied in practice. The four search strategies of the grey literature search plan yielded 302 potentially relevant items for screening. Following the screening process, 15 publications that met all eligibility criteria remained and were included in the case study systematic review. The high-level findings of the case study systematic review are briefly described.
Conclusions:
This article demonstrated a feasible and seemingly robust method for applying systematic search strategies to identify web-based resources in the grey literature. The search strategy we developed and tested is amenable to adaptation to identify other types of grey literature from other disciplines and answering a wide range of research questions. This method should be further adapted and tested in future research syntheses.
As an editor-in-chief, I perceive we are approaching a crisis point with literature reviews and the reviewing process. The quality of literature reviews in submitted research is dropping, while there are more submissions with an expectation of faster reviews. The impact is that appropriate sources are not being cited and limited reviewer resources are being stressed on reviewing literature reviews. This paper reviews the literature on literature reviews and discusses how to perform them. I categorize literature review issues into five categories and make recommendations on how to correct literature review issues.
Google Scholar (GS), a commonly used web-based academic search engine, catalogues between 2 and 100 million records of both academic and grey literature (articles not formally published by commercial academic publishers). Google Scholar collates results from across the internet and is free to use. As a result it has received considerable attention as a method for searching for literature, particularly in searches for grey literature, as required by systematic reviews. The reliance on GS as a standalone resource has been greatly debated, however, and its efficacy in grey literature searching has not yet been investigated. Using systematic review case studies from environmental science, we investigated the utility of GS in systematic reviews and in searches for grey literature. Our findings show that GS results contain moderate amounts of grey literature, with the majority found on average at page 80. We also found that, when searched for specifically, the majority of literature identified using Web of Science was also found using GS. However, our findings showed moderate/poor overlap in results when similar search strings were used in Web of Science and GS (10–67%), and that GS missed some important literature in five of six case studies. Furthermore, a general GS search failed to find any grey literature from a case study that involved manual searching of organisations' websites. If used in systematic reviews for grey literature, we recommend that searches of article titles focus on the first 200 to 300 results. We conclude that whilst Google Scholar can find much grey literature and specific, known studies, it should not be used alone for systematic review searches. Rather, it forms a powerful addition to other traditional search methods. In addition, we advocate the use of tools to transparently document and catalogue GS search results to maintain high levels of transparency and the ability to be updated, critical to systematic reviews.
Background
The large and growing number of published studies, and their increasing rate of publication, makes the task of identifying relevant studies in an unbiased way for inclusion in systematic reviews both complex and time consuming. Text mining has been offered as a potential solution: through automating some of the screening process, reviewer time can be saved. The evidence base around the use of text mining for screening has not yet been pulled together systematically; this systematic review fills that research gap. Focusing mainly on non-technical issues, the review aims to increase awareness of the potential of these technologies and promote further collaborative research between the computer science and systematic review communities.
Methods
Five research questions led our review: what is the state of the evidence base; how has workload reduction been evaluated; what are the purposes of semi-automation and how effective are they; how have key contextual problems of applying text mining to the systematic review field been addressed; and what challenges to implementation have emerged?
We answered these questions using standard systematic review methods: systematic and exhaustive searching, quality-assured data extraction and a narrative synthesis to synthesise findings.
Results
The evidence base is active and diverse; there is almost no replication between studies or collaboration between research teams and, whilst it is difficult to establish any overall conclusions about best approaches, it is clear that efficiencies and reductions in workload are potentially achievable.
On the whole, most suggested that a saving in workload of between 30% and 70% might be possible, though sometimes the saving in workload is accompanied by the loss of 5% of relevant studies (i.e. a 95% recall).
Conclusions
Using text mining to prioritise the order in which items are screened should be considered safe and ready for use in ‘live’ reviews. The use of text mining as a ‘second screener’ may also be used cautiously. The use of text mining to eliminate studies automatically should be considered promising, but not yet fully proven. In highly technical/clinical areas, it may be used with a high degree of confidence; but more developmental and evaluative work is needed in other disciplines.
The “standing on the shoulders of giants” metaphor is often used to acknowledge the work of others when undertaking research and, in particular, stresses the importance of literature reviews in scientific inquiry. Though the significance of literature reviews has never been in doubt, researchers, especially novice researchers, still struggle with developing effective strategies for reviewing literature. An important reason for this difficulty is the rapidly increasing number of potentially relevant publications—not all of which necessarily add value to a literature review. As such, avoiding standing on the shoulders of dwarfs literature search emerges as a major issue in crafting an effective literature review. In this paper, we discuss challenges of literature searches in the increasingly dynamic context of information systems (IS) research and make recommendations for how to deal with them. We present practical guidelines and a checklist to help researchers with planning and organizing their literature searches.
Download: http://aisel.aisnet.org/cais/vol37/iss1/9/
To examine how effectively forwards citation searching with Web of Science (WOS) or Google Scholar (GS) identified evidence to support public health guidance published by the National Institute for Health and Care Excellence.
Forwards citation searching was performed using GS on a base set of 46 publications and replicated using WOS.
WOS and GS were compared in terms of recall; precision; number needed to read (NNR); administrative time and costs; and screening time and costs. Outcomes for all publications were compared with those for a subset of highly important publications.
The searches identified 43 relevant publications. The WOS process had 86.05% recall and 1.58% precision. The GS process had 90.7% recall and 1.62% precision. The NNR to identify one relevant publication was 63.3 with WOS and 61.72 with GS. There were nine highly important publications. WOS had 100% recall, 0.38% precision and NNR of 260.22. GS had 88.89% recall, 0.33% precision and NNR of 300.88. Administering the WOS results took 4 h and cost £88-£136, compared with 75 h and £1650-£2550 with GS.
WOS is recommended over GS, as citation searching was more effective, while the administrative and screening times and costs were lower. Copyright © 2015 John Wiley & Sons, Ltd.
Copyright © 2015 John Wiley & Sons, Ltd.
Background:
Previous research looking at published systematic reviews has shown that their search strategies are often suboptimal and that librarian involvement, though recommended, is low. Confidence in the results, however, is limited due to poor reporting of search strategies the published articles.
Objectives:
To more accurately measure the use of recommended search methods in systematic reviews, the levels of librarian involvement, and whether librarian involvement predicts the use of recommended methods.
Methods:
A survey was sent to all authors of English-language systematic reviews indexed in the Database of Abstracts of Reviews of Effects (DARE) from January 2012 through January 2014. The survey asked about their use of search methods recommended by the Institute of Medicine, Cochrane Collaboration, and the Agency for Healthcare Research and Quality and if and how a librarian was involved in the systematic review. Rates of use of recommended methods and librarian involvement were summarized. The impact of librarian involvement on use of recommended methods was examined using a multivariate logistic regression.
Results:
1560 authors completed the survey. Use of recommended search methods ranged widely from 98% for use of keywords to 9% for registration in PROSPERO and were generally higher than in previous studies. 51% of studies involved a librarian, but only 64% acknowledge their assistance. Librarian involvement was significantly associated with the use of 65% of recommended search methods after controlling for other potential predictors. Odds ratios ranged from 1.36 (95% CI 1.06 to 1.75) for including multiple languages to 3.07 (95% CI 2.06 to 4.58) for using controlled vocabulary.
Conclusions:
Use of recommended search strategies is higher than previously reported, but many methods are still under-utilized. Librarian involvement predicts the use of most methods, but their involvement is under-reported within the published article.
With the ever-increasing development of technology and its integration into users’ private and professional life, a decision regarding its acceptance or rejection still remains an open question. A respectable amount of work dealing with the Technology Acceptance Model (TAM), from its first appearance more than a quarter of a century ago, clearly indicates a popularity of the Model in the field of technology acceptance. Originated in the psychological Theory of Reasoned Action (TRA) and Theory of Planned Behavior (TPB), TAM has evolved to become a key model in understanding predictors of human behaviour towards potential acceptance or rejection of the technology. The main aim of the paper is to provide an up-to-date, well researched resource of past and current references to TAM-related literature and to identify possible directions for future TAM research. The paper presents a comprehensive concept-centric literature review of the Technology Acceptance Model, from 1986 onwards. According to a designed methodology, 85 scientific publications have been selected and classified according to their aim and content into three categories: (i) TAM Literature Reviews, (ii) Development and Extension of TAM and (iii) Modification and Application of TAM. Despite a continuous progress in revealing new factors with significant influence on TAM’s core variables, there are still many unexplored areas of Model potential application that could contribute to its predictive validity. Consequently, four possible future directions for TAM research based on the conducted literature review and analysis are identified and presented.
Background
Qualitative systematic reviews are increasing in popularity in evidence based health care. Difficulties have been reported in conducting literature searches of qualitative research using the PICO search tool. An alternative search tool, entitled SPIDER, was recently developed for more effective searching of qualitative research, but remained untested beyond its development team.Methods
In this article we tested the `SPIDER¿ search tool in a systematic narrative review of qualitative literature investigating the health care experiences of people with Multiple Sclerosis. Identical search terms were combined into the PICO or SPIDER search tool and compared across Ovid MEDLINE, Ovid EMBASE and EBSCO CINAHL Plus databases. In addition, we added to this method by comparing initial SPIDER and PICO tools to a modified version of PICO with added qualitative search terms (PICOS).ResultsResults showed a greater number of hits from the PICO searches, in comparison to the SPIDER searches, with greater sensitivity. SPIDER searches showed greatest specificity for every database. The modified PICO demonstrated equal or higher sensitivity than SPIDER searches, and equal or lower specificity than SPIDER searches. The modified PICO demonstrated lower sensitivity and greater specificity than PICO searches.Conclusions
The recommendations for practice are therefore to use the PICO tool for a fully comprehensive search but the PICOS tool where time and resources are limited. Based on these limited findings the SPIDER tool would not be recommended due to the risk of not identifying relevant papers, but has potential due to its greater specificity.
Background
Lean is a set of operating philosophies and methods that help create a maximum value for patients by reducing waste and waits. It emphasizes the consideration of the customer’s needs, employee involvement and continuous improvement. Research on the application and implementation of lean principles in health care has been limited.
Methods
This is a protocol for a systematic review, following the Cochrane Effective Practice and Organisation of Care (EPOC) methodology. The review aims to document, catalogue and synthesize the existing literature on the effects of lean implementation in health care settings especially the potential effects on professional practice and health care outcomes. We have developed a Medline keyword search strategy, and this focused strategy will be translated into other databases. All search strategies will be provided in the review. The method proposed by the Cochrane EPOC group regarding randomized study designs, non-randomised controlled trials controlled before and after studies and interrupted time series will be followed. In addition, we will also include cohort, case–control studies, and relevant non-comparative publications such as case reports. We will categorize and analyse the review findings according to the study design employed, the study quality (low- versus high-quality studies) and the reported types of implementation in the primary studies. We will present the results of studies in a tabular form.
Discussion
Overall, the systematic review aims to identify, assess and synthesize the evidence to underpin the implementation of lean activities in health care settings as defined in this protocol. As a result, the review will provide an evidence base for the effectiveness of lean and implementation methodologies reported in health care.
Systematic review registration
PROSPERO CRD42014008853
In their 2005 study, Gross and Taylor found that more than a third of records retrieved by keyword searches would be lost without subject headings. A review of the literature since then shows that numerous studies, in various disciplines, have found that a quarter to a third of records returned in a keyword search would be lost without controlled vocabulary. Other writers, though, have continued to suggest that controlled vocabulary be discontinued. Addressing criticisms of the Gross/Taylor study, this study replicates the search process in the same online catalog, but after the addition of automated enriched metadata such as tables of contents and summaries. The proportion of results that would be lost remains high.
We frequently fail to identify articles relevant to the subject of acute kidney injury (AKI) when searching the large bibliographic databases such as PubMed, Ovid Medline or Embase. To address this issue, we used computer automation to create information search filters to better identify articles relevant to AKI in these databases.
We first manually reviewed a sample of 22 992 full-text articles and used prespecified criteria to determine whether each article contained AKI content or not. In the development phase (two-thirds of the sample), we developed and tested the performance of >1.3-million unique filters. Filters with high sensitivity and high specificity for the identification of AKI articles were then retested in the validation phase (remaining third of the sample).
We succeeded in developing and validating high-performance AKI search filters for each bibliographic database with sensitivities and specificities in excess of 90%. Filters optimized for sensitivity reached at least 97.2% sensitivity, and filters optimized for specificity reached at least 99.5% specificity. The filters were complex; for example one PubMed filter included >140 terms used in combination, including 'acute kidney injury', 'tubular necrosis', 'azotemia' and 'ischemic injury'. In proof-of-concept searches, physicians found more articles relevant to topics in AKI with the use of the filters.
PubMed, Ovid Medline and Embase can be filtered for articles relevant to AKI in a reliable manner. These high-performance information filters are now available online and can be used to better identify AKI content in large bibliographic databases.
Purpose
The purpose of this paper is to present an overview of the current practices in “corporate-startup collaboration” and “Open Innovation” (OI) in Europe. OI has increasingly become mainstream. A growing number of European corporates are adopting OI approaches to innovate and benefit from a more agile business environment. As Henry Chesbrough – the father of OI – finds out, there is “no single best model for engagement”. It highly depends on the goals that companies want to achieve. Models and approaches of corporate-startup collaboration are continuously evolving. A study of the variety of their effective-implementations in a real business context is therefore beneficial.
Design/methodology/approach
For the purpose of this research, the authors analyzed the European corporates that are considered as “innovation leaders” according to “SEP Europe’s Corporate Startup Stars” annual ranking. According to experts’ evaluations, these companies represent the most advanced case studies in open innovation. The paper analyses the experience of 31 European large corporates implementing effective corporate-startup collaboration. The research approach is exploratory and descriptive.
Findings
By adopting a practitioner-oriented perspective, the authors contribute to shed new light on how European corporates adopt OI and internalize arising innovations across organizational boundaries. Six key areas of OI activities have been identified and compared based on required resources’ commitment. Nearly all of the corporates have implemented low-commitment strategies such as organizing one-off startup events and/or sharing free resources with startups. By contrast, only a limited number of corporates engaged actively through acquisitions (M&A), which requires the highest level of commitment. Startup procurement and investments seem to be the most effective approaches to startup-corporate collaboration, while corporate accelerators and innovation outposts are adopted by only nearly half of the companies considered.
Research limitations/implications
Although the research is not a comprehensive survey, it is useful to identify current and future trends of successful corporate-startup collaboration as well as best practices by European leading companies working at the forefront of OI.
Practical implications
This study provides evidence of the main trends in corporate-startup collaborations, both opening up their innovation processes for mutual benefits. The results have important implications both for corporates and policy makers since the study also highlights the main barriers that hinder successful corporate-startup collaborations. Although many of the analyzed corporates report to have introduced “startup-friendly procedures” – including shortening payments times, simplification of vendor registration and qualification process – the vast majority of companies still need to be educated about the opportunities and benefits arising from Open Innovation (OI). This is particularly true for mid-size companies and small and medium-sized companies that based on some preliminary evidences have not yet fully engaged in open innovation due to limited resources and lack of ability to understand the disruption threats posed by recent technology and market evolution.
Originality/value
To date, there is little evidence on current practices of “Open Innovation” and “corporate-startup collaboration” in Europe. Only recently, large European corporations have concretely started to engage with startups. This paper attempts to shed new light on this so-far under-explored issue.
With open innovation gaining popularity, the question is how firms view its conceptualisation. This is of particular interest for those national economies that are patchy and consisting largely of small and medium-sized enterprises, as in Scotland. To solicit views of Scottish firms a focus group was organised centred on core themes of open innovation. Interviews with Scottish Innovation Centres complemented the focus group. The outcomes suggest that canonical views on ‘open innovation’ prevail, particularly for collaboration, even though its opportunities are well-recognised. It also turns out that some Scottish companies hold myopic views on innovation, which could be an explanatory factor for the oft-discussed innovation gap in the United Kingdom. Most interestingly, our study also reveals the concept of open innovation is not always understood for what it covers; it is recommended that the term ‘open innovation’ is redefined as ‘open collaboration’ to better reflect its nature.
JEL Codes: O32
Client preferences in psychotherapy reflect specific conditions and activities that clients desire in their treatment, with increasing evidence pointing to preference accommodation as facilitating psychotherapy outcomes. This updated meta‐analysis establishes the magnitude of the effect of client preference accommodation in psychotherapy. Based on data from 53 studies and over 16,000 clients, preference accommodation was associated with fewer treatment dropouts (OR = 1.79) and more positive treatment outcomes (d = 0.28) than providing client with a nonpreferred treatment or psychotherapy condition. The preference effect was moderated by study design, timing and type of outcome measurement, and client diagnosis. It was not moderated by year of publication, treatment duration, preference type, treatment options, client age, client gender, client ethnicity, or client years of education. The authors provide a case example of preference accommodation and practice recommendations for working with client preferences.
Objective:
To compare and contrast different methods of qualitative evidence synthesis (QES) against criteria identified from the literature and to map their attributes to inform selection of the most appropriate QES method to answer research questions addressed by qualitative research.
Study design and setting:
Electronic databases, citation searching and a study register were used to identify studies reporting QES methods. Attributes compiled from 26 methodological papers (2001-2014) were used as a framework for data extraction. Data were extracted into summary tables by one reviewer and then considered within the author team.
Results:
We identified seven considerations determining choice of methods from the methodological literature, encapsulated within the mnemonic RETREAT (Review question - Epistemology - Time/Timescale - Resources - Expertise - Audience and purpose - Type of Data). We mapped 15 different published QES methods against these seven criteria. The final framework focuses on stand-alone QES methods but may also hold potential when integrating quantitative and qualitative data.
Conclusion:
These findings offer a contemporary perspective as a conceptual basis for future empirical investigation of the advantages and disadvantages of different methods of QES. It is hoped that this will inform appropriate selection of QES approaches.
The concept of lean product development has attracted the attention of many scholars since its inception in the 1990s derived from practices at Toyota Motor Company. Key to this approach to new product development (NPD) are a few methods derived from lean production as well as longer established practices such as concurrent engineering. This makes one wonder whether lean product development is a new practice, a new method or an encapsulation of already existing methods at the time; this quest for the roots and tenets of lean product development, also in comparison with other methods for NPD, is the focus of this paper. This journey takes this propositional paper not only to the roots of lean product development and the context of its era of conception, but also to what this concept adds to other extant methods for NPD. In particular, this comparison draws out that other methods are trying to achieve the same objectives: the creation of products and services with value to the customer, the reduction of time-to-market and the efficient use of resources. This inference implies that managers of new product (and service) development can choose from a wider pallet of methods and approaches to enhance the performance of R&D and to connect better to manufacturing (including supply chains). Inevitably, this has implications for research on (lean) product and service development; hence, this paper sets out a research agenda based on the deliberations and gaps that have been uncovered in the discourse.
Some of the most important decisions that a researcher will make when conducting a meta-analysis are decisions about the search strategies and inclusion/exclusion criteria. Decisions regarding inclusion/exclusion criteria serve to define the scope of a meta-analysis and search strategy decisions can have a large impact on how well the results of a meta-analysis actually represent the existing body of literature. In this article, we provide descriptions and recommendations for performing searches and making inclusion/exclusion decisions. We also provide a review of 65 meta-analyses of psychotherapy versus pharmacotherapy in order to offer frequency data on the use of various search strategies and inclusion/exclusion decisions in the field.
Background:
Qualitative research in dementia improves understanding of the experience of people affected by dementia. Searching databases for qualitative studies is problematic. Qualitative-specific search strategies might help with locating studies.
Objective:
To examine the effectiveness (sensitivity and precision) of 5 qualitative strategies on locating qualitative research studies in dementia in 4 major databases (MEDLINE, EMBASE, PsycINFO, and CINAHL).
Methods:
Qualitative dementia studies were checked for inclusion on MEDLINE, EMBASE, PsycINFO, and CINAHL. Five qualitative search strategies (subject headings, simple free-text terms, complex free-text terms, and 2 broad-based strategies) were tested for study retrieval. Specificity, precision and number needed to read were calculated.
Results:
Two hundred fourteen qualitative studies in dementia were included. PsycINFO and CINAHL held the most qualitative studies out the 4 databases studied (N = 171 and 166, respectively) and both held unique records (N = 14 and 7, respectively). The controlled vocabulary strategy in CINAHL returned 96% (N = 192) of studies held; by contrast, controlled vocabulary in PsycINFO returned 7% (N = 13) of studies held. The broad-based strategies returned more studies (93-99%) than the other free-text strategies (22-82%). Precision ranged from 0.061 to 0.004 resulting in a number needed to read to obtain 1 relevant study ranging from 16 (simple free-text search in CINAHL) to 239 (broad-based search in EMBASE).
Conclusion:
Qualitative search strategies using 3 broad terms were more sensitive than long complex searches. The controlled vocabulary for qualitative research in CINAHL was particularly effective. Furthermore, results indicate that MEDLINE and EMBASE offer little benefit for locating qualitative dementia research if CINAHL and PSYCINFO are also searched.
Introduction. It is argued that the actual elements of typical browsing episodes have not been well captured by common approaches to the concept to date. Method. Empirical research results reported by previous researchers are presented and closely analysed. Analysis. Based on the issues raised by the above research review, the components of browsing are closely analysed and developed. Browsing is seen to consist of a series of four steps, iterated indefinitely until the end of a browsing episode: 1) glimpsing a field of vision, 2) selecting or sampling a physical or informational object within the field of vision, 3) examining the object, 4) acquiring the object ( conceptually and/or physically) or abandoning it. Not all of these elements need be present in every browsing episode, though multiple glimpses are seen to be the minimum to constitute the act. Results. This concept of browsing is then shown to have persuasive support in the psychological and anthropological literature, where research on visual search, curiosity and exploratory behaviour all find harmony with this perspective. Conclusions. It is argued that this conception of browsing is closer to real human behaviour than other approaches. Implications for better information system design are developed.
Here I examine each of the major issues raised by Priem and Butler (this issue) about my 1991 article and subsequent resource-based research. While it turns out that Priem and Butler's direct criticisms of the 1991 article are unfounded, they do remind resource-based researchers of some important requirements of this kind of research. I also discuss some important issues not raised by Priem and Butler - the resolutions of which will be necessary if a more complete resource-based theory of strategic advantage is to be developed.
Research indicates that increasing teacher-directed opportunities to respond (TD-OTR) positively impacts student outcomes. Prior reviews of the empirical literature focused on outcomes for students with emotional behavioral disorders or on TD-OTRs as one of many classroom-management practices; however, prior reviews did not examine effects of TD-OTRs solely within the class-wide context. For the present review, we (a) examined class-wide TD-OTR research (i.e., screened a total of 527 unique abstracts and identified, reviewed, and coded 15 empirical studies); (b) summarized the effects of class-wide TD-OTRs on student behavioral and academic outcomes, including differential impacts by modality; and (c) described the rates of TD-OTRs documented in the literature. Results are consistent with prior reviews, supporting positive behavioral and academic student outcomes when class-wide TD-OTRs are increased, and extend the literature by identifying differential outcomes by modality and describing observed and desired rates of TD-OTR delivery.
Purpose
– Maintaining and improving productivity of product design and engineering processes has been a paramount challenge for design-driven companies, which are characterised a high degree of development of products and processes in order to meet particular customer requirements. Literature on this issue is fragmented and dispersed and a concise and systematic overview is lacking. Hence, it remains unclear, which methods are applicable for design-driven companies to improve the productivity of limitedly available engineering resources (a challenge companies and nations face currently). The purpose of this paper is to develop such a systematic overview.
Design/methodology/approach
– An unusual approach was utilised by combining the outcomes from a systematic literature review and the results of a Delphi study. From both research approaches complementary and overlapping methods for improving the productivity of product design and engineering processes could be drawn.
Findings
– The unique systematic overview presents 27 methods to increase the productivity, effectiveness and efficiency of product design and engineering processes of design-driven companies. Moreover, the study finds that methods for improving effectiveness are preferred over methods for improving efficiency and that limitations with regard to the availability of resources are often not considered.
Research limitations/implications
– During the development of the systematic overview, a lack of empirical evidence to assess the actual impact of productivity improvement methods was discovered. This shortcoming demonstrates the need for more conceptual and empirical work in this domain. More studies are needed to test and confirm the usefulness of the proposed methods.
Practical implications
– Nevertheless, design-driven companies, which struggle to increase the productivity of their product design and engineering processes, can systematically select improvement methods from the overview according to their impact on productivity, effectiveness and efficiency. However, companies should keep in mind, whether effectiveness of product design and engineering can really be increased without considering limitations in engineering resources.
Originality/value
– Therefore, the systematic overview provides a valuable map of the unexplored territory of productivity improvement methods for product design and engineering for both practitioners and researchers. For the latter ones, it creates directions for empirical investigations in order to explore and to compare methods for the improvement of productivity of product design and engineering processes.
The purpose of this paper is to identify the benefits of integrated management systems by comparing them with the benefits obtained through the individual implementation of ISO 9001 and ISO 14001 standards. The methodology used is a literature review based on an electronic search in the Web of Science, ScienceDirect, Scopus and Emerald databases. Findings show that although some benefits are common regardless the system management type, the benefits obtained with integration are greater than considering management systems separately because of the wider scope considered in integration. This is one of the first papers, to the best of our knowledge, to compare benefits from the two management systems standards when implemented separately and when integrated. In addition, some ideas are proposed for consideration in future research on the internalization of management systems and selection effect.
The literature review is an established research genre in many academic disciplines, including the IS discipline. Although there is consensus that systematic literature reviews should be rigorous, there are only few instructional texts for compiling a solid literature review, at least with regard to the IS discipline. In response to this shortage of guides, the overall goal of this tutorial is to provide practical guidance for both students and researchers in the IS community who want to methodologically conduct qualitative literature reviews. Our tutorial differs from other instructional texts in two regards: (1) In contrast to most textbooks, we do not only cover the task of literature search and synthesis but also the challenging tasks of framing the literature review, interpreting research findings and proposing research paths. (2) We draw on other texts that provide guidelines for writing literature reviews in the IS discipline but we make strong use of examples of published literature reviews. We use an integrated example of a literature review, which guides the reader through the overall process of compiling a literature review.
To determine whether librarian and information specialist authorship was associated with better reported systematic review (SR) search quality.
SRs from high-impact general internal medicine journals were reviewed for search quality characteristics and reporting quality by independent reviewers using three instruments, including a checklist of Institute of Medicine Recommended Standards for the Search Process and a scored modification of the Peer Review of Electronic Search Strategies instrument.
The level of librarian and information specialist participation was significantly associated with search reproducibility from reported search strategies (Χ(2) = 23.5; P < 0.0001). Librarian co-authored SRs had significantly higher odds of meeting 8 of 13 analyzed search standards than those with no librarian participation and six more than those with mentioned librarian participation. One-way ANOVA showed that differences in total search quality scores between all three groups were statistically significant (F2,267 = 10.1233; P < 0.0001).
Problems remain with SR search quality and reporting. SRs with librarian or information specialist co-authors are correlated with significantly higher quality reported search strategies. To minimize bias in SRs, authors and editors could encourage librarian engagement in SRs including authorship as a potential way to help improve documentation of the search strategy.
Copyright © 2015 Elsevier Inc. All rights reserved.
OVERVIEW: The term “open innovation” was introduced in my 2003 book, which outlined a new model for industrial innovation. Since that time, the concept has been adopted by hundreds of academic articles and been incorporated into the innovation practices of a similarly large number of companies. At the editors’ invitation, this article reviews this recent history and offers a perspective on where open innovation is going in the future.
There is ongoing interest in including grey literature in systematic reviews. Including grey literature can broaden the scope to more relevant studies, thereby providing a more complete view of available evidence. Searching for grey literature can be challenging despite greater access through the Internet, search engines and online bibliographic databases. There are a number of publications that list sources for finding grey literature in systematic reviews. However, there is scant information about how searches for grey literature are executed and how it is included in the review process. This level of detail is important to ensure that reviews follow explicit methodology to be systematic, transparent and reproducible. The purpose of this paper is to provide a detailed account of one systematic review team's experience in searching for grey literature and including it throughout the review. We provide a brief overview of grey literature before describing our search and review approach. We also discuss the benefits and challenges of including grey literature in our systematic review, as well as the strengths and limitations to our approach. Detailed information about incorporating grey literature in reviews is important in advancing methodology as review teams adapt and build upon the approaches described. Copyright © 2013 John Wiley & Sons, Ltd.
Copyright © 2013 John Wiley & Sons, Ltd.
Systematic reviews typically require searching for, retrieving, and screening a large volume of literature, yet little guidance is available on how to manage this volume.
We detail methods used to search for and manage the yield of relevant citations for a mixed-methods, mixed research synthesis study focused on the intersection between family life and childhood chronic physical conditions.
We designed inclusive search strings and searched nine bibliographic databases to identify relevant research regardless of methodological origin. We customized searches to individual databases, developed work-arounds for transferring large volumes of citations and eliminating duplicate citations using reference management software, and used this software as a portal to select citations for inclusion or exclusion. We identified 67,555 citations, retrieved and screened 3,617 reports, and selected 800 reports for inclusion.
Systematic reviews require search procedures to allow consistent and comprehensive approaches and the ability to work around technical obstacles.