Table 1 - uploaded by Apisit Kositchaiyong
Content may be subject to copyright.
Source publication
Summary Quantitative and qualitative scientific evaluations of the research performance of Thai researchers were carried out with
regards to their international publications and citations in four different subject categories; namely Clinical Medicine,
Chemistry, Material Sciences, and Engineering. This work used citations to publications of Thai re...
Contexts in source publication
Context 1
... citation positions were classified in sections, such as Introduction, Experimental, Results & Discussion, and Conclusion, while the significance levels of the citations considered the meanings of the citations. The number of times cited and the positions and sub-positions of citations for each citing article were considered and recorded separately using a data sheet, which is shown in Table 1. ...
Context 2
... this article, the number of times cited (quantity), positions and sub-positions of citations were considered and recorded separately using a data sheet, shown in Table 1. A number of possible contents and meanings of article citations were designed through our experience. ...
Context 3
... citation behaviors were also considered in terms of exact meanings (quality) of the cited phrases, sentences, and paragraphs to which the cited article by Thai researchers was referred. Table 1 gives general meanings of citations in each sub-position, and examples of cited information. ...
Similar publications
Sustainable entrepreneurship emerges as one of the economically viable alternatives, with products and processes geared to the creation of solutions allied to social and environmental responsibility. The behavior of this literature arouses increasing interest. Thus, the objective of this study was to analyze the scientific production on sustainable...
The main contribution of this work is an analysis of recently appeared agent-based
modeling (ABM) approaches to study the implications of climate change on tourism
dynamics. This analysis is motivated by criticism on other studies investigating the impacts
on (winter) tourism for being primarily supply side (i.e. the destinations) oriented,
while n...
Citations
... In the evaluation of citations, multiple indicators such as article impact factors, position impact factors, and journal impact factors are proposed. Using multiple indicators for evaluation, especially considering different weights, should be given to citations in different positions of the article [23]. Moreover, the criteria and focus of evaluation are different according to specialty. ...
Graduate education is the main way to train high-level innovative talents, the basic layout to cope with the global talent competition, and the important cornerstone for implementing the innovation-driven development strategy and building an innovation-driven country. Therefore, graduate education is of great remarkably to the development of national education. As an important manifestation of graduate education, the quality of a graduate thesis should receive more attention. It is conducive to promoting the quality of graduates by supervising and examining the quality of the graduate thesis. For this purpose, this work is based on text mining, expert interviews, and questionnaire surveys to obtain the factors influencing the quality of a graduate thesis first. Then, through three rounds of expert consultation, a multidimensional evaluation indicator system for the graduate thesis quality is built. Furthermore, probabilistic linguistic term sets (PLTSs) are utilized to obtain the initial evaluation information and apply the stepwise weight assessment ratio analysis method to determine the weights of attributes. In the ensuing step, the novel multi-attribute border approximation area comparison based on the PLTS method is established. Finally, the proposed method is employed in a case study concerning the quality evaluation of a graduate thesis and the effectiveness of this approach is further illustrated.
... The method of comparing model outputs is beneficial for determining the accuracy of different models, but it is only applicable to certain models and requires considerable time. In addition, since Garfield proposed the impact factor concept in 1955, this metric has been widely used to evaluate the academic impact of journals, papers, researchers, and institutions, among other entities (Garfield 1955(Garfield , 1972Sombatsompop et al. 2006;Pan and Fortunato 2014;Bai et al. 2020), even if it is disputed in the context of the reliability of the source data, the meaning of the rankings, and the misuse in some evaluations of research outputs or researchers (Smeyers and Burbules 2011). A quantitative measure of academic impact can also provide users with an alternative guide for model evaluation. ...
Geographic simulation models can be used to explore and better understand the geographical environment. Recent advances in geographic and socio-environmental research have led to a dramatic increase in the number of models used for this purpose. Some model repositories provide opportunities for users to explore and apply models, but few provide a general evaluation method for assessing the applicability and recognition of models. In this study, an academic impact evaluation method for models is proposed. Five indices are designed based on their pertinence. The analytical hierarchy process is used to calculate the index weights, and the academic impacts of models are quantified with the weighted sum method. The time range is controlled to evaluate the life-term and annual academic impacts of the models. Some models that met the evaluation criteria from different domains are then evaluated. The results show that the academic impact of a model can be quantified with the proposed method, and the major research areas that models impact are identified.
... The journal impact factor (JIF) (Garfield, 1999) is the earliest measurement Garfield (2006) and is now viewed as a well-established indicator of the scientific quality of scientific literature. The JIF method assumes that the articles published in high impact factor journals should be high quality Sombatsompop et al. (2006). One of the drawbacks of the JIF method is that a journal's high impact factor may not result from the citations of all articles; instead, it may merely be attributed to a small number of highly cited articles (Campbell, 2008;Colquhoun, 2003;Garfield, 2001). ...
Interest in assessing research impacts is increasing due to its importance for informing actions and funding allocation decisions. The level of innovation (also called “innovation degree” in the following article), one of the most essential factors that affect scientific literature’s impact, has also received increasing attention. However, current studies mainly focus on the overall innovation degree of scientific literature at the macro level, while ignoring the innovation degree of a specific knowledge element (KE), such as the method knowledge element (MKE). A macro level view causes difficulties in identifying which part of the scientific literature contains the innovations. To bridge this gap, a more fine-grained evaluation of academic papers is urgent. The fine-grained evaluation method can ensure the quality of a paper before being published and identify useful knowledge content in a paper for academic users. Different KEs can be used to perform the fine-grained evaluation. However, MKEs are usually considered as one of the most essential knowledge elements among all KEs. Therefore, this study proposes a framework to measure the innovation degree of method knowledge elements (MIDMKE) in scientific literature. In this framework, we first extract the MKEs using a rule-based approach and generate a cloud drop for each MKE using the biterm topic model (BTM). The generated cloud drop is then used to create a method knowledge cloud (MKC) for each MKE. Finally, we calculate the innovation score of a MKE based on the similarity between it and other MKEs of its type. Our empirical study on a China National Knowledge Infrastructure (CNKI) academic literature dataset shows the proposed approach can measure the innovation of MKEs in scientific literature effectively. Our proposed method is useful for both reviewers and funding agencies to assess the quality of academic papers. The dataset, the code for implementation the algorithms, and the complete experiment results will be released at: https://github.com/haihua0913/midmke.
... For citation location, where the reference is cited was proven to have uneven distribution (Bertin et al., 2015;Ding et al., 2013;Hu et al., 2013) but sometimes have specific differences between disciplines . Sombatsompop et al. (2006) and Lu et al. (2017) applied citation location to scientific evaluation. Thijs (2020) also found that there are corresponding section content similarities between the citing and the cited document. ...
Author bibliographic coupling analysis (ABCA) is an extension of bibliographic coupling theory at the author level and is widely used in mapping intellectual structures and scholarly communities. However, the assumption of equal citations and the complete dependence on explicit counts may affect its effectiveness in today’s complex context of discipline development. This research proposes a new approach that uses multiple full-text data to improve ABCA called enhanced author bibliographic coupling analysis. By mining the semantic and syntactic information of citations, the new approach considers more diverse dimensions as the basis of author bibliographic coupling strength. Comparative empirical research was then conducted in the field of oncology. The results show that the new approach can more accurately reveal the relevant relations between authors and map a more detailed domain intellectual structure.
... Although there have been few studies evaluating the research performance of ASEAN in various fields (Sombatsompop et al., 2011;Kumar, Rohani & Ratnavelku, 2014;Payumo & Sutton, 2015) and countries (e.g. Rana (2012) and Prathap (2018) on Singapore, Kumar and Jan (2013) and Tahira et al. (2016Tahira et al. ( , 2018 on Malaysia, Maula, Fuad and Utarini (2018) on Indonesia, Sombatsompop et al. (2006) on Thailand and Vinluan (2012) and Navarrete and Asio (2014) on Philippines), it appears there has been no empirical analysis of all ASEAN members at the meso-level that engages in research performance assessment. The review of previous research revealed a gap in the literature regarding research activities of the top ASEAN research institution and benchmarking their performance based on various metrics of research productivity, impact, excellence and collaboration. ...
The ASEAN University Network (AUN) is a South East Asian (SEA) association of institutions founded in 1995 and currently has 30 members from 13 countries. This study investigates research performance of the AUN member universities over a five-year time span (2013-2017) and benchmarks their research productivity and impact, research excellence, innovation, collaboration and competencies, employing multidimensional indicators and established bibliometric methods. Data were obtained from Elsevier’s Scopus and analysed utilizing SciVal. Findings show that two leading Singaporean universities accounted for almost one third of all AUN members’ outputs, followed by four Malaysian universities. Singaporean universities also garnered the highest amount of citations, mean citations per publication, citedness rate, field-weighted citation impact and H5-index. Only 12 universities had relative citation impacts above the expected global average. A total of 999 scientific outputs of the AUN members have been cited 1674 times by the 1550 patents issued by five international patent offices. Most of the AUN members’ outputs were authored jointly by two or more authors (92.48%), while single-authored publications only constituted about 7.52% of all publications. The results revealed that the AUN members published the highest share of collaborative publications in partnership with the researchers affiliated with the institutions from Asia Pacific, Europe and North America. Research competencies of each of the AUN members were studied and visualized using co-citation analysis of their scientific output.
... A selection of 96 research articles and reviews referencing articles authored by either Bliss or Salkovskis were chosen for study. Previous research had found that references cited on more than one occasion within a paper indicated greater influence of the reference to the citing paper (McCain and Turner 1989;Peritz 1983;Safer and Tang 2009;Sombatsompop et al. 2006;Tang and Safer 2008), therefore we preferentially selected papers with more than one citation occasion to increase the chances of including more papers where the reference was of high importance. Our selection of papers included 19 % of citing research articles with three or more citation occasions and 52 % of citing reviews with two or more citation occasions. ...
There is growing interest in assessing the societal impacts of research such as informing health policies and clinical practice, and contributing to improved health. Bibliometric approaches have long been used to assess knowledge outputs, but can they also help evaluate societal impacts? We aimed to see how far the societal impacts could be traced by identifying key research articles in the psychiatry/neuroscience area and exploring their societal impact through analysing several generations of citing papers. Informed by a literature review of citation categorisation, we developed a prototype template to qualitatively assess a reference’s importance to the citing paper and tested it on 96 papers. We refined the template for a pilot study to assess the importance of citations, including self-cites, to four key research articles. We then similarly assessed citations to those citing papers for which the key article was Central i.e. it was very important to the message of the citing article. We applied a filter of three or more citation occasions in order to focus on the citing articles where the reference was most likely to be Central. We found the reference was Central for 4.4 % of citing research articles overall and ten times more frequently if the article contained three or more citation occasions. We created a citation stream of influence for each key paper across up to five generations of citations. We searched the Web of Science for citations to all Central papers and identified societal impacts, including international clinical guidelines citing papers across the generations.
Electronic supplementary material
The online version of this article (doi:10.1007/s11192-016-1895-4) contains supplementary material, which is available to authorized users.
... Thailand's National Science and Technology Development Agency (NSTDA) in a recent open letter bemoaned the Thai government's stance on scientific research. They state that Thailand's scientific research is going downhill and that the government is only concerned with ways to solve problems in the short term and focuses too much on related business opportunities (Online Reporters, 2013). The result is that Thailand's skills and competitiveness have suffered. ...
It was Arthur Wellesley, the Duke of
Wellington, who was attributed with the phrase,
‘Publish and be damned’ when confronted with
the threat of his letters being published in the
memoirs of Harriette Wilson. The plight of
budding teachers, lecturers and academics has
never been so intense as it is now, due to the
pressure being exerted by educational institutions
around the world to have academic research
papers published in quality journals in order to
increase the establishment’s standing in the
country and world rankings. English is the lingua
franca for scholastic publication (Curry & Lillis,
2004), so it is quite possible that in today’s
academic climate, you and your career will be
damned if you don’t publish in a premiere English
language journal.
... We identified various papers that analysed how far objective aspects of a research paper have been shown to relate to expert or author opinion of importance. Characteristics repeatedly found to be associated with expert or author opinion of the level of importance of a citation to the cited paper include the location of a citation and its frequency within the citing paper (Cano 1989; Peritz 1983; Safer and Tang 2009; Sombatsompop et al. 2006; Tang and Safer 2008). Characteristics that have been found to have some level of prediction of importance include naming of the first author (Paul 2000) and length of the citation (Tang and Safer 2008). ...
There is an increasing need both to understand the translation of biomedical research into improved healthcare and to assess the range of wider impacts from health research such as improved health policies, health practices and healthcare. Conducting such assessments is complex and new methods are being sought. Our new approach involves several steps. First, we developed a qualitative citation analysis technique to apply to biomedical research in order to assess the contribution that individual papers made to further research. Second, using this method, we then proposed to trace the citations to the original research through a series of generations of citing papers. Third, we aimed eventually to assess the wider impacts of the various generations. This article describes our comprehensive literature search to inform the new technique. We searched various databases, specific bibliometrics journals and the bibliographies of key papers. After excluding irrelevant papers we reviewed those remaining for either general or specific details that could inform development of our new technique. Various characteristics of citations were identified that had been found to predict their importance to the citing paper including the citation's location; number of citation occasions and whether the author(s) of the cited paper were named within the citing paper. We combined these objective characteristics with subjective approaches also identified from the literature search to develop a citation categorisation technique that would allow us to achieve the first of the steps above, i.e., being able routinely to assess the contribution that individual papers make to further research.
... As university ranking activities have been consistently carried out worldwide, questions about the social benefits contributed by academia in universities have frequently been tackled (López-Marơnez and Rocha-Lackiz 2001). More accurate assessments would be obtained if the academic ranking were carried out in discipline levels (Norris and Oppenheim 2010;Rao and Srivastava 2010) and citation qualities and significance of cited publications were taken into account (Sombatsompop et al. 2006). ...
The research performances for Association of Southeast Asian Nations (ASEAN) countries and universities in the energy and fuel field were assessed using the standard bibliometric indicators proposed by the Centre for Science and Technology, University of Leiden, The Netherlands; and h-index, all the data being retrieved from the Web of Science (WoS) database during 2003-2009. The results suggested that Thailand had the highest number of published articles while Singapore was positioned first as concerns total citations and citations per publication. All the selected ASEAN countries seemed to publish their research works in a similar group of energy and fuel journals, while 15-50% of the published articles for the ASEAN universities had never been cited after publication. The research performance of Singapore was found to exceed the worldwide average reference while those of Malaysia, Thailand and Vietnam were just about average; those for the rest of the ASEAN countries were positioned below. At the university level, Nanyang Technology University (Singapore), National University of Singapore (Singapore) and King Mongkut's University of Technology Thonburi (Thailand) were the top three ASEAN universities with the highest publication volumes, total citations and h-index values. The variations in h-index values for ASEAN universities most correlated with those in total citations. There was no apparent relationship between the h-index and ratio of citation/article to average field citation score (CPP/FCSm) values observed in this work. In conclusion, the research performances of ASEAN countries and their selected universities have now been revealed and discussed for the first time in relation to worldwide references.
... This is a little unfair if the self-citations are wholly justified. Some studies have also looked at the positions of citations in research articles 8 . The most crucial citations tend to occur in the methods section, and also in the discussion, provided it is not simply a list of comparisons with other studies. ...
Crude publication statistics such as publication counts and impact factors are routinely being employed to
assess individuals and institutions. Although they can play a role in an approximate preliminary assessment, using them
for anything more is inappropriate due to their over-simplicity and ease of manipulation. Furthermore, it is argued that
rewarding scientists for achieving high scores in such number-based evaluations ultimately leads to a slowing of scientific
progress. Suggestions are given on how reliance on statistics can be reduced and their manipulation discouraged.
