• Home
  • ETH Zurich
  • Department of Humanities, Social and Political Sciences
  • Hans-Dieter Daniel
Hans-Dieter Daniel

Hans-Dieter Daniel
ETH Zurich | ETH Zürich · Department of Humanities, Social and Political Sciences

About

166
Publications
52,730
Reads
How we measure 'reads'
A 'read' is counted each time someone views a publication summary (such as the title, abstract, and list of authors), clicks on a figure, or views or downloads the full-text. Learn more
7,073
Citations

Publications

Publications (166)
Book
Full-text available
Gute Führung führt zu besseren Bildungsergebnissen, die wiederum spürbare Auswirkungen auf das wirtschaftliche Wachstum und den Wohlstand einer Gesellschaft haben. Diese Zusammenhänge sind empirisch nachgewiesen, und dennoch sind Führungskräfte in deutschen Bildungseinrichtungen häufig nicht oder nicht ausreichend für diese wichtige Aufgabe qualifi...
Book
Full-text available
Der sich immer schneller vollziehende Wandel in der globalen Welt bedingt die Bewältigung drängender Herausforderungen, die nur durch gleichzeitiges und gleichberechtigtes Umsetzen von umweltbezogenen, wirtschaftlichen und sozialen Zielen erreicht werden kann. In Deutschland firmiert dieses Denken unter dem Konzept der „Bildung für nachhaltige Entw...
Book
Full-text available
Ist die Demokratie in Deutschland in Gefahr? Welchen Beitrag kann Bildung leisten, um sie zu stärken? Eine demokratische Gesellschaft setzt voraus, dass ihre Bürgerinnen und Bürger von klein auf lernen, andere Meinungen zu respektieren, Konflikte konstruktiv zu lösen und sich aktiv in gemeinschaftliche Willensbildungsprozesse einzubringen. Der Akti...
Article
Full-text available
With the growing complexity of societal and scientific problems, research centers have emerged to facilitate the conduct of research beyond disciplinary and institutional boundaries. While they have become firmly established in the global university landscape, research centers raise some critical questions for research evaluation. Existing evaluati...
Book
Full-text available
Gibt es in Deutschland regionale Unterschiede in den Bildungschancen im Verhältnis Stadt – Land und hat der Wohnort Einfluss auf die gesellschaftliche und berufliche Teilhabe der Menschen? Diese Frage wird in den Medien immer wieder diskutiert. Der Aktionsrat Bildung analysiert im aktuellen Gutachten die empirische Datenlage und geht der Frage nach...
Article
Full-text available
Regarding evaluation of individual researchers, the bibliometric indicators approach has been increasingly discussed recently, but there are some problems involved with it: construct definition, measurement errors, level of scale, dimensionality, normalization. Based on a psychometric model, the Rasch model, we developed a measuring scale for the t...
Book
Full-text available
Die sich derzeit vollziehende digitale Transformation durchdringt nahezu alle Lebensbereiche. Der souveräne Umgang mit digitalen Medien wird damit zur unumgänglichen Grundlage aller Bildungsprozesse und zur Voraussetzung dafür, die nachwachsende Generation auf die sich wandelnden Anforderungen in Beruf und Gesellschaft vorzubereiten. In seinem aktu...
Conference Paper
Full-text available
Competitive research grants become more and more important in the careers of young scholars. If grants are making careers, the decision for the grant winners is important and needs to be fair, consistent and transparent. In this research in progress paper, we present evaluation criteria for research proposals from early career researchers in the hu...
Article
Full-text available
In recent years, scientometrics has devoted increasing attention to the question of measurement of productivity and efficiency in research. In econometrics, the question is usually examined using data envelopment analysis. Alternatively, in this paper we propose using a statistical approach, Bayesian stochastic frontier analysis (B-SFA), that expli...
Article
Scientific journals publish an increasing number of articles every year. To steer readers' attention to the most important papers, journals use several techniques (e.g., lead paper). Angewandte Chemie International Edition (AC), a leading international journal in chemistry, signals high-quality papers through designating them as a "very important p...
Book
Full-text available
Die jüngsten Migrations- und Wanderungsbewegungen stellen Deutschland vor große Herausforderungen, zu denen auch die erfolgreiche Integration von Personen mit Migrationshintergrund und Flüchtlingen in das Bildungssystem gehört. Die unterschiedlichen Motive für die Zuwanderung sind dabei ebenso von Bedeutung wie die damit verbundenen Rechtsansprüche...
Chapter
Full-text available
Research assessments in the humanities are highly controversial. While citation-based research performance indicators are widely used in the natural and life sciences, quantitative measures for research performance meet strong opposition in the humanities. Since there are many problems connected to the use of bibliometrics in the humanities, new ap...
Chapter
Full-text available
The assessment of research performance in the humanities is linked to the question of what humanities scholars perceive as ‘good research’. Even though scholars themselves evaluate research on a daily basis, e.g. while reading other scholars’ research, not much is known about the quality concepts scholars rely on in their judgment of research. This...
Article
Full-text available
Psychometrics questions the use of dichotomous decisions. For these reasons, De Los Reyes and Wang (2012) favour a continuous funding decision system, in which the funded percentage of a requested grant sum is coupled to the ratings that a proposal receives in the ex ante peer evaluation. In contrast to the ‘winner takes all’ philosophy in a dichot...
Book
Full-text available
This book analyses and discusses the recent developments for assessing research quality in the humanities and related fields in the social sciences. Research assessments in the humanities are highly controversial and the evaluation of humanities research is delicate. While citation-based research performance indicators are widely used in the natura...
Article
Full-text available
Even with very well-documented rankings of universities, it is difficult for an individual university to reconstruct its position in the ranking. What is the reason behind whether a university places higher or lower in the ranking? Taking the example of ETH Zurich, the aim of this communication is to reconstruct how the high position of ETHZ (in Eu...
Book
Full-text available
n einer zunehmend komplexen, globalisierten Gesellschaft steht das Bildungssystem vor der Aufgabe, nicht mehr nur bloßes Fachwissen zu vermitteln, sondern auch zu einem flexiblen Umgang mit demselben zu befähigen. Sowohl das Arbeitsleben als auch die gesellschaftlichen Anforderungen stellen den Einzelnen vor die Aufgabe, die eigenen Ziele und Kompe...
Article
Full-text available
The assessment of research performance in the humanities is an intricate and highly discussed topic. Many problems have yet to be solved, foremost the question of the humanities scholars’ acceptance of evaluation tools and procedures. This article presents the results of a project funded by the Rectors’ Conference of the Swiss Universities in which...
Article
Full-text available
It is essential for research funding organizations to ensure both the validity and fairness of the grant approval procedure. The ex-ante peer evaluation (EXANTE) of N = 8,496 grant applications submitted to the Austrian Science Fund from 1999 to 2009 was statistically analyzed. For 1,689 funded research projects an ex-post peer evaluation (EXPOST)...
Article
Full-text available
Considering the complexity of the world problems, it seems evident that they do not fit straightforwardly into a disciplinary framework. In this context, the question arises as to whether and how frequently several disciplines cooperate on research projects. Cross-disciplinary cooperation in research might be difficult for two reasons. On one hand,...
Article
Full-text available
How to assess research quality in the humanities is an intricate question. Despite the recent efforts of many initiatives, the measurement and assessment of research quality still faces strong opposition from humanities scholars, indicating that currently used evaluation schemes and tools are not tailored well enough to humanities disciplines. We h...
Article
Since the 1990s, with the heightened competition and the strong growth of the international higher education market, an increasing number of rankings have been created that measure the scientific performance of an institution based on data. The Leiden Ranking 2011/2012 (LR) was published early in 2012. Starting from Goldstein and Spiegelhalter's (1...
Article
Background. It is often claimed that psychology students’ attitudes towards research methods and statistics affect course enrolment, persistence, achievement, and course climate. However, the inter-institutional variability has been widely neglected in the research on students’ attitudes towards research methods and statistics, but it is important...
Article
Full-text available
This study presents humanities scholars’ conceptions of research and subjective notions of quality in the three disciplines German literature studies, English literature studies, and art history, captured using 21 Repertory Grid interviews. We identified three dimensions that structure the scholars’ conceptions of research: quality, time, and succe...
Article
Full-text available
Starting out from a broad concept of research output, this article looks at the question as to what research outputs can typically be expected from certain disciplines. Based on a secondary analysis of data from final project reports (ex post research evaluation) at the Austrian Science Fund (FWF), Austria's central funding organization for basic r...
Article
Whereas in traditional peer review a few selected researchers (peers) are included in the manuscript review process, public peer review includes both invited reviewers (who write ‘reviewer comments’) and interested members of the scientific community who write comments (‘short comments’). Available to us for this investigation are 390 reviewer comm...
Article
Full-text available
One of the most important weaknesses of the peer review process is that different reviewers' ratings of the same grant proposal typically differ. Studies on the inter-rater reliability of peer reviews mostly report only average values across all submitted proposals. But inter-rater reliabilities can vary depending on the scientific discipline or th...
Article
The journal impact factor (JIF) proposed by Garfield in the year 1955 is one of the most commonly used and prominent citation-based indicators of the performance and significance of a scientific journal. The JIF is simple, reasonable, clearly defined, and comparable over time and, what is more, can be easily calculated from data provided by Thomson...
Article
Full-text available
There is currently no agreed upon standard how to evaluate humanities research. Our article addresses one of the several reasons for this: the missing link between indicators and humanities scholars' notions of quality. We present groups of indicators that are tied to quality criteria put forward by humanities scholars of German literature, English...
Article
Whereas in traditional, closed peer review (CPR) a few, selected scientists (peers) are included in the process of manuscript review, public peer review (PPR) includes, in addition to invited reviewers, a wider circle of scientists who are interested in a manuscript and wish to write a comment on it. In this study, using the data of two comprehensi...
Article
The journal impact factor (JIF) proposed by Garfield in the year 1955 is one of the most prominent and common measures of the prestige, position, and importance of a scientific journal. The JIF may profit from its comprehensibility, robustness, methodological reproducibility, simplicity, and rapid availability, but it is at the expense of serious t...
Article
Full-text available
A number of bibliometric studies point out that citation counts are a function of many variables besides scientific quality. In this paper our aim is to investigate these factors that usually impact the number of citation counts, using an extensive data set from the field of chemistry. The data set contains roughly 2000 manuscripts that were submit...
Article
Full-text available
One of the most frequently voiced criticisms of the peer review process is gender bias. In this study we evaluated the grant peer review process (external reviewers' ratings, and board of trustees' final decision: approval or no approval for funding) at the Austrian Science Fund with respect to gender. The data consisted of 8,496 research proposals...
Chapter
Full-text available
Die Messung von Forschungsleistungen trifft in den Geisteswissenschaften auf grosse Vorbehalte. Einerseits eignen sich die aus den Natur- und Lebenswissenschaften stammenden bibliometrischen Verfahren nur sehr bedingt, um geisteswissenschaftliche Forschungsleistungen sichtbar zu machen, andererseits besteht unter Geisteswissenschaftlern grundsätzli...
Article
Full-text available
Schubert (Scientometrics, 78:559–565, 2009) showed that “a Hirsch-type index can be used for assessing single highly cited publications by calculating the h index of the set of papers citing the work in question” (p. 559). To demonstrate that this single publication h index is a useful yardstick to compare the quality of different publications; the...
Article
Full-text available
  Scientific journals must deal with the following questions concerning the predictive validity of editorial decisions. Is the best scientific work selected from submitted manuscripts? Does selection of the best manuscripts also mean selecting papers that after publication show top citation performance within their fields? Taking the journal Angewa...
Article
Full-text available
This paper presents the first meta-analysis of studies that computed correlations between the h index and variants of the h index (such as the g index; in total 37 different variants) that have been proposed and discussed in the literature. A high correlation between the h index and its variants would indicate that the h index variants hardly provi...
Article
Full-text available
Taking the interactive open access journal Atmospheric Chemistry and Physics as an example, this study examines whether Thomson Reuters, for the Journal Citation Reports, correctly calculates the Journal Impact Factor (JIF) of a journal that publishes several versions of a manuscript within a two-stage publication process. The results of this study...
Article
Full-text available
In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high‐impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal w...
Article
Full-text available
This paper presents the first meta-analysis for the inter-rater reliability (IRR) of journal peer reviews. IRR is defined as the extent to which two or more independent reviews of the same scientific document agree. Altogether, 70 reliability coefficients (Cohen's Kappa, intra-class correlation [ICC], and Pearson product-moment correlation [r]) fro...
Article
This paper investigates the extent to which staff editors’ evaluations of submitted manuscripts—that is, internal evaluations carried out before external peer reviewing—are valid. To answer this question we utilized data on the manuscript reviewing process at the journal Angewandte Chemie International Edition. The results of this study indicate th...
Article
Full-text available
Ratings in journal peer review can be affected by sources of bias. The bias variable investigated here was the information on whether authors had suggested a possible reviewer for their manuscript, and whether the editor had taken up that suggestion or had chosen a reviewer that had not been suggested by the authors. Studies have shown that author-...
Article
Full-text available
The scientific impact of a publication can be determined not only based on the number of times it is cited but also based on the citation speed with which its content is noted by the scientific community. Here we present the citation speed index as a meaningful comple- ment to the h index: whereas for the calculation of the h index the impact of pu...
Article
Full-text available
The h index is a widely used indicator to quantify an individual's scientific research output. But it has been criticized for its insufficient accuracy—the ability to discriminate reliably between meaningful amounts of research output. As a single measure it cannot capture the complete information on the citation distribution over a scientist's pub...
Article
Full-text available
High predictive validity--that is, a strong association between the outcome of peer review (usually, reviewers' ratings) and the scientific quality of a manuscript submitted to a journal (measured as citations of the later published paper)--does not as a rule suffice to demonstrate the usefulness of peer review for the selection of manuscripts. To...
Article
Full-text available
More than 4,500 open access (OA) journals have now become established in science. But doubts exist about the quality of the manuscript selection process for publication in these journals. In this study we investigate the quality of the selection process of an OA journal, taking as an example the journal Atmospheric Chemistry and Physics (ACP). ACP...
Article
If a manuscript meets scientific standards and contributes to the advancement of science, it can be expected that two or more reviewers will agree on its value. Manuscripts are rated reliably when there is a high level of agreement between independent reviewers. This study investigates for the first time whether inter-rater reliability, which is lo...
Article
Full-text available
One of the most frequently raised criticisms of the review process for manuscripts is that the length of time between submission of a manuscript and the editorial decision is overly long. Taking the journal Angewandte Chemie International Edition as an example and based on nearly 2000 manuscripts, the present study examined just how long the peer r...
Article
Full-text available
The scientific quality of a publication can be determined not only based on the number of times it is cited but also based on the speed with which its content is disseminated in the scientific community. In this study we tested whether manuscripts that were accepted by Angewandte Chemie International Edition (one of the prime chemistry journals wor...
Article
Full-text available
In peer review research, no study has been performed to date that has opened the “black box” of manuscript reviewing and dealt with the internal mechanisms of the process. Using as an example the peer review system of Angewandte Chemie International Edition (AC-IE), this study investigates which review requests are assigned by the editors to extern...
Article
Full-text available
Die aus den Natur- und Lebenswissenschaften stammenden bibliometrischen Verfahren eignen sich für die Geistes- und Sozialwissenschaften nur sehr bedingt, um Forschungsleistungen sichtbar zu machen oder zu messen (vgl. Glänzel/Schoepflin 1999; Nederhof 2006; Scheidegger 2007). Deshalb fördert die Rektorenkonferenz der Schweizer Universitäten (CRUS)...
Article
Der SPIEGEL hat 1989 das erste Hochschulranking in Deutschland veröffentlicht. Seitdem sind zahlreiche nationale und internationale Rankings entstanden, die große Beachtung gefunden haben. Allerdings weisen solche Rangordnungen, wenn sie auf Befragungen basieren, eine Reihe von methodischen Problemen auf (Stichprobenfehler, Konsequenzen der Bildung...
Article
Ziel dieses Beitrags ist es, Hochschulcharakteristika zu bestimmen, die fur Studierende der Psychologie (Diplom) ausschlaggebend waren fur die Hochschulwahl, was die Frage nach dem Zeitpunkt der Entscheidung fur eine spezifische Hochschule einschliest. Theoretische Grundlage bildet die ipsative Handlungstheorie, formalisiert als Logit-Modell fur Me...
Article
Full-text available
In the grant peer review process we can distinguish various evaluation stages in which assessors judge applications on a rating scale. Bornmann & al. [2008] show that latent Markov models offer a fundamentally good opportunity to model statistically peer review processes. The main objective of this short communication is to test the influence of th...
Article
Selection processes are never faultless. We investigate the predictive validity of the manuscript selection process at Angewandte Chemie International Edition (AC-IE), one of the prime chemistry journals worldwide, and conducted a citation analysis for manuscripts that were accepted by the journal or rejected but published elsewhere (n=1817). With...
Article
This study examined the peer review process at the journal Angewandte Chemie International Edition — the referees' recommendations and the editors' decisions to accept or reject submitted manuscripts for publication — for evidence of potential sources of bias. To analyze referees' recommendations, an ordinal regression model (ORM) with a total of 3...
Article
Full-text available
Peer review is valued in higher education, but also widely criticized in terms of potential biases, particularly gender. We evaluate gender differences in peer reviews of grant applications, extending Bornmann, Mutz, and Daniel’s meta-analyses that reported small gender differences in favor of men (d = .04), but a substantial heterogeneity in effec...
Article
Due to the disadvantages of the h index that have been named since Hirsch's first publication of the index in 2005 (Hirsch, 2005), a number of variants that are intended to compensate for the weaknesses have been proposed. Bornmann et al (2008a, 2009b) tested (1) whether the variants developed are associated with an incremental contribution for eva...