No full-text available
To read the full-text of this research,
you can request a copy directly from the author.
Assessing the Impact of Planned Social Change
... The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor. -Donald T. Campbell [1] The number of GitHub stars is the most widely used signal when stakeholders evaluate, select, and adopt opensource projects into their software supply chain [2]- [7]. However, it is merely a popularity signal (i.e., the attention received from GitHub users) and known to be poorly correlated to usage or importance [7]- [10]. ...
... processing step to reduce noise and increase accuracy. 1 We then apply StarScout to all GitHub event data from July 2019 to October 2024, identifying over million fake stars and 15,835 repositories with fake star campaigns. Using this resulting dataset, we conduct a measurement study that answers the following research questions: ...
... Only 64 repositories published packages in npm/PyPI, with limited evidence of adoption. 1. Note that technically speaking, the detection results of StarScout are only suspected fake stars and suspected fake star campaigns, among which there may still be some false positives (see Section 3.4 for more discussion). ...
GitHub, the de-facto platform for open-source software development, provides a set of social-media-like features to signal high-quality repositories. Among them, the star count is the most widely used popularity signal, but it is also at risk of being artificially inflated (i.e., faked), decreasing its value as a decision-making signal and posing a security risk to all GitHub users. In this paper, we present a systematic, global, and longitudinal measurement study of fake stars in GitHub. To this end, we build StarScout, a scalable tool able to detect anomalous starring behaviors (i.e., low activity and lockstep) across the entire GitHub metadata. Analyzing the data collected using StarScout, we find that: (1) fake-star-related activities have rapidly surged since 2024; (2) the user profile characteristics of fake stargazers are not distinct from average GitHub users, but many of them have highly abnormal activity patterns; (3) the majority of fake stars are used to promote short-lived malware repositories masquerading as pirating software, game cheats, or cryptocurrency bots; (4) some repositories may have acquired fake stars for growth hacking, but fake stars only have a promotion effect in the short term (i.e., less than two months) and become a burden in the long term. Our study has implications for platform moderators, open-source practitioners, and supply chain security researchers.
... The phenomenon that a technological artefact (such as a metric or an algorithm) has different implications if used for analytical purposes, where it is used to describe the most significant relationships between variables (e.g., to determine training demand), or for control purposes, where it is used to manage (e.g., to automatically evaluate workers), has been described in various fields under different names. Campbell (1979) in the field of sociology concluded that "the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor" (Campbell, 1979: 85). Goodhart (1981), in the field of macro-economics states: "Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes" (Goodhart, 1981: 116), concluding that any underlying relationship will fully disappear once a variable involved is used as a management objective. ...
... Goodhart (1981), in the field of macro-economics states: "Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes" (Goodhart, 1981: 116), concluding that any underlying relationship will fully disappear once a variable involved is used as a management objective. Campbell (1979) primarily to adverse behavior by subjects 5 (Garrabrant, 2017;Manheim & Garrabrant, 2019). ...
... Our results from the classroom simulation and the reflection exercise do suggest that the behavioral reaction of workers is not necessarily the result of adverse behavior (Campbell, 1979; Osterloh & Frey, 2015) as our participants strongly disapprove of the resulting consequences, claiming that a certain behavior is forced upon workers. Rather than (only) workers trying to 'game' the algorithm, the incentives produced by the algorithm (also) influence worker behavior. ...
... Whenever a quantitative metric is used as a proxy to assess a social behavior, it becomes open to exploitation and corruption (Campbell, 1976;Goodhart, 1975;Lucas, 1976). This is often summarized more pithily as "when a measure becomes a target, it ceases to be a good measure." ...
... We have provided some empirical evidence that this occurred, as well as a general model of the process. If we want to improve how our scientific culture functions, we must consider not only the individual behaviors we wish to change, but also the social forces that provide affordances and incentives for those behaviors (Campbell, 1976;Wilson, Hayes, Biglan & Embry, 2014). We are hardly the first to consider a need to alter the incentives for career success in science (Nosek & Lakens, 2014;Nosek et al., 2012;Ioannidis, 2014a;Vankov et al., 2014;Fischer, Ritchie & Hanspach, 2012;Brembs, Button & Munafò, 2013;Begley, Buchan & Dirnagl, 2015;MacCoun & Perlmutter, 2015;Gigerenzer & Marewski, 2015;Sills, 2016;Sarewitz, 2016). ...
Poor research design and data analysis encourage false-positive findings. Such poor methods persist despite perennial calls for improvement, suggesting that they result from something more than just misunderstanding. The persistence of poor methods results partly from incentives that favor them, leading to the natural selection of bad science. This dynamic requires no conscious strategizing---no deliberate cheating nor loafing---by scientists, only that publication is a principle factor for career advancement. Some normative methods of analysis have almost certainly been selected to further publication instead of discovery. In order to improve the culture of science, a shift must be made away from correcting misunderstandings and towards rewarding understanding. We support this argument with empirical evidence and computational modeling. We first present a 60-year meta-analysis of statistical power in the behavioral sciences and show that power has not improved despite repeated demonstrations of the necessity of increasing power. To demonstrate the logical consequences of structural incentives, we then present a dynamic model of scientific communities in which competing laboratories investigate novel or previously published hypotheses using culturally transmitted research methods. As in the real world, successful labs produce more "progeny", such that their methods are more often copied and their students are more likely to start labs of their own. Selection for high output leads to poorer methods and increasingly high false discovery rates. We additionally show that replication slows but does not stop the process of methodological deterioration. Improving the quality of research requires change at the institutional level.
... Графики, показывающие резкое увеличение числа симптомов, не сопровождались параллельными графиками, показывающими базовую цифру для протестированного количества пациентов [5]. Как и в других областях политики (таких как образование и другие аспекты здравоохранения), цифры, как Д. Кэмпбелл предупреждал нас в рамках своей фундаментальной критики о тенденции сосредоточиться на единичных результатах в оценке политики (Campbell, 1979) [6], часто преднамеренно манипулируются (Davis, 2020) [8], чтобы оказать желаемое влияние на финансирование или другие аспекты политики. ...
... 5. Некоторые сотрудники полиции воспользовались возможностью, чтобы метафорически и физически избивать людей (а) потому что некоторые власти «сказали» им сделать это, и (б) потому что соблюдение правил имеет очевидную моральную основу. 6. Публика, напуганная тем, что можно оказаться среди проигравших, а также подогреваемая явно укоренившимся желанием навязывать другим то, что одни считают хорошим и правильным, без учета пожеланий этих других, без учета долгосрочных последствий таких действий, в сочетании с предрасположенностью к предпочтению драконовских фашистских однофакторных политик, якобы способствующих общему благу, «вскочила на подножку последнего вагона» и начала требовать дополнительных ограничений и соответствия, в то же время получая удовольствие от доносов властям на своих соседей, за мелкие нарушения того, что принято за правила. ...
COVID-19 (на основе системно динамических моделей, принятых политическими консультантами) © Автор(ы) 2023 РАВЕН Джон, доктор философии в области психологии, профессор, научный консультант, почетный доктор и заслуженный профессор Печского университета (Венгрия), почетный доктор Католического Люблинского университета (Польша) Университет Эдинбурга EH8 9YL, Шотландия, Эдинбург, jraven@ravenfamily.co.uk ORCID: 0000-0002-6185-8153 SPIN-код: 6174-3930 AuthorID: 947445 Перевод на русский язык-О.Н. Ярыгин Аннотация. Предлагаемая статья является продолжением исследований автора по теме, указанной в заглавии, а именно: злоупотребления «наукой», логикой и властью. Анализируя материалы научных и псевдонаучных ис-следований, на основе которых вырабатывалась и реализовывалась политика борьбы с «пандемией COVID-19», автор показывает не только методологическую несостоятельность используемых «научных» исследований, но и преднамеренные злоупотребления «научных» властей, так называемого «научного сообщества», направленных на извлечение выгоды (статусной или материальной) из нагнетания страха на широкие массы населения. Автор вы-являет основные пороки «научного подхода» к решению проблемы возникшей перед человечеством: (1) чрезмерно упрощенные модели, предлагаемые для учета распространения COVID-19 и оценки последствий возможных вме-шательств; (2) отсутствие в моделях оценки множественных и разнообразных последствий, которые могут возник-нуть в результате предлагаемых изменений; (3) неспособность проверить качество основных данных и использу-емых мер; (4) неспособность проверить обоснованность предположений о причинно-следственных связях; (5) не-способность учитывать контекст; (6) неадекватное обсуждение опасностей введения полицейского государства при молчании организаций, занимающихся защитой гражданских свобод и свободы слова; (7) неспособность признать и изучать природу и роль, которую играет поток возникающих, самосохраняющихся, саморазвивающихся и саморас-пространяющихся упрощенных представлений или мемов (сетей убеждений), относительно того, как решать кон-кретную проблему (например, как остановить COVID-19). Автор настойчиво предупреждает об опасности навязы-вания однофакторного подхода в исследованиях сложной проблемы, каковой является распространения COVID-19, и о том, что подход основанный на редукционистской «науке» оказывается не просто вредным для общества, но т опасным для человечества в целом. Ключевые слова: искажение научного подхода, злоупотребление властью, политика локдауна, социальное дис-танцирование, несистемная (редукционистская) наука, неадекватные модели принятия решений, отказ от сложно-сти, ментальный вирус, деплатформинг. Abstract. This article is a continuation of the author's research on the topic indicated in the title, namely: the abuses of "science", logic and authority. Analyzing the materials of scientific and pseudoscientific research, on the basis of which the policy of combating the "COVID-19 pandemic" was developed and implemented, the author shows not only the method-ological failure of the "scientific" research used, but also the deliberate abuse of the "scientific" authorities, the so-called "scientific community" aimed at extracting benefits (status or material) from injecting fear into the broad masses of the population. The author identifies the main flaws of the "scientific approach" to solving the problem that has arisen before humanity: (1) oversimplified models proposed to take into account the spread of COVID-19 and assess the outcomes of possible interventions; (2) the absence in the models of estimating the multiple and varied impacts that may result from the proposed changes; (3) failure to check the quality of the underlying data and measures used; (4) failure to test the validity of causal assumptions; (5) failure to consider context; (6) inadequate discussion of the dangers of imposing a police state in the silence of civil liberties and free speech organizations; (7) failure to recognize and study the nature and role played by the flow of emerging, self-perpetuating, self-evolving, and self-propagating simplistic beliefs or memes (belief networks) in relation to how to solve a particular problem (e.g., how to stope COVID-19). The author emphatically warns about the dangers of imposing a one-factor approach in research on such complex problem, which is the spread of COVID-19, and that an approach based on reductionist "science" is not only harmful to society, but dangerous to humanity as a whole. Keywords: distortion of scientific approach, abuse of authority, lockdown policy, social distancing, non-systemic (re-ductionist) science, inadequate decision-making models, rejection of complexity, mental virus, deplatforming. ВВЕДЕНИЕ Последние несколько месяцев меня очень беспокои-ли следующие проявления. I. Чрезмерно упрощенные модели-то есть отсут-ствие внутренней сложности. Это характерно для мно-гих из моделей, предложенных для учета распростране-ния COVID-19 и оценки возможных последствий ряда возможных вмешательств. Многие из этих дефектов воз-никли из-за недостатков научного метода, то есть из-за неспособности провести достаточные исследования в реальном мире, чтобы понять происходящее прежде, чем создавать модели. Но, в основном, они возникают из образа науки, в котором одна причина связана с одним результатом без ссылки на такие вещи, как рекурсивные петли обратной связи имеющихся в исследуемом про-цессе и взаимодействие с посторонними входами. То РАВЕН Джон НЕКОТОРЫЕ ЗЛОУПОТРЕБЛЕНИЯ «НАУКОЙ» ... ©2023 Контент доступен по лицензии CC BY-NC 4.0 This is an open access article under the CC BY-NC 4.0 license (https://creativecommons.org/licenses/by-nc/4.0/)
... Un dato che conferma la possibilità, già evidenziata dalla letteratura (Corsini, 2009), che l'Effetto Scuola non individui le scuole più efficaci ma quelle meno inclusive. D'altro canto, come già indicato da Campbell (1979), associare ai test rilevanti conseguenze (come quelle di natura reputazionale per dirigenti e docenti) tende a compromettere la loro validità e a peggiorare la qualità dei processi di apprendimento e insegnamento oggetto di rilevazione. Questo tende a tradursi in comportamenti opportunistici. ...
... However, concerns about the quality of state services such as schools and medical facilities led to the introduction of a new age of science-driven assessment, also known as evaluation (Alkin 2004;Patton 2008;Vedung 2010). This application of social science research, influenced by medical and engineering models of causal attribution, examined whether and how social services could change individual behaviour and social conditions (Alkin 2004;Campbell 1979;Vedung 2010). Subsequent evaluation waves have shifted the focus toward different stakeholder groups, yet collecting outcomes-based data from program recipients remains a core aspect of modern evaluation practice (Ahearn and Parsell 2024). ...
Inspection is an institutionalised feature of social services that aims to ensure accountability and improve quality and outcomes for recipients. Successive changes in administration and funding have created a hybridised market of public, private, and third-sector providers, leading to a complex institutional environment. Our study seeks to understand how the chosen modality of inspection in different social services is influenced by this environment. By combining public statements of inspection from social service organisations with qualitative interviews with sector leaders and experts, we reveal a stark divide: audited services operating within quasi-markets, on the one hand and evaluated services relying on block grant-funding, on the other. These differences are underpinned by embedded expectations of whether services should change outcomes or simply provide care, in turn influencing the design, administration, and quality of services.
... First, the use of any measure of research quality brings with it the risk that the measure will have a distorting effect on the quality of research. A measure of research quality can incentivize researchers, funding agencies, and other stakeholders to make decisions with the goal of improving their score on that measure, even if that comes to the detriment of the property the measure was originally designed to track (Campbell, 1979). This risk is clearly not unique to the use of mutual information as a measure of research quality; it is also a risk for reliability and validity. ...
How should we measure the quality of experimental research? With talk of a looming “replicability crisis”, this question has gained additional significance. Yet, common measures of research quality based on reliability and validity do not always track core epistemic virtues. To remedy this issue, we draw on information theory and propose a measure of research quality based on mutual information. Mutual information measures how much information an experimental method carries about the world. We show that this measure tracks epistemic virtues that reliability and validity do not. We conclude by discussing implications of this information-theoretic measure of research quality and address some limitations of this approach.
... Por último, pareciera una constante que, frente a la existencia de determinadas intervenciones, bonificación o incentivo, existiera cierto contingente de instituciones y personas que buscarían hacerse indebidamente acreedor de estos beneficios y mientras más se utilicen o implementen, también serán mayores a distorsiones el uso estratégico fraudulento, la corrupción que vulnera y trastoca el espíritu que inicialmente le animaba (Campbell, 1979). En consecuencia, la eficiencia, eficacia y justicia en la implementación de una política de esta naturaleza requeriría también estar consciente de estas prácticas y sus externalidades a objeto de prevenirlas, atenuarlas o sancionarlas. ...
La evaluación escolar estima el aprovechamiento curricular y la calidad educativa en la medida que es pertinente, confiable y válida. Analizar el rendimiento de los estudiantes de segundo año de secundaria, comparando la consistencia de la calificación escolar docente (evaluación interna) con las puntuaciones de los test estandarizados (evaluación externa). Se realiza un análisis longitudinal (2014-2022) de las bases de datos de rendimiento escolar del Ministerio de Educación y los resultados en las pruebas estandarizadas del Sistema de Medición de la Calidad de la Educación en Chile. Compara ambos sistemas de evaluación de un total de 250.000 estudiantes organizados en 2.972 colegios. Los datos evidencian un continuo desacoplamiento entre los sistemas de evaluación interna y externa. Por un lado, se observa un sostenido aumento en la calificación escolar docente y, por otro, una relativa invariabilidad en los puntajes de los test estandarizados, tanto en lenguaje como en matemáticas. Situación particularmente evidente en colegios que atiende preferentemente a estudiantes de mayor nivel socioeconómico. Esta inconsistencia evaluativa estaría reportando la existencia de una práctica de inflación de calificaciones, comportamiento estratégico en respuesta las presiones que directa o indirectamente diversos agentes ejercen sobre los docentes.
... However, we caution that no forecast should be used as a target or a quota for analysts or CSSPs. When a measure becomes a goal, that measure may no longer be meaningful as an outcome [44]. The meaning of a measure can be distorted by biases such as social and political pressure which may introduce incentives with unintended consequences. ...
There have been extensive efforts in government, academia, and industry to anticipate, forecast, and mitigate cyber attacks. A common approach is time-series forecasting of cyber attacks based on data from network telescopes, honeypots, and automated intrusion detection/prevention systems. This research has uncovered key insights such as systematicity in cyber attacks. Here, we propose an alternate perspective of this problem by performing forecasting of attacks that are analyst-detected and -verified occurrences of malware. We call these instances of malware cyber event data. Specifically, our dataset was analyst-detected incidents from a large operational Computer Security Service Provider (CSSP) for the U.S. Department of Defense, which rarely relies only on automated systems. Our data set consists of weekly counts of cyber events over approximately seven years. Since all cyber events were validated by analysts, our dataset is unlikely to have false positives which are often endemic in other sources of data. Further, the higher-quality data could be used for a number for resource allocation, estimation of security resources, and the development of effective risk-management strategies. We used a Bayesian State Space Model for forecasting and found that events one week ahead could be predicted. To quantify bursts, we used a Markov model. Our findings of systematicity in analyst-detected cyber attacks are consistent with previous work using other sources. The advanced information provided by a forecast may help with threat awareness by providing a probable value and range for future cyber events one week ahead. Other potential applications for cyber event forecasting include proactive allocation of resources and capabilities for cyber defense (e.g., analyst staffing and sensor configuration) in CSSPs. Enhanced threat awareness may improve cybersecurity.
... Exacerbating the issue, it is often functionally simpler for evolution to exploit loopholes in the quantitative measure than it is to achieve the actual desired outcome. Just as well-intentioned metrics in human society can become corrupted by direct pressure to optimize them (known as Campbell's law [66] or Goodhart's law [67]), digital evolution often acts to fulfill the letter of the law (i.e. the fitness function) while ignoring its spirit. We often ascribe creativity to lawyers who find subtle legal loopholes, and digital evolution is often frustratingly adept at finding similar exploits. ...
Biological evolution provides a creative fount of complex and subtle adaptations, often surprising the scientists who discover them. However, because evolution is an algorithmic process that transcends the substrate in which it occurs, evolution's creativity is not limited to nature. Indeed, many researchers in the field of digital evolution have observed their evolving algorithms and organisms subverting their intentions, exposing unrecognized bugs in their code, producing unexpected adaptations, or exhibiting outcomes uncannily convergent with ones in nature. Such stories routinely reveal creativity by evolution in these digital worlds, but they rarely fit into the standard scientific narrative. Instead they are often treated as mere obstacles to be overcome, rather than results that warrant study in their own right. The stories themselves are traded among researchers through oral tradition, but that mode of information transmission is inefficient and prone to error and outright loss. Moreover, the fact that these stories tend to be shared only among practitioners means that many natural scientists do not realize how interesting and lifelike digital organisms are and how natural their evolution can be. To our knowledge, no collection of such anecdotes has been published before. This paper is the crowd-sourced product of researchers in the fields of artificial life and evolutionary computation who have provided first-hand accounts of such cases. It thus serves as a written, fact-checked collection of scientifically important and even entertaining stories. In doing so we also present here substantial evidence that the existence and importance of evolutionary surprises extends beyond the natural world, and may indeed be a universal property of all complex evolving systems.
... We do not reject metrics or quantitative indicators per se, as they might be reasonably used when applied in the proper context nor do we criticize any particular statistical property of those measures. Rather we discuss an unreflective use of metrics as the sole indicator of research performance and the side-effects and often unintended consequences of this approach (see Strathern, 1997;Campbell, 1979;Kerr, 1975). We see this as more important because as long as this approach does not change, the new metrics will not provide better insights into research quality. ...
This conceptual paper explores the impact of quantitative research evaluation systems, on the intellectual capital (IC) of modern universities. By integrating the theory of IC and research evaluation scholarship, we shed light on how quantitative research evaluations might gradually shift the values of universities from traditional values centred around knowledge generation to a predominant emphasis on metric generation, metrics that are treated as tradable or exchangeable assets, like commodities in the marketplace. We argue that this shift in values has serious implications, as it gives rise to new academic workers “Homo metricus”, whose IC, must be oriented not towards robust knowledge production, but rather towards achieving metrics dictated by various aspects of evaluation systems. This paper advances our understanding of how research evaluation practices might reshape the intellectual landscape of universities and suggests the processes by which universities are evolving from knowledge hubs into entities that increasingly resemble business organizations. Moreover, our theoretical elaboration contributes to the theory of IC by emphasizing the often-overlooked role of organizational values. We highlight that IC does not exist in isolation from values that define the purposes for which IC is mobilized.
... This ultimately led to the cancellation of the program. 84 Comparison is about measurement, but it turns out that measuring an artefact as complex as the law is a more difficult matter than many would think, perhaps because the law rarely has the opportunity to pursue a single goal but must pursue a multiplicity of goals. 85 On their side, economists have concluded that: "Any robust policy dialogue must rely on a much broader assessment of reform than on the Doing Business rankings". ...
... Pinch and Bijker 1984). This phenomena, known as Goodhart's Law (Goodhart 1984;Campbell 1979;Strathern 1997), has been identified across numerous fields, including education (Strathern 1997;Griesemer 2020), economics (Mügge 2022), and organizational studies (Gray, Micheli, and Pavlov 2015). For instance, when schools use students' test scores as a metric to evaluate teacher quality, some teachers and administrators have responded by teaching to the test or in the worst case, altering students' test scores (Gabriel 2010). ...
Recent work has advocated for training AI models on ever-larger datasets, arguing that as the size of a dataset increases, the performance of a model trained on that dataset will correspondingly increase (referred to as “scaling laws”). In this paper, we draw on literature from the social sciences and machine learning to critically interrogate these claims. We argue that this scaling law relationship depends on metrics used to measure performance that may not correspond with how different groups of people perceive the quality of models' output. As the size of datasets used to train large AI models grows and AI systems impact ever larger groups of people, the number of distinct communities represented in training or evaluation datasets grows. It is thus even more likely that communities represented in datasets may have values or preferences not reflected in (or at odds with) the metrics used to evaluate model performance in scaling laws. Different communities may also have values in tension with each other, leading to difficult, potentially irreconcilable choices about metrics used for model evaluations---threatening the validity of claims that model performance is improving at scale. We end the paper with implications for AI development: that the motivation for scraping ever-larger datasets may be based on fundamentally flawed assumptions about model performance. That is, models may not, in fact, continue to improve as the datasets get larger---at least not for all people or communities impacted by those models. We suggest opportunities for the field to rethink norms and values in AI development, resisting claims for universality of large models, fostering more local, small-scale designs, and other ways to resist the impetus towards scale in AI.
... The strategy in this research uses a case study strategy and planning for the problem that is trying to be solved. Research with this strategy seeks to explain and study a complex problem or object of research (Campbell, 2005;Hamilton, 2008). This study used three data collection techniques, namely documentation, listen, and record techniques. ...
As a communication tool, social media has linguistic aspects ranging from letters to discourse, so it is important to be researched from a linguistic scientific point of view to find its meaning. This research aims to identify, elaborate, and analyze digital discourse on Twitter social media related to political elements. This research is based on the multimodal meaning related to communication modes in the form of signs such as writing, images, photos, videos, and other forms that have visual meaning in finding meaning in a communication in twitter posts. The method of this research is qualitative descriptive. The research data is in the form of posts on Twitter accounts that contain political elements. The data analysis technique in this study goes through the reduction and classification stage based on the use of communication modes in digital political discourse. Data collection techniques are carried out by documenting, listening, and taking notes. The results of the research are in the form of identification and explanation of how multimodal has meaning and meaning in digital political discourse on Twitter social media and the contribution of semiotic fashion in the form of writings, images, photos, videos, and other forms that have visual meaning in digital political discourse on Twitter social media as relevance regarding the views of the interests of discourse producers, digital discourse makers with certain semiotic modes to realize discourse, and interests aimed at the creation of political digital discourses such as identity politics, politics of struggle, and power politics.
... The more any quantitative social indicator is used for social decisionmaking, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor (Campbell, 1976). ...
... [30] Furthermore, poor selection of a proxy can promote bias (e.g., using predicted healthcare costs as a proxy for clinical risk underestimates the needs of those with less access to care [31]), and measures used for social decision-making are more likely to be gamed. [32] These risks do not require that we avoid measuring healthcare delivery. As statistician George Box observed, "Essentially, all models are wrong, but some are useful." ...
UNSTRUCTURED
This article aims to introduce emerging measurement domains made feasible through electronic health record (EHR) use metadata, to inform the changing landscape of healthcare delivery. We reviewed domains in which EHR metadata may be used to measure healthcare delivery, outlining a framework for evaluating measures based on desirability, feasibility, and viability. We argue that EHR use metadata may be leveraged to develop and operationalize novel measures in the domains of Team Structure and Dynamics, Workflows, and Cognitive Environment, to provide a clearer understanding of modern healthcare delivery. By enabling measures that can be used to inform the next generation of healthcare delivery, EHR use metadata may be used to improve the quality of patient care and support clinician well-being. Careful attention is needed to ensure these measures are desirable, feasible, and viable.
... Incentivy jsou hnací silou kulturního vývoje a pokud chceme vědu, která je smysluplná ("pravdivá") a reprodukovatelná, musíme zajistit, aby instituce takovou vědu vyžadovaly (Smaldino & McElreath, 2016). Změna může být funkční, pouze pokud budeme brát v úvahu jak individuální chování vědců, tak také systémové nastavení, které vytváří pobídky pro toto chování (Campbell, 1976). V padesátých letech publikoval Cressey (1953) tzv. ...
... In the context of organizations, 'Campbell's law' formulates the risk of redirecting attention and energy by the inappropriate use of indicators (Campbell 1976; for examples see e.g. Muller 2018). ...
When organizations solve collective action problems or realize values, they do so by means of institutions. These are commonly regarded as self-stabilizing. Yet, they can also be subject to endogenous processes of decay, or so we argue. We explain this in terms of psychological and cultural processes, which can change even if the formal structures remain unchanged. One key implication is that the extent to which norms, values, and ideals motivate individuals to comply with institutions is limited.
... The aspect of rationality and acceptability of an alternative is the main consideration in choosing alternatives, but on the other hand, various other aspects are ignored (Subarsono, 2005). Evaluators need to focus their attention on policy alternatives and emphasise the influence of policy administrators on the recipient of policies that will derail policies (Campbell, 1979). ...
Asphalt, which is the result of lubricating coal minerals (non-renewable), requires effective management from the government which is realized through rational policies. Efficient policy planning is needed to overcome policy problems without causing major consequences. This research aims to develop selected policy alternatives through selecting alternative policies for managing Buton asphalt mines in Buton Regency. The focus of this research is public policy analysis, namely methods for identifying problems, determining goals, evaluating alternative options, selecting alternatives, and measuring policy performance. This research, only focusing on the best alternative for management policies for the Buton asphalt mine in Kab. Buton. This research aims to analyze and identify: selected policy alternatives to be recommended in the management of asphalt mines in Kab. Buton. The approach used is mixed method. In problem formulation, using descriptive qualitative, to project policy alternatives using public policy analysis techniques through three stages (I), problem formulation techniques (hierarchy), developing into the Projection Forecasting method (extrapolative), ending with alternative selection based on Franklin's criteria. Alternative method looks at the consequences of each policy are equivalent to scoring based on technical, economic, financial and administrative feasibility. The research results show that there are three alternatives developed based on projection forecasting (extrapolative) assessments, namely: structuring institutional authority in asphalt mining management (2.36), strengthening Buton asphalt policy as a leading sector in Buton Regency (2.82), consistency policy in the preparation of Buton asphalt mine management policies (3.18). The selection of consistent alternatives for developing Buton asphalt mine management policies is the most prominent and has a fairly high probability of success and can be carried out. Where policy consistency through social mapping and domestic policy obligations increasing a larger portion for optimal domestic use (distribution to regions for use of State roads) can encourage the use of Buton asphalt nationally. If this condition continues, economic growth can continue. Alternative consistency in preparing Buton asphalt mine management policies in making Buton asphalt mine management policies is the best alternative choice for Buton asphalt mine management policies in Buton Regency.
... Un dato che conferma la possibilità, già evidenziata dalla letteratura (Corsini, 2009), che l'Effetto Scuola non individui le scuole più efficaci ma quelle meno inclusive. D'altro canto, come già indicato da Campbell (1979), associare ai test rilevanti conseguenze (come quelle di natura reputazionale per dirigenti e docenti) tende a compromettere la loro validità e a peggiorare la qualità dei processi di apprendimento e insegnamento oggetto di rilevazione. Questo tende a tradursi in comportamenti opportunistici. ...
... Un dato che conferma la possibilità, già evidenziata dalla letteratura (Corsini, 2009), che l'Effetto Scuola non individui le scuole più efficaci ma quelle meno inclusive. D'altro canto, come già indicato da Campbell (1979), associare ai test rilevanti conseguenze (come quelle di natura reputazionale per dirigenti e docenti) tende a compromettere la loro validità e a peggiorare la qualità dei processi di apprendimento e insegnamento oggetto di rilevazione. Questo tende a tradursi in comportamenti opportunistici. ...
... Finally, there is a sizable literature on how unintended and inadvertent consequences of implementing metric-based systems may happen (for a full review, see Muller, 2018 [46]). These are generally extensions of "Campbell's law" [47], i.e., that when performance measurements are defined, they become increasingly invalid over time, and "Goodhart's law" [48], i.e., that the value of a metric collapses when it is identified for control purposes. In the case of MBC, these refer to the contamination of a measure's meaningfulness or validity, which can happen for a number of reasons. ...
Purpose of Review
Precision medicine prioritizes characterization of individual patient parameters to optimize care and this review evaluates measurement-based care (MBC) as a strategy for doing so in the treatment of substance use disorders (SUD). Measurement-based care refers to the systematic use of validated assessments to inform diagnosis and treatment planning, with varying frequency of assessments. Despite the seemingly obvious grounds for the use of MBC in treating SUD, systematic implementation to date has been limited. Thus, the goal of this review is to evaluate efforts to date and to stimulate greater consideration of MBC models in addictions programs.
Recent Findings
Data from two published randomized controlled trials and findings from pragmatic clinical research highlight the potential utility of MBC in the SUD treatment settings. Despite these findings, the existing literature indicates the high need for larger-scale clinical trials and quality improvement programs. Potential barriers to the implementation of MBC for SUD are outlined at the patient, provider, organization, and system levels, as well as the challenges associated with the use of MBC programs for clinical research. Critical thinking considerations and risk mitigation strategies are offered toward advancing MBC for SUD beyond the current nascent state.
Summary
Collectively, the existing data confirm that MBC is a suitable and promising strategy for applying a precision medicine approach in SUD treatment, warranting further implementation efforts and scientific inquiry.
... We can use indicators to identify broad issues, ideally unobtrusive ones that are less likely to be gamed. An indicator is not a target: as soon as an indicator becomes a target, it ceases to be an indicator (Campbell, 1979;Goodhart, 1984). That is because the more important a measure, the more likely it is to be manipulated -the dark side of the saying that "what's measured is what's managed". ...
Factors outside of healthcare services determine our health and this involves many different sectors. Health for All Policies changes the argument about inter-sectoral action, from one focusing on health and the health sector to one based on co-benefits – a 'Health for All Policies' approach. It uses the Sustainable Development Goals as the framework for identifying goals across sectors and summarizes evidence along two causal axes. One is the impact of improved health status on other SDGs, e.g. better educational and employment results. The other is the impact of health systems and policies on other sectors. The 'Health for All Policies' approach advocated in this book is thus a call to improve health to achieve goals beyond health and for the health sector itself to do better in understanding and directing its impact on the world beyond the healthcare it provides. This title is also available as Open Access on Cambridge Core.
... 33 Matta etkisinin 30 "Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes." Goodhart, C. 1975 Campbell, D. T. 1979. "Assessing the Impact Of Planned Social Change". ...
Abesle iştigalden başka bir şey olmayan akademik sıralama çalışmalarına fazla değer atfetmenin ve metriklere tapınmanın bir anlam taşımadığını düşünüyorum.
Akademik değersizleşmeyi ifade eden akademik nihilizmin nirvanasında yaşanan bu akademik absürdizmi gerçekten ayıplıyorum ve kınıyorum!
Sayı oyunları ile meşgul olmak yerine önce doğru şeyleri ölçmenin ve sayıları kontrol etmenin önemini anlamalıyız. Sayıları çoğaltmak yani akademik enflasyon her yönüyle ve her türüyle (üniversite enflasyonu, öğrenci enflasyonu, derece enflasyonu, diploma enflasyonu, unvan enflasyonu, akademik dergi enflasyonu vs.) akademik yozlaşmaların ana kaynağıdır.
Üniversite sayılarını artırıp üniversiteleri değersizleştirdikten sonra “mükemmeliyet” (excellence) hedefinden bahsederek üniversiteleri sıralamaya tabi tutmak abesle iştigaldir. Doktoralı öğretim üyesi açığı var deyip üniversitede aslında ders vermekle fazlasıyla meşgul ve yorgun her öğretim elemanına kolay yollardan doktora derecesi vermek ve daha sonra onları doçent/profesör yapmaya kalkışmak akılsızlıktan başka bir şey değildir. Akademik sıralama kriterlerinden biri olduğu için doktoralı öğretim elemanı sayısını ve doktora derecesine sahip akademisyen/akademik personel oranını artırmaya çalışmak gerçekten doğru bir yol değildir. Yabancı öğrenci sayısını, bir diğer ifadeyle uluslararası öğrenci oranını artırmak suretiyle Dünya Üniversiteler Ligi’ne dahil olmaya çalışan bir akademik mentalite apaçık ahmaklıktır. Ve en nihayetinde sayı oyunları (kitap sayısı, “sözde” uluslararası kitap bölümü sayısı, makale sayısı, “sözde” uluslararası konferanslarda sunulan bildiri sayısı, bildiri kitaplarında yayınlanan makale sayısı, atıf sayısı, proje sayısı, tez danışmanlığı sayısı vs.) eşliğinde akademik başarıyı ölçmeye çalışmak akademik absürdizmden başka bir şey değildir.
Sonsöz: Bilimsellik maskesi altında “bilimcilik” (scientism) meşguliyetinden; “en iyi üniversite sıralaması” adı altında “medyatik şarlatanlık” yapmaktan; sayılara ya da rakamlara abartılı bir şekilde bağlanarak “metrik fetişizmi”ne tapınmaktan; sayılarla övünerek “metrik manyaklığı”na sarılmaktan; “toplam kalite” felsefesini bırakıp “toplam kantite” saçmalığını takip etmekten uzak kaldığımız sürece ve ayrıca akademik kapitalizmin etkilerini ve yönlendirmelerini gözardı etmediğimiz takdirde akademik metroloji (bilimetri) alanında yapılan çalışmaların yarar sağlayacağını söyleyebiliriz.
Eline bir mezura alıp her ölçülebileni ölçmek büyük bir marifet değildir, dolayısıyla iltifata da tabi değildir. Önemli olan neyi ölçmeye çalıştığımız, gerçekten ölçmeye değer şeyleri ölçüp ölçmediğimiz, ölçümle neyi amaçladığımız gibi hususlardır.
Sözlerimizi tüm zamanların en iyi fizikçilerinden birisi olarak kabul edilen Albert Einstein’ın bir sözü ile tamamlayalım:
“Değer ifade eden her şey sayılamaz ve sayılabilen her şey de bir değer ifade etmez.”
... On one hand, our findings demonstrate that AI models trained on human ratings are not only efficient (yielding millions of personal quality scores in a matter of minutes, replicating human ratings with uncanny precision) but also interpretable (as opposed to an inscrutable black box) and auditable for fairness to demographic subgroups. On the other hand, Campbell's law (43) states that the more weight given to an assessment in high-stakes decisions (as opposed to low-stakes research), the greater the incentive for distortion. It is not hard to imagine how applicants might try to mold their essays, perhaps using AI tools such as ChatGPT, to match what admissions officers, and the algorithms they train, are looking for. ...
Personal qualities like prosocial purpose and leadership predict important life outcomes, including college success. Unfortunately, the holistic assessment of personal qualities in college admissions is opaque and resource intensive. Can artificial intelligence (AI) advance the goals of holistic admissions? While cost-effective, AI has been criticized as a “black box” that may inadvertently penalize already disadvantaged subgroups when used in high-stakes settings. Here, we consider an AI approach to assessing personal qualities that aims to overcome these limitations. Research assistants and admissions officers first identified the presence/absence of seven personal qualities in n = 3131 applicant essays describing extracurricular and work experiences. Next, we fine-tuned pretrained language models with these ratings, which successfully reproduced human codes across demographic subgroups. Last, in a national sample ( N = 309,594), computer-generated scores collectively demonstrated incremental validity for predicting 6-year college graduation. We discuss challenges and opportunities of AI for assessing personal qualities.
... Hence, we draw upon the views of Remco decision-makers, their advisers and institutional investors to obtain data on their firsthand experiences of the determination and nature of measurement of executive performance and associated pay outcomes, and to explore how their subjective sense of accountability influences their decisions on quantum. It theorises the problem under the rubric of accountability theory (Abd Aziz et al., 2015;Besley, 2006;Campbell, 1979;Frink and Klimoski, 2004;Han, 2020;Kuo et al., 2022;Mansbridge, 2014;Power, 1994;Sabel and Zeitlin, 2008;Tamir, 2012;Vandenabeele, 2009;Xiao and Xiao, 2010). ...
Purpose
The purpose of this paper is to examine how and why individuals involved in executive remuneration (top pay) decision-making consider quantum as being appropriate rather than excessive, theorised under the rubric of accountability.
Design/methodology/approach
In-depth interviews were conducted with non-executive directors (NEDs) serving on remuneration committees (Remcos), institutional investors, their external advisers and internal HR reward experts. Transcripts were analysed using NVivo and the Gioia qualitative methodology.
Findings
Defining, measuring and applying performance conditionality in the determination of top pay quantum such that it aligns with company strategy/culture and values, as well as individual recipient motivations, is difficult. While creative approaches to setting top pay so as to attract, retain and motivate key personnel are welcomed, these risk Remco members' personal/organisational reputations. Members recognise disconnection between top pay quantum and general pay levels and how the media highlights social inequality leading to public distrust. They believe they can contribute to more socially acceptable quantum by applying their own values in top pay decision-making.
Originality/value
Sanctions-based, trust-based and selection/peer networks/felt-based accountability theory is used to explain decision-makers’ actions when determining top pay quantum. This paper extends felt accountability theory to encompass public/societal accountability in the context of the appropriateness of top pay quantum decisions.
... Cuando los resultados positivos o negativos de los estudiantes en una prueba pueden tener consecuencias significativas tanto para los estudiantes individuales como para sus profesores e instituciones educativas, se les considera como pruebas de alto riesgo o de alto impacto. Cuando un solo indicador se utiliza para la toma de decisiones sociales de alto riesgo, más sujeto estará a presiones de corrupción con el potencial de distorsionar y sesgar los procesos sociales que pretende medir (Campbell, 1976). De esta manera, consolidar los resultados de evaluación de los estudiantes como un indicador para medir la complejidad de los resultados educativos tiene gran probabilidad de adulterar el proceso, como el incentivar una mayor enseñanza para la prueba y el desarrollo de prácticas de instrucción perjudiciales, mientras se excluyen actividades más auténticas y espontáneas, centradas en las necesidades e intereses de los estudiantes (Nichols y Harris, 2016). ...
En el ámbito de la educación superior actual, la evaluación de los aprendizajes de los estudiantes ha evolucionado y adquirido una importancia cada vez mayor, ya que se utiliza para fines diversos, como la subsecuente evaluación de la calidad de los programas e instituciones, la rendición de cuentas y la toma de decisiones curriculares. En este sentido, mediante un análisis documental, el presente artículo tiene el objetivo de analizar la forma en que la evaluación de los aprendizajes de los estudiantes se ha abordado desde las políticas públicas en los países de Latinoamérica pertenecientes a la Alianza del Pacífico, en relación con el uso de sus resultados para el mejoramiento de la calidad de los programas educativos. Se concluye que la mayoría de los sistemas educativos estudiados realizan evaluaciones como requisito de ingreso a la universidad y para determinar el perfil de egreso. De igual manera, miden el desempeño estudiantil como criterio para las acreditaciones de calidad. Desde esa vía, se subraya que algunos de los usos de las evaluaciones, normados en las políticas, se consideran de alto riesgo, de acuerdo a la revisión de la evidencia científica.
... One concern is the possibility of gaming. Campbell's Law states that "the more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor" (Campbell, 1979). Gaming is a problem regardless of the level at which selection operates and is an issue in many sectors (Larkin, 2014). ...
Criteria for recognizing and rewarding scientists primarily focus on individual contributions. This creates a conflict between what is best for scientists' careers and what is best for science. In this article, we show how the theory of multilevel selection provides conceptual tools for modifying incentives to better align individual and collective interests. A core principle is the need to account for indirect effects by shifting the level at which selection operates from individuals to the groups in which individuals are embedded. This principle is used in several fields to improve collective outcomes, including animal husbandry, team sports, and professional organizations. Shifting the level of selection has the potential to ameliorate several problems in contemporary science, including accounting for scientists' diverse contributions to knowledge generation, reducing individual-level competition, and promoting specialization and team science. We discuss the difficulties associated with shifting the level of selection and outline directions for future development in this domain.
... Objectives emerging from purposeful subsystems must be in concert with each other, otherwise they can create disharmony across the whole system -such as when there are different goals for the roads and transit operators (Austenfeld Jr Robert, 2001;Deming, 2018;Gartner & Naughton, 1988;Moore, 1995;Ohmae, 1983;Overeem, 2012 However, none of those performance measurements contain considerations of value for money, pollution, society, businesses, public transport passengers, or pedestrians; therefore, NSW traffic engineers optimising those vehicle centric performance measurements in the Sydney Central Business District (CBD) reallocated space for the many pedestrians to the fewer vehicles (Saulwick, 2014(Saulwick, , 2015, even though the RTA had also documented a dedicated set of performance measurements for pedestrian walkways (RTA, 2002, p. 4-12, Table 4.8). There is always competition over resource allocation within an organisation or within society as a whole because any group of people will develop multiple goals and approaches (Campbell, 1979;Dekker, 2011;Moore, 1995). In addition, service partners will always focus on meeting the exact expectations of those providing funding -as specified in the contractual KPIs -in order to maintain the survival of their own organisation (Barr, 2017(Barr, , 2019Booz & Company, 2011; CoA PC, 2022; Deming, 1982Deming, , 2018Goodhart, 2015;King, 2019). ...
This document introduces the review to support the author’s first Candidature Assessment for the doctoral research currently titled: Enhancing Interpretive Models of Operational Efficiency using Measurements Derived from Big Data to develop Collaborative Multi-Modal Customer-Centric Key Performance Indicators for Transport
The review considered measurement of performance and Key Performance Indicators (KPIs) used for measuring the Economy, Efficiency, Efficacy, & Effectiveness (4E’s) of transit service delivery. Due to the need for manual processing, public transport operators historically measured their output using the product-centric On Time Running (OTR) KPI which tracked the timetable-adherence of each services arrival and departure at the first, middle, and last stops (Currie et al., 2012; TfNSW, 2018; Unsworth, 2004; Vuchic, 2005). However, the limits of technology changed with the advent of the fourth industrial revolution because wireless Information and Communication Technology allowed the advent of Measurements Derived from Big Data (Schwab, 2017). As such, there is now an opportunity to develop comprehensive KPIs that assist service partners to collaboratively deliver customer-centric high-quality transport systems by minimising the inherent behavioural distortions from those gaming the KPIs.
Performance indicators and other accountability measures are increasingly common in higher education internationally. Consistent with this trend, the Australian Federal Government’s Teacher Education Expert Panel (TEEP) recently recommended new reforms to strengthen the link between performance and funding of initial teacher education (ITE). Recommended reforms included (i) the measurement and publication of ITE performance on four categories of indicators, including student selection, student retention, graduate readiness, and the employment outcomes of recent graduates and early career teachers, and (ii) the use of transition, excellence, or compact-based funding as levers for driving quality. While the proposal for the adoption of performance indicators to measure the quality of ITE has since been accepted by Australian Education ministers, our inductive content analysis of 56 public submissions in response to the proposed reforms revealed a divergence of views on the validity of the proposed performance measures and the potential impacts of these indicators on student diversity and graduation numbers. Higher education providers, Deans of Education, employers, teachers’ associations, and teacher regulatory authorities were consistent in arguing that the proposed indicators were not direct measures of quality and may have perverse or unintended consequences, with providers incentivised to ‘game the system’. Some stakeholders also queried assumptions that current accreditation processes are not sufficient to drive quality. We discuss implications of this reform for implementation and policy, noting important anomalies between stakeholder feedback and recommendations made in the final TEEP report.
In der medialen Darstellung gilt die Eisenbahnstraße in Leipzig „als eine der kriminellsten Meilen Deutschlands“ (Raabe 2016). Spätestens seitdem die boomende Stadt Hypezig auf weltweite Aufmerksamkeit gestoßen ist, rückt damit auch eine der angeblich gefährlichsten Straßen Deutschlands in den überregionalen Fokus.
Das Anliegen der vorliegenden Arbeit ist es, die Konstruktion der Eisenbahnstraße als eine der gefährlichsten Straßen Deutschlands aus einer polizeiwissenschaftlichen Betrachtung heraus zu untersuchen. Trägt die Polizei mit ihrer eigenen Öffentlichkeitsarbeit zur Konstruktion der Eisenbahnstraße als gefährlichen Ort bei? Dabei soll insbesondere herausgefunden werden, warum und wie über die Eisenbahnstraße berichtet wird.
The adoption of the Sustainable Development Goals has rejuvenated an old debate: Can foreign aid be used to finance global public goods (GPGs)? There are those who see aid exclusively as a source of development funding for poor countries. And there are others who are open to answering the question in the affirmative. I put forward five arguments why the latter position is reasonable. Firstly, the formal definition of official development assistance (ODA) cannot be said to exclude its use in financing GPGs as these goods by definition benefit developing countries. Secondly, the amount of ODA provided has never been the gold standard of rich country effort envisaged by some. In particular, the level is boosted by the self‐interests of donors. Thirdly, there is ample precedent for following the benefit principle when it comes to multilateral organisations, which are often seen as GPGs. Fourthly, distinguishing between national public goods and GPGs is not always straightforward as the former are in many cases inputs into the production of the latter, and in such cases, the dividing line between ‘traditional aid’ and ‘funding for GPGs’ is blurred. Finally, it is not obvious in practice that aid as country finance always generates greater welfare gains for developing countries than the provision of GPGs. In sum, being overly normative with respect to what ODA is distracts us from the real problem, namely, that collective action problems result in too little spending on all international public goods, including poverty alleviation in poor countries.
This article provides a review of concepts of quality and excellence in higher education. It sketches the perceptions and development of quality in the German higher education and science system since the beginning of the 20th century, and related changes in approaches to quality assurance and development. Special attention is given to the Bologna process and the Excellence Initiative. The article discusses challenges for research management and administration as well as institutional research as emerging functions and professional roles. It critiques the trend towards excessive and one-sided quantitative measurement of quality in higher education and science, and outlines perspectives for future research and policy development in the field. Three key fields of tension identified are: (1) uses and merits of quantitative versus qualitative measures of quality, (2) the academic conceptualisation of quality as excellence versus the political-economic conceptualisation as impact or relevance, and (3) an individualistic versus holistic approach to quality assessment. The article proposes understanding performance as value added rather than in absolute terms, accounting for diverse conditions and starting points.
Die vorliegende Ausgabe der Beiträge zur Hochschulforschung vereinigt Artikel zu den Gelingensbedingungen von Wissenschaft. Die Erhöhung der Qualität von Forschung und Lehre ist ein weit verbreitetes Ziel von Hochschulpolitik und den Hochschulen selbst – Exzellenz wird angestrebt. Aber welche Bedingungen sind notwendig, um dieses Ziel zu erreichen? Und welche Exzellenzvorstellungen liegen dem heutigen wissenschaftlichen Handeln zugrunde? Welche Auswirkungen haben institutionelle
Rahmenbedingungen und Hochschulpolitik auf das qualitätsbezogene Handeln von Akteurinnen und Akteuren im Hochschulbereich? Diese Fragen werden im vorliegenden Heft aus den verschiedensten Blickwinkeln beleuchtet. Dabei wird sowohl
die Qualität von Forschung als auch von Lehre in den Blick genommen.
Forschung: In einem einführenden Überblicksartikel rekapitulieren Susan Harris-Huemmert, Michael Hölscher, Justin J. W. Powell und Johanna Witte die Entwicklung des Verständnisses von Qualität und Exzellenz im deutschen hochschul- und wissenschaftspolitischen
Diskurs. Sie zeigen auf, wie eng beide Begriffe zusammenhängen, da das Streben nach Qualitätsverbesserung im Kern ein Streben nach Exzellenz ist. Vor dem Hintergrund des Erbes der Zeit des Nationalsozialismus wird das langjährige Vermeiden des Exzellenzbegriffs, aber auch einer offenen Differenzierung des deutschen Hochschulsystems erklärt. Der Artikel zeigt, wie sich beides – das Verhältnis zu Exzellenz als auch zuLeistungsdifferenzierung und Vielfalt – im Zuge des Bologna-Prozesses und der Exzellenzinitiative veränderten und wie Qualitätssicherung, aber auch Qualitätsentwicklung auf neue Weise institutionalisiert wurden. Im engen Zusammenhang damit steht die Entstehung und Verbreitung von Wissenschaftsmanagement und institutional research, deren noch nicht ausgeschöpfte Potenziale für die Hochschulentwicklung herausgearbeitet werden. Der Artikel endet mit einer Kritik an der Tendenz zu einer überzogenen und einseitigen quantitativen Messung von Qualität in Hochschule und Wissenschaft und skizziert Perspektiven für die zukünftige Forschung und Politikentwicklung in diesem Bereich. Es werden drei zentrale Spannungsfelder identifiziert: (1) quantitative versus qualitative Qualitätsmessungsinstrumente – ihr Einsatz und ihre Rückwirkung auf die Wissenschaft selbst, (2) Qualität als Exzellenz versus Qualität als impact oder Relevanz – d. h. wissenschaftseigene versus politisch-ökonomische Qualitätsverständnisse; und (3) ein individualistischer versus ganzheitlicher Zugang zu Qualitätsbewertung. Die Autoren plädieren abschließend dafür, ähnlich wie im Bereich der Bildung auch im Bereich der Forschung zu einem Verständnis von Leistung als added value zu kommen. Dies setzt eine Berücksichtigung unterschiedlicher institutioneller, organisationaler sowie individueller Bedingungen und Ausgangspunkte (wie Finanzierungs- und Ausstattungsmerkmale) für Forschungsleistungen voraus.
Se revisan aquí los fundamentos y desarrollo comparado de la cuestión de género, para realizar un análisis económico de costes, incentivos, eficiencia y bienestar. Se centra la atención en el cuestionamiento de las aportaciones de la Economía Pública, al tratar de desideologizar el género y abordarlo desde la Elección colectiva y como un bien público de provisión y promoción estatal según su función de bienestar social. Para tal revisión, se recurre a los marcos teóricos y metodológicos de la Elección pública (y demás enfoques neoinstitucionales y otros heterodoxos complementarios), con ilustraciones empíricas comparadas, de modo que sea posible el ofrecer una sistematización de los efectos negativos de la intervención pública en economía, máxime en el caso del género y su paradoja aparejada.
Zusammenfassung
Am Beispiel der IQB-Bildungstrend 2021 wird die Rolle des nationalen Bildungsmonitorings für das Initiieren von Reformen untersucht. Entfaltet wird die These, dass sich das IQB nicht allein als Datenlieferant begreift, sondern gemeinsam mit dem Beratungsgremium (SWK) als Reformakteur in Erscheinung tritt. Die Analyse des anvisierten Reformprogramms legt nahe, dass die Maßnahmen einer evidence-based-policy folgen. Es wird eine Expansion des Monitorings über die verschiedenen Bildungsetappen (von frühkindlicher Bildung bis zur Lehrkräfteprofessionalisierung) angestrebt. Für die Grundschulforschung bieten die Reformabsichten wichtige Impulse und Diskussionsanstöße. Sie sind zugleich einer theoretisch und empirisch informierten Analyse, insbesondere im Hinblick auf nicht-intendierte Nebenfolgen, zu unterziehen. Die Reform strebt eine disparitätsmindernde Wirkung der Grundschule an und imaginiert einen zentralen Hebel (Evidenz, Diagnostik, Standardisierung) und eine pädagogische Monokultur. Unterstellt wird eine Homogenität (alle Kinder profitieren von mehr Diagnostik und Testung). Entgegen der Intention zur Verringerung des Anteils an „Risikokinder“ beizutragen, besteht jedoch die Gefahr ungewollt mehr „Risikokinder“ zu produzieren. Damit läuft die anvisierte Reform Gefahr, die eigentliche „Risikogruppe“ aus dem Auge zu verlieren, die begründet Anlass für Reformen gibt.
This is a collaborative research of the University of the West of England, Bristol, UK (UWE Bristol), the International Federation of Surveyors (FIG), the Royal Institution of Chartered Surveyors (RICS), the International Valuation Standards Council (IVSC) and The European Group of Valuers' Associations (TEGOVA). As a first step-before the research results are available-this article examines and presents our basic understanding of the term 'transparency in the property market'. At this stage, the authors are encouraged by the extensive number of publications on this topic that show a reasonably uniform consensus. However, it is also worth noting that the term is viewed and interpreted differently, even in specialist circles. One gets the impression that the term 'transparency' is strongly interpreted from the personal and professional perspective of the user. The authors would like to develop a generally valid and recognised interpretation in the property sector(s). The study is intended to lay these foundations. The research uses a global comparative study to examine the level of transparency in real estate markets and identifies key differences between national markets due to the regulatory, economic, political, social, and cultural environment in which sellers and buyers operate. The determination of market transparency focuses on informational market efficiency and information asymmetry. The research is concerned with the perception, definition, and measurement of transparency in real estate markets and exploring any transparency deficits. To obtain comparable evidence, data was collected using an international online survey and utilising the 'purposive sampling' technique among relevant FIG members. These include professionals working in the field of land administration and management and in property surveying across the private and public sectors as well as in the higher education sector. Additionally, members of RICS, IVSC, CASLE and TEGOVA have been specifically approached for their input. Understanding market transparency, beyond the current measures available for selected countries and selected property sectors only, should help improve policies aimed at improving market efficiency. From a global perspective, the results of this research aim to inform policymakers to support the more vulnerable members of society who are often deprived of their real estate rights due to market opacity.
A policy commentary on the potential negative impact of choosing curriculum based on an assessment.
This is a critical review on gender issues and its policies, to understand and to evaluate the impact of gender state interventionism, with its costs, failures, paradoxes and other unwanted effects. This review uses the theoretical and methodological frameworks from neo institutional approach (Law & Economics, Public Choice, Constitutional Economic, etc.), to build bridges between Economy, Law and Politics, without confusion among the social spheres and under the principle of reality, which rejects economic thaumaturgy, political romanticism and state paternalism. There is a historical-comparative review on the development of coercive implementation based on gender perspective and its agenda, from a macro-view to a micro level, focusing the attention on the Spanish case. There is a final statement of its results, to clarify what kind of incentives have been given the gender bills and policies, the level of efficiency and institutional quality to solve social problems, the risks of an endless agenda and other unwanted effects, but foreseeable according to the principle of reality.
Outline for a course in time series economic analysis for graduate students of the Department of Economics, University of the Philippines Los Baños. Note: This is the latest version of the course outline.
La cuestión de género refiere un problema social de múltiples aristas: va más allá de la prevención y represión del machismo (también un concepto laxo: desde el maltrato y feminicidio hasta el piropo o las cuotas y ayudas específicas), pues buena parte de la doctrina entiende que se trata de la agenda para subvertir el orden dado en Occidente, por basarse en planteamientos hetero-patriarcales capitalistas (Johnson y Zubiaurre, 2012; Laje, 2022). Hoy en día es más confuso aún, al combinarse con otra agenda subversiva del orden establecido, como es la del cambio climático y decrecimiento (Mellor, 1992 y 1997; Koch, 2019; Fullbrook y Morgan, 2021; Keen, 2021), además de sufrir un giro hermenéutico de 180º, pasándose de postulados feministas cis-género (cis) a feministas trans-género (trans). Por tanto, para comprender mejor una cuestión tan difusa y polémica, defendida desde el pathos (o sentimiento compartido), en este estudio se ofrece un dictamen (un análisis es de el logos o la racionalidad técnica individual), sobre los efectos jurídico-económicos de la cuestión de género impulsada por el intervencionismo estatal. Para ello se recurre a los enfoques de la Escuela Austriaca y de los Neoinstitucionalistas, quienes comparten, entre otros supuestos, la premisa de desconfianza del poder (al corromper y reprimir), el principio de realidad (evitándose la falacia naturalista), el individualismo metodológico (al obligar a profundizar en cualquier organización y llegar a los fundamentos y agentes concretos involucrados, con sus agendas ocultas, Pérez-Huertas et al, 2014).
Актуальность. В статье анализируется регламентация ключевых показателей эффективности муниципального управления. Деятельность местных органов власти имеет определяющее значение для обеспечения достойного качества жизни населения территориальных сообществ. Эффективность муниципального управления измеряется на основе выполнения нормативно предзаданных показателей эффективности. Их выполнение по замыслу авторов управленческой модели работы по показателям является индикатором успешности функционирования местных органов власти. Однако действующие институциональные нормы потенциально способны приводить к имитации результатов управленческой деятельности. Цель исследования: выяснить, содержат ли нормативные требования к ключевым показателям эффективности потенциал имитации в практиках муниципального управления. Методы исследования. Проведенное исследование выстроено с применением общенаучных методов анализа и синтеза, сравнительного метода, прогностического подхода. Результаты исследования. В результате проведенного исследования мы пришли к выводу о том, что действующие нормативные требования к ключевым показателям эффективности содержат большой потенциал имитации в практиках муниципального управления. Принятые нормативные регуляторы разделены на две группы: показатели накопления и показатели расходования. Наиболее уязвимыми с точки зрения искажения эффективности муниципального управления выступают показатели расходования. Мы предлагаем изменить методику измерения эффективности, отказавшись от технократизма в определении ключевых показателей. Перспективы исследования связаны с изучением эмпирических условий возникновения имитации в муниципальном управлении на основе установления ресурсов профессиональной деятельности у муниципальных служащих.
Objectives:
While issues related to mental health, including suicide, have been frequently reported among finance workers, no formal investigation has been undertaken. This study was conducted to analyze correlations between indicators of performance pressure, which is a characteristic of the finance sector, and mental health.
Methods:
An online survey was administered to 1,181 participants. Brief questionnaires were employed to ask general questions about participant characteristics, work environment, and the presence of performance pressure, suicidal thoughts/plans/attempts, depression (indicated by the Patient Health Questionnaire-9), and anxiety (measured with the Generalized Anxiety Disorder-7). Frequency analysis, chi-square testing, and multivariate logistic regression analysis were performed.
Results:
Of the 1,181 respondents, 797 (83.54%) reported feeling pressure to perform at work, while 252 (26.42%) admitted to occasional willingness to achieve results even through illegal activities. Multivariate logarithmic regression analysis was employed to examine the correlation between performance pressure and mental health. This analysis revealed that those expressing willingness to achieve.
Results:
through illegal activities exhibited higher levels of suicidal ideation (adjusted odds ratio [aOR], 1.63; 99% confidence interval [CI], 1.04-2.55), plans (aOR, 1.75; 99% CI, 1.01-3.01), and attempts (aOR, 2.72; 99% CI, 1.06-6.98). Additionally, these individuals demonstrated higher levels of depression (aOR, 2.02; 99% CI, 1.34-3.06) and anxiety (aOR, 2.84; 99% CI, 1.81-4.46).
Conclusion:
Performance pressure is prevalent within the finance industry. This pressure serves as a major source of stress for employees and is evident in 3 representative indicators of mental health: suicide, depression, and anxiety.
Sözlerime üniversitelere dair genel bir tespiti ifade ederek başlamak istiyorum. Tüm dünyada ve Türkiye’de yükseköğretim kurumları akademik idealizm ilkelerinden (akademik özgürlük, akademik özerklik, akademik liyakat, akademik etik, akademik dürüstlük, akademik kalite vs.) her geçen gün çok daha uzaklaşma eğilimindedir. Bunun böyle olmasının iki ana sebebi bulunmaktadır: (1) Akademik enflasyon, (2) Akademik kapitalizm. Üniversitelerin sayılarının çoğalması (üniversite enflasyonu), öğretim elemanlarının sayıca çoğalması (akademisyen enflasyonu), yüksek lisans ve özellikle doktora gibi akademik derecelerin çoğalması (derece enflasyonu), üniversiteye adımını atan her öğretim elemanının doçent, profesör gibi unvanlara kolayca sahip olması akademik enflasyona örnekler teşkil etmektedir. Derecelere ve unvanlara sahip olmanın yayın sayısına bağlanması neticesinde de akademik dergi enflasyonu sorunu ortaya çıkmaktadır. Akademik yozlaşmanın ikinci ana sebebi akademik kapitalizmdir. Üniversiteler para için öğrenci avlayan ticarethaneye dönmüşlerdir. Uluslararasılaşma bu süreci hızlandırmış, üniversiteler yabancı öğrenci ithalatı için her türlü pazarlama ve satış tekniklerini uygulayan ticari şirketlere dönmüşlerdir. Üniversitelerde görev yapan akademisyenlerin iş bulma, yülseltilme ve atanma kriterlerinden akademik metriklere (yayın sayısı, atıf sayısı vs.) bağlanması neticesinde artan yayın talebi uluslararası ya da çokuluslu yayın şirketlerinin her açıdan büyümesine yolaçmıştır. Bugün dünyada uluslararası akademik dergi yayıncılığı sadece sınırlı sayıda yayıncının tekelinde bulunmaktadır.
Bizim bu yazımızda inceleyeceğimiz konu akademik dergi enflasyonu neticesinde ortaya çıkan yozlaşma ile sınırlıdır. Çalışmamızda ilk olarak ülkemizdeki akademik dergi enflasyonu konusunda bazı tespitler yaptıktan sonra yağmacı dergicilik ve torba kitap yayıncılığı konusunu inceleyeceğiz.
Considering the function of humanities and its comparison with other sciences, this research seeks to examine the scientific outputs and the weight of each, evaluation criteria and indicators, and the relationship between each output and criteria in the evaluation of these sciences Especially in language and literature. In terms of purpose, the research is applied, and in terms of the research implementation process, it is of a sequential and exploratory type. The steps of the work are as follows: 1. Identification and weighting of scientific outputs through the three steps of the library method, conducting interviews, and the Analytical Hierarchy Process (AHP); 2. Identifying the evaluation criteria of scientific outputs with the library method; and 3. determining priorities for evaluating scientific outputs through concurrent function deployment (CFD). Based on the findings, scientific outputs were divided into two categories: 1. Formats: scientific journal article, conference article, book, research project, and dissertation/thesis; 2. Activity: in policy-making, social (scientific-promotional), social (media), and economic contexts. Evaluation criteria are also divided into 8 categories: platform for creation, presentation and publication; writing structure; content; impact in online environment; scientific impact; social impact; economic impact; and cultural impact, each of which includes indicators. Finally, outputs and criteria have been prioritized according to three approaches and goals: production of science and promotion of knowledge foundations, applicability and responsiveness to society’s problems, literary creation/creative literature. Considering the importance and necessity of different evaluation of each field and discipline according to the nature of each one as an effective factor on the application and effectiveness of their scientific outputs, research policy makers can use a new approach in decision-making and establishing policies for evaluating the scientific outputs of the language and literature fields and humanities according to the results.
This is a critical review on gender issue, to understand and to evaluate the impact of the gender interven-tionism, with its costs, failures, paradoxes and other unwanted effects. This review uses the theoreticaland methodological frameworks from New-Institutional approach (Law & Economics, Public Choice,Constitutional Economic, etc.), to build bridges between Economy, Law and Politics, without confusionamong the social spheres and under the principle of reality, which rejects economic thaumaturgy, politicalromanticism and state paternalism. There is a historical-comparative review on the development of coerciveimplementation based on gender perspective and its agenda, from a macro-view to a micro level, focusingthe attention on the Spanish case. There is a final statement of its results, to clarify what kind of incentiveshave been given the gender bills and policies, the level of efficiency and institutional quality to solve socialproblems, the risks of an endless agenda and other unwanted effects, but foreseeable according to the principleof reality.
Este es un estudio neoinstitucionalista desde planteamientos de Economía Política Comparada, para comprender y evaluar la cuestión de género y sus efectos no deseados, como la paradoja del género. Resulta que cuánto más ha avanzado la regulación de género, en especial la inspirada por el feminismo trans (de construcción socio-cultural y sentimiento de autopercepción), parece haber disminuido el nivel de garantías jurídicas de la mujer cis (de base biológica y genética coincidente), además de causarse el efecto perverso de convertir la autonomía lograda en dependencia estatal. Se aborda aquí una presentación del problema, con una revisión histórica, comparada y de narrativas, aclarándose cómo el feminismo se ha impuesto, ocultando el sufragismo y otros movimientos de los derechos de la mujer. Se continúa con una refutación de falacias de género, desde el estudio de su producción en el mundo anglosajón y nórdico hasta su distribución desde ONU-Mujeres y la quinta generación derechos humanos, de género y etno-culturales. Finalmente, se centra la atención en un caso de trasplante de la materia, como es el caso español, evaluándose los “efectos no deseados” de su reciente regulación, además de probarse la paradoja citada. Se completa todo ello con unas conclusiones y futuras líneas de investigación.
(Prólogo)
La previsión del futuro atrajo el interés humano desde la confirmación de las primeras civilizaciones. Al suprimir al destino como causa última de los fenómenos sociales, la secularización complejizó ese proceso: los horizontes posibles se ampliaron y con ellos la capacidad de prever. La posterior instauración de las
democracias y el avance de la industrialización hicieron a las sociedades más complejas al tiempo que profundizaron la importancia de la intervención pública y la planificación. En el siglo xxi, las sociedades están atravesando cambios profundos, a gran escala y en velocidades aceleradas. La transición tecnológica,
el cambio climático y las amplias transformaciones en la organización y disposición del trabajo son algunos de los procesos que inciden sobre la vida de las/os ciudadanas/os. Esto presenta un desafío inédito para los Estados, que deben ser capaces de dar cuenta del carácter exponencial de los cambios en curso, y de
reflexionar acerca del futuro para poder actuar en el presente.
Para enfrentar este desafío, el Instituto Nacional de la Administración Pública puso en marcha el Programa INAP Futuro y, dentro de él, la Unidad de Prospectiva y Estudios del Futuro (UPEF). La UPEF es una apuesta estratégica del INAP, ya que el trabajo en materia de prospectiva tiene un rol fundamental en la innovación y la profesionalización del Sector Público, y su desarrollo es indispensable para la consolidación de un Estado al servicio de la ciudadanía.
Integrada por especialistas de la Dirección Nacional de Planeamiento Estratégico de la Capacitación; la Dirección de Gestión del Conocimiento, Investigación y Publicaciones (ambas del INAP); y el Centro de Investigaciones en Administración Pública (CIAP) de la Facultad de Ciencias Económicas de la Universidad
de Buenos Aires, el propósito de la UPEF es desarrollar diversas líneas de investigación referidas al futuro de la administración y el empleo público. Además, se dio la tarea de producir materiales de diverso formato que sirvieran para la difusión y la capacitación sobre la prospectiva y el análisis de escenarios futuros.
Materia Estado condensa el intenso trabajo desarrollado durante más de un año en la Unidad, con el fin de aportar a la comprensión de algunas de las tendencias más relevantes del futuro estatal. Mediante una combinación de metodologías y abordajes conceptuales, el equipo de la UPEF fue capaz de condensar y presentar, de forma clara y precisa, una serie de análisis interrelacionados sobre las principales dimensiones del Estado y su proyección en el tiempo.
El libro se centra en tres dimensiones: el empleo público, el uso de tecnologías digitales en la Administración Pública y la estructura estatal. Cada una de ellas es abordada en múltiples componentes, que organizan el desarrollo analítico.
El rigor teórico con que esta diversidad de temas es abordada merece ser destacado: los autores vinculan cuestiones específicas de la Administración Pública como rama disciplinar con elementos de la prospectiva y los estudios sobre escenarios futuros. Lo hacen de un modo que resulta accesible, sin sacrificar por ello la precisión requerida para un estudio de esta envergadura.
En un sentido similar, una característica distintiva de este estudio es su abordaje metodológico. La UPEF realizó decenas de entrevistas, talleres y grupos focales, combinados con desarrollos analíticos que emplearon las aplicaciones ATLAS.ti y MicMac. Este trabajo de campo formó el primer eslabón de una estrategia de trabajo, que continuó con la carga de información, su deconstrucción en dimensiones y subdimensiones, la construcción de categorías y la modelación. Esto redundó en el desarrollo de escenarios futuros para cada una de las dimensiones estudiadas, y, en paralelo, el diseño de modelos específicos para tres escuelas teóricas: Nueva Gerencia Pública, Poligobernanza y Neoweberianismo.
Como puede advertirse, esta estrategia surge de una construcción preliminar de un enfoque heurístico en torno a la prospectiva. La elaboración de un dispositivo analítico que permita estudiar escenarios futuros que no sean meras proyecciones del presente, sino que tengan en consideración la multiplicidad de posibilidades abiertas (así como la presencia de «cisnes negros»), es la función del equipo de la UPEF.
El trabajo colectivo de las/os investigadoras/es ha resultado en un libro de gran valor no solo para la reflexión sobre el futuro, sino también como insumo para el proceso de actualización permanente de la propuesta formativa y de capacitación del INAP. Así, Materia Estado constituye un aporte clave para la mejora presente y futura de las capacidades estatales.