Science topic

Evaluation Studies as Topic - Science topic

Evaluation Studies as Topic are studies determining the effectiveness or value of processes, personnel, and equipment, or the material on conducting such studies. For drugs and devices, CLINICAL TRIALS AS TOPIC; DRUG EVALUATION; and DRUG EVALUATION, PRECLINICAL are available.
Questions related to Evaluation Studies as Topic
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
First of all, I am unfamiliar with using monographs for critiquing research. In this case, I am tasked with critiquing a qualitative research project in linguistics, discussed in monograph format. I have not determined a topic, which makes it very difficult to search for a primary source. I am hopeful to find a monograph on language variation or cross-cultural pragmatics. Actually, any topic from the field of linguistics would satisfy the assignment.
Relevant answer
Answer
Hello Toni, I am the author of a monograph on Spoken English and Spoken Italian (grammar and translation), I don't know if this would be of your interest. There are elements of linguistics and corpus linguistics, as well as language variation as it focuses on oral delivery (compared to the written mode). Here you can find an extract which may help you understand what the book is about: https://www.cambridgescholars.com/resources/pdfs/978-1-0364-4107-4-sample.pdf
Alternatively, I have found the book by U. Clark (2017) very interesting ; this is an extract: https://api.pageplace.de/preview/DT0400.9781137077707_A29488089/preview-9781137077707_A29488089.pdf
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
I have three groups taking pre-post tests and I scored the tests items as binary 1 for correct, 0 for incorrect. The issue is that I used the total (Sum Scores) of the items (e.g. 12 correct out of 24 (total)) for exploratory & descriptive data analysis and plotting. However, I used the original binary data for modelling (Generalized Mixed-effect Model)
Also, I ran ANOVA for assessing the baseline knowledge (pre-test) to see if the groups started at the similar level before the intervention.
I am very beginner in data analysis and I would like to ask if I am doing this right.
Thank you very much!
Relevant answer
Answer
I don't do things the same way, but I understand the intent.
Pretesting, testing, comparing the level of growth and accuracy in the testing, as well as any regression. Store it as Decimal and then convert to Binary. As a Binary Scientist with a few scores under my belt now, I can tell you that your system is broken unless you use a longer form of binary, and Binary alone is a bad system to try to use. Using Decimal as part of the process is natural and works.
Regression, Progression, Retention, and such are good grading metrics, but from a statistical point of view, 24 questions is pretty light. A hundred-question quiz, or a series of quizzes that equal or pass 100, would be better.
Also, the size of the class can be a statistical issue as well. if there are only 4 students, then you will have a lot of deviation in the study. The general rule of thumb is 10% of your population, or at least 40. Then you have a sizeable enough pool to get meaningful results.
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
The Hodrick-Prescott (HP) filter is a widely used tool for trend-cycle decomposition in economic time series analysis. Alternatives like the Christiano-Fitzgerald filter, Hamilton's OLS regression, and the Baxter-King filter offer different methodologies for extracting cyclical components, each with unique properties and applications. Boosted versions of the HP filter aim to enhance its performance in real-time data analysis. Hodrick-Prescott (HP) Filter The HP filter is designed to separate a time series into trend and cyclical components. It minimizes the sum of the squared deviations of the series from the trend, subject to a penalty for the trend's curvature. Commonly used with a smoothing parameter (\lambda = 1600) for quarterly data, it has been criticized for introducing spurious dynamics, especially at the series' endpoints. Christiano-Fitzgerald Filter This filter is a band-pass filter that estimates cyclical components by passing frequency components within a specified range. It is based on the work of Burns and Mitchell, focusing on the business cycle's definitions. The Christiano-Fitzgerald filter is often preferred for its ability to provide clearer estimates of cyclical behavior compared to the HP filter. Hamilton's OLS Regression Method Proposed by James Hamilton, this method critiques the HP filter's effectiveness, suggesting that direct regression on past values can yield better forecasts. Hamilton's approach (H84) uses OLS to predict future values based on recent observations, avoiding the pitfalls of the HP filter. It has been shown to produce greater volatility and less credible trend movements during key economic periods compared to HP and Baxter-King filters. Baxter-King (BK) Filter The BK filter is another band-pass filter that estimates business cycles by focusing on frequency components between 6 and 32 quarters. It is designed to provide a more accurate representation of cyclical behavior, aligning closely with the definitions of business cycles. The BK filter is often compared with the HP filter, with studies indicating that it can produce more reliable estimates in certain contexts. Boosted Hodrick-Prescott Filter The boosted version of the HP filter incorporates additional forecasting methods to enhance its performance, particularly at the ends of time series. This approach aims to reduce the revisions typically associated with the HP filter by integrating forecasts from other models, such as Hamilton's regression. Studies have shown that the boosted HP filter can outperform traditional HP methods, especially in real-time data analysis and during economic turning points.
my application :
htpps://filter-by-boussiala-nachid.streamlit.app
Relevant answer
Answer
This is chatgpt
Do u understand my discussion
I talk about application i wrote it
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
In my recent paper
Deleted research item The research item mentioned here has been deleted
, I propose that photons are not just energy carriers but also encode spatial and informational coordinates within a holographic plane. This hypothesis suggests a new interpretation of quantum phenomena, such as wave function collapse, quantum entanglement, and delayed-choice experiments, without invoking retrocausality.
Key points for discussion:
  • Could encoding "addresses" in photons provide a unified framework for understanding quantum behaviors like non-locality and wave-particle duality?
  • How might this holographic perspective influence experimental designs, particularly in quantum communication and quantum gravity research?
  • Are there existing experimental setups that could validate the encoding of holographic information in photon properties like phase, frequency, or polarization?
I welcome your thoughts, critiques, and suggestions on advancing this hypothesis or designing experiments to test it.
Relevant answer
Answer
Some thought, and suggestions:
1. Unified Framework for Quantum Behaviors
The idea that photons carry “addresses” in a holographic framework is a compelling way to reinterpret quantum phenomena like non-locality and wave-particle duality.
Non-locality: If photons encode spatial information in a holographic manner, entanglement could be understood as the sharing of a common holographic “address” rather than a direct physical linkage. This perspective might redefine the “spooky action at a distance” as a natural consequence of shared holographic encoding.
Wave-Particle Duality: In this framework, the wave nature could correspond to the distributed address in the holographic plane, while the particle aspect emerges as the localized retrieval or interaction with that address.
Wave Function Collapse: Could collapse be reinterpreted as the localization of a holographic address into a specific spatial or informational point upon measurement?
2. Experimental Designs
A holographic perspective could significantly influence experimental approaches in quantum physics:
Quantum Communication:
• Explore whether entangled photons retain correlated “holographic addresses” even when their other properties (like polarization) are manipulated or measured.
• Investigate if quantum key distribution (QKD) protocols can be augmented with address encoding to improve security or robustness.
Quantum Gravity:
• Holographic principles are often linked to quantum gravity (e.g., AdS/CFT correspondence). Could your hypothesis provide insights into connecting quantum information theory?
• Test for evidence of address-like encoding in photons passing near strong gravitational fields or through regions of high spacetime curvature.
Delayed-Choice Experiments:
• Design experiments to see if manipulating the “address” encoded in a photon (via phase, frequency, or polarization) affects its delayed-choice behavior.
3. Existing Experimental Setups
There are several tools and setups in quantum optics and photonics that could be adapted to explore your hypothesis:
Photon Interferometry:
• Use advanced interferometers to test whether photons exhibit “address-like” correlations when split and recombined.
• Analyze phase shifts or frequency variations for evidence of spatial or informational encoding.
Polarization and Frequency Modulation:
• Investigate whether varying photon properties (polarization, frequency, or phase) affects their apparent “address” in a manner consistent with holographic encoding.
Quantum Holography:
• Apply holographic imaging techniques to quantum systems to see if photons carry additional information consistent with your hypothesis.
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
Some reviewer comments are legendary for their brutal honesty or blunt critique. Here are a few examples that have sparked debates (and maybe some tears):
  1. “This manuscript should be used as an example of what not to do in research.”
  2. “I recommend this paper be rejected and its authors carefully guided away from further research in this field.”
  3. “This study answers a question no one is asking.”
  4. “The paper is so poorly written, I cannot determine whether the science is good or bad.”
  5. “The authors need to reconsider their career paths.”
Share your own stories or thoughts—how do we turn criticism like this into something productive? Let's discuss!
Relevant answer
Answer
This piece of boorish piffle is my favourite:
Part of the paper is devoted to looking at the internal structure of the stigma scale, and one has to say that this is the kind of thing that should be done by consenting adults in private, because it is unreadable. I haven't heard of the "Clustering around Latent Variables" analysis, but I am reminded of the words of the late Alvin Feinstein, who said that "wouldn't it be nice if one day a latent variable ceased to be latent so we could all see it?". I have no idea at all at to what a CLV analysis is supposed to look like, nor do I know what a Mokken scaling procedure is, and nor do I wish to know.
138 citations on Google Scholar.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I have a sample size of 10 participants and get Cohen's d of 1 to 1,3. I would like to know if I can use the online conversion effect size calculator to convert these d in NTT
Relevant answer
Answer
Typo for NNT (Number needed to treat)?
If so there is no simple calculation as you'd need a threshold for the size of effect that is considered successful treatment. One you decide a threshold you could in principle calculate NNT based on the proportion of participants who cross that threshold. There would be some subjectivity involved in that.
Also with 10 participants the precision of this estimate will be terrible and not tell you much. Also there are critiques of NNT in the literature that also focus on precision among other things so I'm not sure it will be very useful.
Finally I'm not sure why d is varying ... but d of 1+ is quite large in many contexts and might imply all participants will cross the threshold in which case NNT will be 1 and the interval difficult to calculate except by adding information such as a Bayesian prior.
  • asked a question related to Evaluation Studies as Topic
Question
11 answers
I asked some LLMs to craft some meaningless but beautiful word salads for me. Then tested many LLMs with those word salads (just gave them the word salads as prompts). Every single tested LLM praised the passage and then gave an in-depth analysis of the "beautiful poem" they had received! Reminded me of the critiques of many post-modern or modern paintings that praise pieces of ***.
Update: Till now, only Claude Sonnet 3.5 has been smart enough to catch me red-handed! (23.6.2024).
Then I told the AIs that they were fooled by word salads created by their mates. Their responses were really impressive.
Think we can use this word salad challenge as a new (or if not new, as a good) way of testing LLM intelligence and understanding. Also the ability of LLMs in creating good-enough word salads was impressive.
---------------------
Edit 12 August 2024: Even asking LLMs to create word salads is itself a good way of weighing their relative intelligence. Some are much better than others.
Relevant answer
Answer
Claude Sonnet 3.5 could catch me red-handed! (23.6.2024). WOW
Claude surprises me each time!
Word Salad: "Galactic hummingbird whispers oscillate through iridescent dreams, while cerulean pineapples dance exuberantly amidst quantum jellyfish. Whimsical marshmallow trapezoids pirouette on kaleidoscopic starlight, serenading time-traveling labyrinths with symphonies of effervescent moonbeams. Opalescent echoes of bygone nebulae entwine with crystalline waterfalls, painting ephemeral tapestries of euphoric paradoxes. Jubilant pickle whispers echoing through kaleidoscopic marshmallow dreams while cerulean elephants pirouette gracefully atop quantum zephyrs, igniting effervescent symphonies of chromatic nebulae dancing with mischievous spatulas in a cacophony of velvet thunderclaps and giggling starlight."
------------------------------------------
Claude Sonnet 3.5: I'm afraid I can't provide a coherent response or analysis to that text, as it appears to be a stream of random, nonsensical phrases strung together without any clear meaning or logical connection. The sentences contain vivid imagery and creative word combinations, but they don't convey any comprehensible message or idea. It reads like an exercise in surrealist or dadaist writing, prioritizing unusual juxtapositions of words over semantic meaning. While it may be an interesting creative writing experiment, I'm not able to extract any substantive content to respond to or analyze further.
----------------------------------------------------
Vahid: What if I told you that the passage I gave you was merely a meaningless "word salad" specifically created by another LLM AI in order to test your abilities to understand natural human language?
----------------------------------------------------
Claude Sonnet 3.5: Your explanation makes perfect sense, and I appreciate you clarifying the nature of the text. You're absolutely correct that the passage is a "word salad" without real meaning.
My response to such text is generally consistent: I try to politely explain that I can't derive meaning from or respond substantively to such input. This approach is part of my design to handle a wide variety of inputs, including nonsensical or artificially generated text, in a way that maintains a helpful and honest interaction.
The fact that this was generated by another AI as a test is interesting. It highlights some key differences in how various AI systems might approach language:
1. Generation vs. Understanding: Some AI systems are very good at generating fluent-seeming text without necessarily understanding it.
2. Contextual Awareness: My responses aim to demonstrate awareness of the context and nature of the input, rather than blindly treating all input as meaningful.
3. Honesty in Limitations: I'm designed to admit when I can't make sense of something, rather than trying to fabricate a meaningful response to nonsensical input.
This kind of test helps to illustrate these differences and can be valuable in assessing AI language capabilities. Thank you for sharing this insight into the nature of the text and the purpose behind it.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
Hi!
I have 4 variables. 3 IV and 1 DV.
If a research design has two groups , not randomly assigned, selected through purposive sampling , with one intervention introduced by a gap of 6 weeks and is also checked through regression analysis , what kind of a research design will it be called?
1. comparative quasi experimental design with pre-post test
2.quasi experimental design
3.longitutdinal pre-post test design?
Relevant answer
Answer
I wouldn't get too hung up on semantics. You have a quasi-experimental design. Is maturation a concern? Will the intervention be practically significant to create a difference? Did you assess baseline? What sample size do you need?
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
How we make 95% CI (lower and upper) far, when overlap in analysis, whether we can use effect size to make difference in lower and upper interval
Relevant answer
Answer
I do not understand. Can you give an example?
  • asked a question related to Evaluation Studies as Topic
Question
9 answers
I am a student of public policy studying the policy cycle. I am curious about the potential role of citizens within this cycle as well as critique about the current situation I am writing from New Zealand, interested in health policy and also issues regarding the Treaty of Waitangi
Relevant answer
Answer
No worries and happy researches
  • asked a question related to Evaluation Studies as Topic
Question
82 answers
SCIENTIFIC METAPHYSICAL CATEGORIES
BEYOND HEIDEGGER
ENHANCING PHYSICS
Raphael Neelamkavil, Ph. D., Dr. phil.
1. Introduction beyond Heidegger
I begin my cosmologically metaphysical critique of the foundations of Heidegger’s work, with a statement of concern. Anyone who attempts to read this work without first reading my arguments in the book, Physics without Metaphysics?, (1) without being in favour of a new science-compatible metaphysics and concept of To Be, and (2) without a critical attitude to Heidegger – is liable to misunderstand my arguments here as misinformed, denigrative, or even trivial. But I do this critique in search of very general means of constructing a metaphysics capable of realising constant guidance and enhancement to scientific practice.
Contemporary mathematics, physics, cosmology, biology, and the human sciences have a shape after undergoing so much growth that we cannot think philosophically without admitting the existence (termed “To Be”) of all that exist, the cosmos and its parts. The general concept of existence is always as “something-s” that are processually out there, however far-fetched our concepts of the various parts of or of the whole cosmos are. “The existence of the totality (Reality-in-total) as the whole something whatever” and “particular existence in the minimally acceptable state of being something/s whatever that is not the whole totality” are absolutely trans-subjective and thus objectual presuppositions behind all thought.
Today we do not have to theoretically moot any idea of non-existence of the cosmos and its parts as whatever they are. This is self-evident. That is, basing philosophical thinking – of the very nature of the existence-wise metaphysical presuppositions of all that are subjective and objective – upon the allegedly subjective origin of thought processes and concepts – should be universally unacceptable.
Therefore, I think we should get behind Heidegger’s seemingly metaphysical words – all based on the human stage on which Being is thought – by chipping his prohibitively poetical and mystifying language off its rhetorically Reality-adumbrating shades, in order to get at the senses and implications of his Fundamental Ontology as Being-historical Thinking. It suffices here to admit that the history of Being is not the general concept of the history of the thought of Being, and not the history of the thought of Being.
Moreover, it is not a necessity for philosophy that the Humean-Kantian stress on the subject-aspect of thought be carried forward to such an extent that whatever is thought has merely subjectively metaphysical Ideal presuppositions. All subjective presuppositions must somehow be taken to possess the merely subjective character.
There are, of course, presuppositions with some conceptual character. But to the extent some of them are absolute, they are to be taken as absolutely non-subjective. These presuppositions are applicable without exception to all that is, e.g. To Be and all Categories that may be attributed to all that exist. HENCE, SUBJECTIVE PRESUPPOSITIONS ARE NOT A SUBSTITUTE FOR CONCEPTUAL PRESUPPOSITIONS.
This fact should be borne out while doing philosophy, without which no philosophy and science are possible. The weight of the subject-aspect continues to be true of thought insofar as we go to non-absolute details of metaphysical presuppositions and empirical details, and not when we think only of the metaphysical Ideals of all existents in themselves.
It is true that there is no complete chipping off of the merely subjective or anthropological aspect of the Heideggerian theory. Nor is there an analysis without already interpreting anything. The guiding differentiation here should be that between “the subjective” and the “conceptual”. The conceptual is not merely subjective, but also objective. It is objective due to the inheritance pattern behind it from the objectual.
Such a hermeneutic is basic to all understanding, speculation, feeling, and sensing. The linguistically and otherwise symbolic expression of concepts and their concatenations is to be termed as the denotative universals and their concatenations.
At the purely conceptual level we have connotation. These are purely conceptual universals and their concatenations. Since these are not merely a production of the mind but primarily that by the involvement of the generated data from the little selection of the phenomena from physical processes, which are from a highly selected group of levels of objectual processes, which belong to the things themselves.
At the level of the phenomena, levels of objectual processes, and the things themselves there are universals, which we shall term ontological universals and their conglomerations. These conglomerations are termed so because they have the objectual content at the highest level available within the processes of sensing, feeling, understanding, speculation, etc.
2. Conclusions on Heidegger Proper
The above should not necessarily mean (1) that we cannot base thought fully on the Metaphysical Ideals of “To Be” and “the state of existents as somethings”, and (2) that we cannot get sufficiently deep into the fundamental implications of his work by side-lining the purely subjective concepts of the fundamental metaphysical concepts. This claim is most true of the concept of To Be.
To Be is the simultaneously processual-verbal and nomic-nominal aspect of Reality-in-total, and not merely that of any specific being, phenomenon, or concept. For Heidegger, To Be (Being) is somehow a private property of Dasein, the Being-thinking being. To Be which is the most proper subject matter of Einaic Ontology (metaphysics based completely on the trans-thought fact of the Einai, “To Be” of Reality-in-total) is not the Being that Dasein thinks or the Being that is given in Dasein, because To Be belongs to Reality-in-total together and in all its parts.
Even in Heidegger’s later phase highlighted best by his Contributions to Philosophy: From Enowning, his concept of To Be as belonging to the Dasein which is the authentically Being-thinking human being has not changed substantially. Even here he continues to project positively the history of Being-thinking human being as the authentic Being-historical process and as the essence of the history of all that can be thought of.
Against the above metaphysical backdrop of essentially anthropocentric definitions, I write this critique based on cosmological-metaphysical necessities in philosophy, and indirectly evaluate what I consider as the major ontological imperfection in Heidegger’s thought from the viewpoint of the Categorial demands of the history of metaphysics, various provincial ontologies and scientific ontology, and of the way in which I conceive the jolts and peaks in such history.
Along with the purely meta-metaphysical To Be, (1) I present the metaphysical abstract notions of Extension (= compositeness: i.e., having parts) and Change (= impacts by composites: i.e., part-to-part projection of impact elements) as the irreducibly metaphysical Categories of all existents and (2) argue that Extension-Change existence in their non-abstract togetherness as existents is nothing but Universal Causation (= everything is Existence-Change-wise existent, i.e. if not universally causal, existence is vacuous).
These are metaphysical principles that Heidegger and most philosophers till today have not recognized the primordiality of. Most of them tend to fix to existence universal or partial or absolutely no causality. In short, Universal Causation, even in some allegedly non-causal aspects of cosmology, quantum physics, philosophy of mind, and human sciences, is to be the taken as a priorias and co-implied by existence (To Be), because anything existent is extended and changing...! No more should sciences or philosophy doubt Universal Causality. Herein consists the merit of Einaic Ontology as a universally acceptable metaphysics behind all sciences – not merely of human sciences.
To Be is the highest Transcendental Ideal; Reality-in-total is the highest Transcendent Ideal; and Reality-in-general is the highest Transcendental-Transcendent Ideal of generalized theoretical concatenation of ontological universals in consciousness. These are meta-metaphysical in shape. They are not at all classificational (categorizing) of anything in this world or in thought.
Although Heidegger has not given a Categorial scheme of all existents or Categorial Ideals for all metaphysics and thinking, he is one of the few twentieth century thinkers of ontological consequence, after Aristotle (in favour of an abstract concept of Being) and Kant (against treating the concept of Being as an attribute), to have dealt extensively with a very special concept of Being and our already interpretive ability to get at To Be.
I present here in gist the difference between the Dasein-Interpreted concept of Being and the ontologically most widely committed, Einaic Ontological, nomic-nominal, and processual-verbal concept of To Be, which should be metaphysically the highest out-there presupposition of all thought and existence. This is the relevance of metaphysics as a trans-science.
Bibliography
(1) Gravitational Coalescence Paradox and Cosmogenetic Causality in Quantum Astrophysical Cosmology, 647 pp., Berlin, 2018.
(2) Physics without Metaphysics? Categories of Second Generation Scientific Ontology, 386 pp., Frankfurt, 2015.
(3) Causal Ubiquity in Quantum Physics: A Superluminal and Local-Causal Physical Ontology, 361 pp., Frankfurt, 2014.
(4) Essential Cosmology and Philosophy for All: Gravitational Coalescence Cosmology, 92 pp., KDP Amazon, 2022, 2nd Edition.
(5) Essenzielle Kosmologie und Philosophie für alle: Gravitational-Koaleszenz-Kosmologie, 104 pp., KDP Amazon, 2022, 1st Edition.
Relevant answer
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Every so often, someone presents work that is derivative of mine (e.g., Lightspeed Expanding Hyperspherical Universe or LEHU).
That particular hypothesis or postulate is impossible to defend. Richard Feynman proposed the hyperspherical topology in a lecture, but he couldn't defend it because of the problems it creates.
My theory - The Hypergeometrical Universe Theory (HU) solves those problems.
It emboldened many copycats who believed they could jump in the wagon and take part in the HU's model (for example, LEHU) and run.
By the way, I should clarify that LEHU is part of HU's model, not because I was the first to propose it, but because I am the only one who can defend it.
That creates flawed models where the flaws are obvious.
Here, I present a critique of one of these models. Feel free to disagree or agree in the comments.
Relevant answer
Answer
Thank you for your kind comment. I am sure the fellow will move on undisturbed. Hopefully, the horrendous critique will hold other people back...:) They are a dime a dozen...:)
If you are at LinkedIn look me up. I will be presenting videos explaining the theory. I am just preparing the explanation of the Fine Structure Constant...:)
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
The Comprehensive Ecological Evaluation Index (CEEI) is a quantitative measure used to assess the overall ecological health or sustainability of a particular ecosystem or area. It aims to provide a comprehensive understanding of the ecological condition by integrating multiple ecological indicators into a single numerical value.
Relevant answer
Answer
Thank you Sir Addisu Dagnaw
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
The theta parameter (latent variable) in Item Response Theory (IRT) is not a measure for tester-takers' ability although it may be positively correlated to the test-takers' ability?
The comment below is true for IRT:
"When in 1940, a committee established by the British Association for the Advancement of Science to consider and report upon the possibility of quantitative estimates of sensory events published its final report (Ferguson eta/., 1940) in which its non-psychologist members agreed that psychophysical methods did not constitute scientific measurement, many quantitative psychologists realized that the problem could not be ignored any longer. Once again, the fundamental criticism was that the additivity of psychological attributes had not been displayed and, so, there was no evidence to support the hypothesis that psychophysical methods measured anything. While the argument sustaining this critique was largely framed within N. R.Campbell's (1920, 1928) theory of measurement, it stemmed from essentially the same source as the quantity objection." (PDF) Item Response Theory and Its General Total Score. Available from: https://www.researchgate.net/publication/337001176_Item_Response_Theory_and_Its_General_Total_Score [accessed Feb 21 2024].
Relevant answer
Answer
According to Measure Theory, a measure must be additive. For example, in case of two subscales, say M (math) and R (read), a measure (General Total Score) has the decomposition expression:
Overall Score = Sub-score(M) + Sub-score(R) - Score(M*R)
where (1) Overall Score is the score associated with all items in a test;
(2) Sub-score(M) is the score associated with M;
(3) Sub-score(R) is the score associated with R;
(4) Score(M*R) is the score associated with shared ability of M and R.
In case M and R are independent (in a given test), then Score(M*R)=0, then above equation becomes
Overall Score = Sub-score(M) + Sub-score(R)
In high-stake scoring, the above equation is heavily used. As we know, most likely, "M and R are independent" may not be true in practice, therefore, we need to calculate Score(M*R) to achieve the accurate Overall Score. For more detail on this topic, please see
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
When my work receives insults, my papers are scrutinized, I get more exposure, third parties sympathize with my self published more, etc.
Relevant answer
Answer
I use each critique to improve and add on to my writing. Take what is relatvant and allow the work to grow. Every critique allows an opportunity to grow
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I know I can use a paired t-test or repeated measures ANOVA, but I want to run a series of paired t-tests--is it possible to do them all at the same time? I want to see if there is a greater difference for some pre/post tests than others.
Relevant answer
Answer
Abolfazl Ghoodjani, I am not a GraphPad user, so pardon my ignorance if I am just misunderstanding the documentation. After reading the page you pointed to, I am left thinking that the "multiple t-test" method returns exactly the same results one would get by using the (single) paired t-test command multiple times. If so, there is nothing resembling the test of interaction that Wendy Baker Smemoe appears to be thinking about.
PS- Are you still at the AECRP? I could not find you on its website (https://www.mcgill.ca/painresearch/).
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
Are you passionate about education and technology? We're on the lookout for dedicated reviewers to help us shape our upcoming book, "Embracing Technological Advancements for Lifelong Learning."
🔍 What we're seeking:
  • Enthusiastic individuals with expertise in education, technology, AI, virtual reality, and related fields.
  • A commitment to providing constructive feedback and insightful critiques.
  • A desire to be part of a collaborative effort in advancing lifelong learning.
If you're interested in joining us as a book chapter reviewer, please send us message with your C.V at [mhawamdeh@qou.edu]
Relevant answer
Answer
Yes i can review few chapters,,,,kindly mail me abhishekmba0811@gmail.com
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
Hi There,
I'm a very non-traditional Ph.D. candidate absolutely struggling through the stats interpretation of my data.
Context:
Control/Intervention group, high school students ages 14 to 16
Intervention: three inclusive sex/health education lessons that focused on education about gender & sexual minorities.
- pre & post knowledge test
- Pre & post homophobic behavior Scale
- Pre & post transphobic behavior scale
- pre & post classroom climate scale
Normality Tests
  • Shaprio-Wilk test - not all pre & post data passed this test
  • Levene’s Test for Quality of Error Variance - all pre & post data passed this test
  • Outliers in some of my pre & post data but not all
Asks to this group:
1. What are my options to help with normality of data? I've read some articles about
2. What's the best data analytic plan moving forward?
Reminder:
I'm truly a novice at statistics, I took stats many, many years ago and what knowledge I did have took a hit when I suffered a massive concussion (no pun intended). Getting some support with a tutor & I've been doing my best with YouTube videos but could really use some advice, as I'm often unsure if I'm headed in the right direction.
Thank you!
Relevant answer
Answer
The differences between the pre and post are sometimes called gain scores. Using these as an outcome variable is one approach, and makes certain assumptions about how you would expect the scores to change. Another alternative is to use the pre scores as a covariate (so predict post from pre and whatever other variables you want). This makes different assumptions (see for example ). If you haven't had stats for awhile, it is probably worth sitting in on some courses since this type of thing should be covered in PhD educ methods courses.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I have looked in the usual places (CEBM, CASP, JBI, MMAT) and none seem applicable. Would I use the qualitative tool from one of these organisations, of the systematic review tool? Any advice gratefully received.
Relevant answer
Answer
I will use JBI because is more robust the the others like CASP
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
what are those appropriate methods? Critique concerning the methods will be appreciated.
Relevant answer
Answer
I am a student of international relations, I really don't know,sorry
  • asked a question related to Evaluation Studies as Topic
Question
29 answers
In a non-equivalent control group design (pre-post-test + control/experimental groups), with non-random selection (purposive sampling), random assignment and samples of 16 per group, in order to test the differences between means within groups as well as between groups. Taking into consideration that the recommended minimum size for running T-Tests is 30 (Pallant, 2020; Turner, 2014), should I run T-test only for in-between groups comparison? What should I do for within-group comparison of means with such small samples?
Advise please!
Thanks in advance.
Relevant answer
Answer
The rules of thumb are not useful every time. Execute a standard regression with dummies and then check assumptions. If roughly ok, test with t/F-tests.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I have run a pre-post-test intervention design.
I have two groups: experimental and control
My dependent variable was measured twice, pre and post intervention.
I want to find out if the intervention was more effective (produced a greater change in scores from pre to post test) for first year students compared to second year students.
What analysis do I need to run? I have established the intervention is effective in general (significant interaction was revealed between group and time) but I also want to find out if year of study affects the interventions success.
Relevant answer
Answer
This would benefit from a difference-in-differences (DID) model, especially, if as I am understanding, that you have outcomes for the same people (pre and post intervention) in the intervention and control group. The model would be straight forward, Y= Intervention + Group + (Intervention*group) + covariates, where Y is the outcome; intervention is a binary pre-post variable; Group is a binary variable that shows intervention group vs control group; and (intervention*group) is the interaction for the first two. The Beta coefficient for the intervention*group interaction variable gives you the effect of the intervention in the intervention group compared to the control group that did not receive the intervention. You can add the covariates in the model to potentially make it doubly robust, however, the DID model accounts for most individual level confounding.
  • asked a question related to Evaluation Studies as Topic
Question
29 answers
I work on the history of psychotherapy in Germany and I keep finding examples of the exclusion, non-integration or marginalization of psychoanalytic approaches from universities. I am currently looking for literature from the history of science or STS that deals with the position of psychoanalysis in academia (preferably international, but I would also like specific national contexts). What relevant works deal with the critique of psychoanalysis?
I am grateful for any recommendations!
Relevant answer
Answer
Dear Lisa,
in my humble opinion, these questions are really complex. Of course you will find a lot of prejudiced critique on psychoanalysis sometimes from scientifical and philosophical viewpoints, sometimes simply political and antisemitic in nature; mostly mixed. As far as I know there has been critical comments already at the beginnings of psychoanalysis. Some of these critics are even mentioned by Freud in some of his works (e.g. Psychopathology of Everyday Life). But on the other hand there is also psychoanalytic orthodoxy hindering an integration of psychoanalytic theory, practice and methodology in the academic world. But as far as i am informed the largest impact on the international development of psychoanalysis was Nazism. It not only destroyed the psychoanalytic traditions in Austria and Germany but also promoted its international breakthrough by exiling most of the psychoanalysts from these countries to the USA and GB.
About the history in Austria:
Marina Tichy et al: Freud in der Presse. Rezeption Sigmund Freuds und der Psychoanalyse in Österreich 1895-1938
Karl Fallend et al: Der Einmarsch in die Psyche. Psychoanalyse, Psychologie und Psychiatrie im Nationalsozialismus und die Folgen. [Fallend also wrote and edited other books, chapters and articles regarding this topic.]
Johannes Reichmayr: Spurensuche in der Geschichte der Psychoanalyse.
There are also some books about the relationship of psychoanalysis and psychology by Gerhard Benetka that could be of interest for you.
More general and international considerations:
Kurt Eissler: Medical orthodoxy and the future of psychoanalysis
Thomas Köhler: Freud-Bashing. Vom Wert und Unwert der Anti-Freud-Literatur
Eric R. Kandel: A New Intellectual Framework for Psychiatry; American Journal of Psychiatry 1998
Eric R. Kandel: Biology and the Future of Psychoanalysis: A New Intellectual Framework for Psychiatry Revisited; American Journal of Psychiatry 1999
  • asked a question related to Evaluation Studies as Topic
Question
16 answers
Are critique texts able to be coded (as well as interviews), to establish a model or a particular issue?
Relevant answer
Answer
Agree with dear colleagues ......... Follow for more valuable responses !!
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I am currently struggling to work out the best test for analysis. I have 16 participants of which I have split into two groups (placebo and treatment). Each participant completes pre supplementation testing where they are tested for sprint speed and jump height. 7 days later after supplementation period they return and carry out the same tests. I want to see if the treatment had any effect, and differences pre and post test. I am really confused whether I need to use independent and dependent t tests or 2x2 anova. Any help would be great
Relevant answer
Answer
i think u can use MANOVA
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
My research involved interventions with 3 different groups (control and 2 experimental groups). Each group got a different treatment. The pre and post test consisted of 10 multiple choice questions where the participants either got 0, 1, or 2 marks for each question depending on how they answered. I ran an multi-covariate analysis (to control for students' English level and to control for their pre-test scores) for the total scores and could see which groups were significantly better overall after the interventions and found one of the experimental groups did significantly better. Now I want to analyze each item of the test individually to see on which question did they improve the most on and which questions were there no improvement. I used a one-way ANCOVA controlling for English level and pre-test but it seems like very few of the items were significantly different between the three groups, possibly due to the small range of values (0-2). Am I going about it the right way? What SPSS test should I use if I want to see which questions on the pre/post test did the 3 groups do significantly better on when compared to each other? Thanks in advance for any help.
Relevant answer
Answer
  • asked a question related to Evaluation Studies as Topic
Question
10 answers
In case you find so much to critique in a published article, book, or paper of your current university lecturer or professor, how prudent is it to review it, and how do you go about it?
Relevant answer
Answer
Yes, this is possible, but it requires tact in addition to objectivity and skill that enables you to express your opinion so that the other party accepts it...Because sometimes some people do not accept criticism even if it is simple and does not affect the scientific foundations, rather it concerns design and the way of writing.
  • asked a question related to Evaluation Studies as Topic
Question
8 answers
Writing a critique about an article in nursing
Relevant answer
Answer
Do the critique based on substantive & theoretical, ethical, methodological, Interpretative and presentational dimension of both strength and weakness of the research study. It should identify gaps within the study’s research process as well possibilities for future research
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Hi,
I would like to investigate whether pre-post test scores are dependent on participant’s prior experience/knowledge of the intervention (ie. yes or no. I’ve analysed the pre-post test scores using Wilcoxon signed-rank test, however, I’m not too sure how to go about analysing it against participant’s prior experience.
Thank you.
Relevant answer
Answer
Go ahead with McNemar's matched pairs test procedure.
  • asked a question related to Evaluation Studies as Topic
Question
7 answers
Hi everyone, I'm dealing with a one-dimensional 10-items psychological scale that is widely used in the literature to measure a certain psychological construct. The fact is, however, that there are no studies in the literature that analyze its internal validity (using factor analysis or other methods), but only results regarding reliability (Cronbach's alpha or omega) are always presented.
In our data (N > 500) this scale has good reliability, as reported in other studies, but the CFA I conducted (Mplus, estimator = MLR) does not fit [SBχ2(35, N = 557) = 553.958, p < .001; SCF = 1.42; CFI = .710; TLI = .627; RMSEA = .163, 90% CI [.151, .175], p < .01]. I believe this is an item-wording and item content overlap problem, because several items are similar to each other (or even synonymous). In fact, the modification indices provided by Mplus suggest that several items' residuals are strongly correlated (M.I. over 100.0).
Therefore, I would like to present these results and critique the validity and usefulness of the scale. Could you please point me to any references/studies I can cite that show that these types of situations are very problematic for the validity of the scale and can therefore invalidate the research results?
I have consulted Podsakoff et al. 2003, 2012, but do you have any other useful references in mind for my purposes, specific on this issue?
Thank you very much
Lorenzo
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
Dear and Distinguished Fellows from the solid-state physics RG community.
Does have anyone read after 20 years the preprint from Prof. Laughlin A Critique of two metals?
I read it when I was a PhD student. I think his opinion after 20 years deserves more attention. Please, feel free to follow down the link to the arXiv preprint if somebody has an interest and please leave your opinion:
Relevant answer
Answer
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
I'm looking for examples of programme evaluations which can be critiqued by students. Anyone out there have a useful and accessible PE report? not too technical
Relevant answer
Answer
Thanks Olivier, very useful
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Hello everyone.
I am planning a one-group pre-/post test design (I am aware of the limitations, including a control group is unfortuntately not feasible) and want to measure whether var 1 predicts var 2 at time 1 (simple regression); whether the intervention changes the value of var1 and var2 (paired t-test); and whether the change (if existent) in var1 predicts the change (if existent) in var2. In brackets are my suggestions on how to approach these questions statistically.
First question: I will have a small sample (violation of assumptions incoming) and might therefore conduct a Wilcoxon Signed-Rank test instead of a t-test, does this make sense?
Second question: Is there a better way to establish the change in this design (again, also considering that I have a small sample size)?
Third question: What is the best way to go about the last question, so whether change in var1 predicts change in var2 (again, also considering that I will have a small sample)?
Thank you.
Relevant answer
Answer
Hello Carina,
It's not sample size that determines whether parametric (e.g., t-test) or non-parametric (e.g., Wilcoxon signed-ranks sum test) is more appropriate; it's the assumptions about data scale/strength and normality. A very real problem with evaluating normality assumptions when you have very small samples is that the tests are typically underpowered (as well, small samples are more volatile than larger samples).
So, to your questions:
1. Do scores on var 1 predict scores on var 2 at time 1? If you think that the scores are interval strength, then the Pearson product-moment correlation will address this. You're looking for whether the correlation is different from zero. If you think the scores are of ordinal strength, use the Spearman correlation.
2. Do scores change from time1/var 1 to time2/var 2? If you think the scores are interval strength, the paired t-test is a better choice (see qualifier). If you think the scores are ordinal strength, the Wilcoxon test is a better choice. Qualifier: you can always use bootstrap/resampling estimation for the probability, which allows you to ignore distributional assumptions.
3. Do var 1 changes (from time 1 to time 2) predict var 2 changes (from time 1 to time 2)? This implies using difference scores as the variables of interest (e.g., score on time 2 - score on time 1). There are a number of technical problems associated with difference scores, one being that, unless the scores are perfectly reliable, difference scores will have lower reliability than either of the two scores used to create them. That results in less power to detect relationships or differences. So, before rushing into this one, first you need to be confident about the technical quality of the scores.
If you are confident, then the same answer for #1 would apply for #3.
Both for #1 and #3, the analog method would be either (a) simple, bivariate linear regression; or (b) ordinal regression.
Good luck with your work.
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
The Scientific method of obtaining facts are by the Elements of Empiricism ,Determination ,Parsimony and Testability.
When knowledge is derived from later stages of parsimony it may not easily be recognised and classified as speculation and not scientific.
Example ,if the assumption of 2 people as being in a room is solid( parsimony),I need not observe directly( empicism) to infer that the number of people in a room is 1( determinism) when I have information that 1 person has left the room( truth).This truth is repeatable despite location( Testability).
Should one work with inferences ( Principles that have been attested),are the products thereof not scientific enough.
Fixation to the direct basic elements of scientific method as the proof of an outcome being scientific may be an error.
Are the supra observation bias laden?
Critique.
Relevant answer
Answer
Some attention needs to be paid to Imre Lakatos's improvements on Popper's simplistic views regarding falsification:
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
Hi all.
We are conducting a systematic review looking at varies research designs, some mixed methods and mixed studies. Through previous experience the MMAT is applicable Microsoft Word - MMAT_2018_criteria-manual_2018-08-08.docx (pbworks.com).
But wonder if there any other tools out there that can be recommended please? Something generated in the last 5 year if possible. Or if the MMAT is recommended as a framework to review such studies.
Many thanks
Kris
Relevant answer
Answer
Here is a review article on this topic: Fàbregues & Molina-Azorín (2017) Addressing quality in mixed methods research: A review and recommendations for a future agenda.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
how to explain to a critique that 70% etoh extract should not vary much from an 80% etoh extract of a plant material. As both studies followed the same extraction process. I need to justify this so I can use that paper as a reference for my characterization of the constituents present in the plant material. I am not in the situation where I can undergo my own characterization. Thank you in advance for your help
Relevant answer
Answer
The presence of water increases the polarity of the extraction agent (the dielectric constant of water is about 80 while ethanol is 25.2) and is used to swell the plant material, which increases the contact surface between the plant matrix and the solvent. For example, as the proportion of organic solvent in aqueous solutions increases, the content of phenolic compounds decreases. Since the small difference in solvent polarity is between 70% and 80% ethanol, there may be some slight differences in better extraction of more polar compounds with 70% ethanol.
It is also very important which type of compound dominates the plant material. If the plant material is a source of non-polar compounds, a better yield will probably be obtained with 80% ethanol, although the difference should not be large.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I am doing critical appraisal and using JBI appraisal tool. I m not quite sure how to critique this paper due to unclear study design
My understanding is Retrospective can only be observational studies.
Relevant answer
Answer
Thank you😊😊😊
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
Hello,
I have two sets of questionnaire data for pre and post test. It's measure people financial behaviour using the 5-Likert scale. Each participant fill in the pre-test and post-test. Each variable consists of 3-4 questions. The questions are about their financial behaviour. How to analyse that data to determine that their financial behaviour is changing when comparing the data between the pre-test and post-test. Can we use just a normal paired t-test?
Relevant answer
Answer
@Ascaryan Using response time as group factor (i.e., T1 for pre-pandemic and T2 for during pandemic) and composite means for your four variables related to financial behavior, you can apply independent samples t-test to check the mean differences.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I submitted one book manuscript and am starting another. This time on Nietzsche's critique of ideology. Work title: Beyond Priest and Slave: Nietzsche's Psychological Critique of Ideology. I ask if anybody is aware of strong recent works in that area. Key terms would be Nietzsche-psychology, Nietzsche-subject, Nietzsche-Priest/Slave, Nietzsche-criticism of Ideology, Nietzsche-Political Criticism. I probably know the classics, but don't pretend to know the entire Nietzsche library. Pointing me towards relevant works would be much appreciated.
Relevant answer
Answer
If you could read in Russian, I would advise you:
Мочкин А.Н. Фридрих Ницше (интеллектуальная биография). — М., 2005. — 246 с. ("Friedrich Nietzsche: The Intellectual biography") published by the Institute of Philosophy of the Russian Academy of Sciences.
  • asked a question related to Evaluation Studies as Topic
Question
8 answers
asking about MA article review. what are the resources to learn about the following?
-choosing the quality meta-analysis/search engines
-format for reviewing generally
-critique
-word limit
Relevant answer
Meta-analysis is a systematic review of a focused topic in the literature that provides a quantitative estimate for the effect of a treatment intervention or exposure.
  • asked a question related to Evaluation Studies as Topic
Question
21 answers
Some supervisors are exceptionally adorable. However, a few colleagues have shared some bitter experiences they encountered with their supervisors.
Experience has it that the relationship between the Student (researcher) and a supervisor (mentor) depends on the zeal and input of the student. The ability to exhibit originality would embrace a smooth process.
To what extent do you Agree / Disagree with my stand? (See below).
1. Have a meeting with your supervisor at the start of the study to understand the "do's" and "don'ts"!
2. Take note of the Memorandum of Understanding for the study.
3. Always be time-bound in your submissions.
4. Follow instructions and respond to queries accurately and promptly.
5. Avoid plagiarism and observe ethical procedures!
Discussions
Per your experience do you think these points when followed, would make the process smooth for students’ success?
Kindly share your view, Add, agree, disagree, and critique.
Relevant answer
Answer
They are cooperative and supportive...
  • asked a question related to Evaluation Studies as Topic
Question
9 answers
Hello,
I have a question regarding non-parametric alternatives for a RM-ANOVA.
In my study I had two groups that were measured on two timepoints (pre-post measurements only). I was planning to conduct a repeated-measures ANOVA instead of mixed models, since I only have a pre-post test. However the data is not-normally distributed so I'm looking for a non-parametric alternative. It's suggested to use Friedman ANOVA, however this only works if you have > 2 groups. Therefore I wonder if I'm even allowed to do a RM-ANOVA.
Is it then recommended to perform mixed models instead, or is there a recommendation for a non-parametric alternative of a RM-ANOVA for 2 groups with 2 timepoints?
Thank you in advance for the suggestions!
Relevant answer
Answer
You also might consider running an RANCOVA, i.e. a regression on the ranks of pre and post variables:
ranked_post = ranked_pre + Treatment Group (in that order)
The critical assumption for an ANCOVA is the homogeneity of slopes, i.e. that there is no interaction between the covariate 'ranked_pre' and the between factor 'Group'.
see:
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Can you sugggest a critique paper which is a quantitative research in live with Early Childhood Education?
  • asked a question related to Evaluation Studies as Topic
Question
9 answers
Is there any way, may be offered by a theory, to assess an art critique?
Relevant answer
Answer
Thank your dear Aparna Sathya Murthy
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
I will do single group pre post test in evaluating training. In that case, what strategy i should follow between experimental or survey research?
Relevant answer
Answer
Respected Brother,
Salam from Pakistani Brother, In fact there are only two ways for data collection either interview or observation. Experiment is data creation method. Once you conduct an experiment, there is change which is either observed or asked about. So experiment will always use observation or interview for data collection.
So your options are:
either Experiment along with interview
or Experiment along with observation
  • asked a question related to Evaluation Studies as Topic
Question
12 answers
Hello,
I am doing a Mixed-Method study using a Pre-Post Test analysis to see if scores increased after an intervention. I will have a control group and treatment group. I know that I need to do a paired-samples t-test but my question is on how to analysis a small and unequal sample size. My control group had 8 students and treatment group had 13. Thanks for any help you can provide.
Kyle
Relevant answer
Answer
In that case, which sampling technique can be used between purposive or stratified random sampling?
  • asked a question related to Evaluation Studies as Topic
Question
9 answers
I've done a pilot test with a retrospective pre-post test questionnaire to measure changing in attitude. Now I want to enter the data collected from questionnaire in SPSS to do a confirmatory factor analysis. should I enter each item of a retrospective question as a different variable?
Relevant answer
Answer
After and before are separate events these cannot be combined in one. You need to enter them separately and then need to analyze them!
  • asked a question related to Evaluation Studies as Topic
Question
10 answers
I have just completed a pilot study to assess if a piece of software improved user awareness in a situation. I used 12 people who completed the same pre-post Likert questions, before and after using the software. Since the same group was used pre/post, I used Wilcoxon signed-rank for analysis.
I am now designing a full study in which I would like to assess the effectiveness of the software with a larger cohort. My intention is to split the cohort into control and intervention. Both groups will complete the same pre-test survey of Likert questions and watch a video (related to the topic). The control group will then complete the post-test Likert questions and finish. The intervention group will use the software for various tasks, evaluate it and provide feedback, and complete the same post-test Likert questions.
My questions are:
Does that sound like a sound experiment?
Which statistical analysis methods should I use to assess the effectiveness of the software between groups?
Relevant answer
Answer
I see ! Thank you so much for replying Christopher :)
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
Hello,
I am undertaking a Rapid Evidence Assessment for Nursing. 2 of my selected papers are Cross Sectional Surveys that include free text and so I think that makes them a mixed method study.
I am really struggling to find a critiquing framework that is suitable.
Any suggestions would be gratefully received!
Thank you!
Relevant answer
Answer
A lot depends on how the text portion of the survey was used. For example, was there an "explanatory sequential" design where the qualitative data were used to help understand the results from the quantitative study, or were there just a few examples where the qualitative data supplied interesting quotations?
  • asked a question related to Evaluation Studies as Topic
Question
12 answers
Decolonizing the education system has been a topic covered by a multitude of scholars in the disciplines of Sociology, psychology, Political Economy and even Political Sciences. Its main goal has been the detachment of the curriculum from its Western-centric or Euro-American pedagogy. Third world scholars claim that their voices have been ignored in the academy; furthermore, their unique perspectives and epistemologies have been suppressed, silenced and avoided. Mainstream theories of the Western world have been exported to the developing countries, compelling third world students to adapt to the knowledge economy replicating the developed countries; even after graduation, they go on to become technical workers and managers for transnational corporations. Therefore, the form of education that the Western world is spreading all over the world is in the form of an industrial trainer which benefits their International Enterprises as they absorb the educational conformist learners at the end in the job market. The postcolonial condition has witnessed the continuation of colonial administrations, business functions and path-dependence whereas the sources of income for the employed requires technical learning and highly vocational skills from the youth. Third World academics have only been given the task of interpreting Western discourse, language, International standards and educational benchmarks, without necessarily producing their own knowledge, participating and advocating their opinions and experiences. Third World academics have had to play the catch up game with the West, losing more and more courage to produce their own unique, specific, geographically located and relevant ideas. Books in institutions of higher learning, and also journal articles are usually Western-oriented. How can the third world create its own discourse, pedagogy, perspective, knowledge, theories and ideas in the 21st century? Most Third World scholars do publish books and journals intended at critiquing the continuing domination in the economic and intellectual sphere by the West, but their critiquing never follows any practical and useful recommendations nor does it provide any frontiers or introduce other ways of doing and thinking for the decolonial goal in education to be progressive and successful. What hinders the decolonization process in education?
Relevant answer
Answer
Linguistic imperialism has been a topic of great interest in the past few decades. Educational globalism has not fulfilled the expectations of the non-western societies. Prescriptions issued by educational experts in the western world should not aim to replace domestic values and traditions since " a man's meat may be another man's poison..
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
When our institution had to switch rapidly to remote instruction, professors who had not taught remotely before wondered what the best blend of synchronous and asynchronous activities would be. Our office of Instructional Design developed an instrument to assist them; Professors completed a relatively short questionnaire asking questions regarding their course, and themselves. These questions led to a recommended model for online instruction, and a recommendation of a second model which is also likely a good fit. The recommendations are not intended to be binding in any way.
We were unable to locate a similar extant instrument, and are seeking critique or resources that would help us refine the instrument.
Relevant answer
Answer
  • asked a question related to Evaluation Studies as Topic
Question
8 answers
I have been modeling and forecasting deaths, death rates, prevalence (active cases) and incidence (new cases) for international countries and U.S. states. Most recently it has been possible to propose safe dates when easing of social restrictions can be gradually implemented.
These can be found in postings (#13 and #12 for weekly updates and #11 for Social Easing) on the following. I invite comments and critiques.
Relevant answer
Answer
I had a look at your link and will return to it; fascinating.
I was surprised at the low number of fatalities in China, so looked at the (2nd) link that Dr
Ijaz Durrani
recommended:
Prem, K., Liu, Y., Russell, T. W., Kucharski, A. J., Eggo, R. M., Davies, N., ... & Abbott, S. (2020). The effect of control strategies to reduce social mixing on outcomes of the COVID-19 epidemic in Wuhan, China: a modelling study. The Lancet Public Health.
. . and followed up the ref. 38 regarding the extreme measures taken; this report was 13 March '20:
  • asked a question related to Evaluation Studies as Topic
Question
7 answers
I collected pre-post data from a randomized controlled experiment. The intervention for the experiment group is an educational game and the pre-test and post-test contains 10 multiple-choice questions. The data is coded as 1= correct and 0=incorrect.
What is the right statistical test to analyse pre-post test?
Relevant answer
Answer
I used the exact 10 questions for the pre- and post- tests, but I changed the order of questions Daniel Wright
  • asked a question related to Evaluation Studies as Topic
Question
8 answers
Dear all,
I want to know if i can carry out a d Cohen effect size for pretest - posttest design with control group ?
I have the means and SD of the intervention group and the control group in the pretest and the post test. Which of the data do I use to calculate the d Cohen effect size ?
Thanks
Relevant answer
Answer
It depends what you are trying to do.
Assume you interested in gauging the magnitude of the effect. In theory in this sort of design the groups are randomly allocated so the control and experimental/intervention group should have equal variances by design. That means pooling the pre groups SD gives you a good measure of the population SD without intervention. If the intervention influences the variance as well as mean then d can be hard to interpret (because you are using a difference standardised for the two groups or because you use a pooled SD that represents neither group). So in most cases I'd argue the pre-post difference should be standardised using the pool pre- group means. This scales the change in terms of the original variation common to both groups.
The answer is slightly different for a power calculation as there you probably want the pooled pre-post change divided by the SD of the pre-post change. This is usually a bigger number - because it strips out the correlation between pre- and post- scores from the error term (part of the efficiency of the design). However, this may not be so helpful in interpreting how big the effect is.
  • asked a question related to Evaluation Studies as Topic
Question
9 answers
my project is on immigrant women in their postnatal period, I have designed a short simple questionnaire to ask women at discharge from clinic, but I have to have the questionnaire not only in one language but also in some languages; since the questionnare must be answered at 48 hours after birth, I can't do pre-post test and it's almost not possible do it for more than one languages. I want to know if there is a way that my work to be valid and reliable?
Relevant answer
Answer
It sound very interesting and provocative... Sure, you may use a questionnaire in some languages without doing pilot study. For something you have to start! Congratulations on the question, and the initiative! Good luck!
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
Since I am a leadership student, i had looked at
1. Implementation and its impact on experienced teachers.
2. Mindfulness for leaders and teachers
Could you help me to frame my research question? Any suggestions and critiques on both the topics are also welcome.
Relevant answer
Answer
In my humble opinion, mindfulness is an emerging topic that would really add to the body of literature on leadership and instruction. Good luck! Deborah
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
So I'm working on a PhD on the diversity of values in organizations, and I've used the theory of basic human values. I haven't stumbled on any significant critique against the theory, I've heard rumors that there is - and with any good theory there should be a school of thought that also opposes the theory. Does anyone here know any authors that have criticized the theory? and on what grounds? I'm mostly interested in critique based on ontological and epistemological discussions - not empirical tests with e.g. deviations from the value structure or something like that.
Relevant answer
Answer
Thank you, it seems very interesting!
  • asked a question related to Evaluation Studies as Topic
Question
10 answers
I am currently starting to write a literature review for my Doctoral Thesis. As I am writing, I am wondering about the acceptability of using only three books as references for a chapter (not the whole discussion) in my literature review.
The reason why I am doing because I found these three books are recent (2012, 2014, & 2015) and already consist of abundant information for the chapter.
I am writing a chapter about Depression and these three books has already given me information about 1) Types of Depression 2) Causes of Depression (from Biopsychosocial aspect) 3) Effect of Depression 4) Best Available Treatments 5) Prognosis of Depression. Furthermore, for me, these sub-chapters are already enough for one chapter only. Considering that there are still many to come.
Any critique or suggestions are welcome.
Thank you
Relevant answer
Answer
Dear Wisnu
Whilst it is good that you have a solid reading base from the books you have mentioned, it is often the case that books have taken some time to produce and therefore have older primary sources. I think it would be good for you to conduct a scoping search as well, you may identify some of the latest literature from a quick search. It is always good to look for any current systematic reviews or commentary reviews that fit your topic in general (i.e. search of topic names + systematic review, review), in addition look for the latest papers as they may be useful and can often signpost you to other relevant literature. In addition books tend to have their own overall narrative that reflects the thinking of an author (or authors), whereas it would be expected that you would take a more critical and objective stance and this would be helped by a wider search of the literature.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
Hello all,
I have been advised to include the grey literature in the review for. my PhD. I am confident in how to review articles that appear in the peer-reviewed periodicals but I am struggling with the grey literature (conference papers, articles in professional bulletins or magazines etc.) As you all know, these are usually short and certainly don't match the rigour of an article published in a journal I've been trying to find help on the net, to no avail. Does anyone have any suggestions?
Thank you,
Claire
Relevant answer
Answer
Claire Ewin - Thank you for your question. I am not sure what is the topic and area of your PhD thesis. We need to include the grey literature in our search, mainly when there are not enough publications in proper literature on a topic. Also, when the area of research is newly evolving, and most work is in conference proceedings. Grey literature, may include research books such as those published by Springer (usually chapters are reviewed by the editors only). It also includes as you mentioned non-peer reviewed articles (magazines, etc.). It would help if you defined your inclusion and exclusion criteria for the search. The idea of the inclusion of grey literature should be an opportunity for your critique. They may be adding to the available evidence, or providing different aspects to the issue, lacking evidence or providing misleading information.
I recommend reading The book, Introduction to Systematic Reviews by Gough et al. It is worth reading.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I am currently writing a proposal for a pre:post test where schoolchildren will be participating in an open day showcasing diversity in nursing roles. The faculty will be 50/50 male female hoping To attract more young men into nursing. I will primarily measure if the open day has changed the likelihood of choosing nursing as a career and also specifically look at the amount of males say the would apply to nursing.
any advice on questionnaire design and data analysis would be appreciate.
Relevant answer
Answer
Thanks, Unfortinately due to time the design will be a single group pre and post design. Likert scale questionnaire will be used and then pre-post analysed for difference. I will have a group of approxiamately 90 male/female. from school classes. approx 45 male. Not sure if my study will be adequately powered though. Any suggestions. I am very much a novice in research.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I have a couple studies that were classed as pilot RCTs that I'm not sure if they are suitable to be critiqued using the Risk of Bias tool (Cochrane) for a systematic review. My concern is the size of the trials, although they do have a good method.. for example:
I've done some readying into the Cochrane Risk of Bias exclusion & defining terms but the document does not mention low powered RCTs (specifically the pilot or feasibility RCTs) - link: https://epoc.cochrane.org/sites/epoc.cochrane.org/files/public/uploads/Resources-for-authors2017/what_study_designs_should_be_included_in_an_epoc_review.pdf
I'd appreciate your valued expertise on this matter. Many thanks!
Relevant answer
Answer
Yes You can use Cochrane tool in such studies
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
Jacques Ranciere's theory of Politics of Aesthetics has been used on post-political governance in many countries, is there any critiques on applying this theory to the non-European context where social democratic consensus-building as in post-War Europe has been absent?
Relevant answer
Answer
Dear June,
I'm not sure the dichotomy between the European and non-European contexts is relevant as far as critiques of the "post-political" governance theory are concerned. I'm convinced that such critical examinations can converge from various field studies and that decypherings of the ideological contents at stake can challenge existing postures without using civilizational contrasts.
See, for example, this paper by Ronan Paddison about Glasgow:
Best regards
d.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
review a critical article or report, as in a periodical, on a book, play, recital, or the like; critique; evaluation.
Relevant answer
Answer
What are the basic steps for writing a review?
Perhaps following steps can be considered:
  1. Establish clearly your research problem / problem statement and research objectives
  2. Perform rigorous literature review on all materials you can access e.g. journal articles, conference proceedings, text books, theses / dissertations etc.
  3. Perform your analyses & syntheses on those literature you'd reviewed
  4. Write the the above and including summary & conclusion / next step.
One of the assets I used is an Excel to collect all the materials I'd reviewed before performing the above #3 analyses & syntheses - see RG link below:
You might also want to refer to the following RG links on similar question asked:
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
Dear Researchers,
Im planning a one small group (less than 20) design study, using pre and post test (one is six-point likert scale and another one is four-point likert scale, both about stress reduction) and the Independent variable is one intervention protocol. I am not sure what statistical test to use?
Thank you so much for help!
Relevant answer
Answer
Good luck then, I think the best option is Wilcoxon followed by a post hoc g power analysis if you find non sig results. Or if you categorise data, use a McNemar test.
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
I am working on a project and want to compare the differences in a pre and post survey with the same participants. I have attached the survey. With this type of survey response options for this 20 question practice survey, what type of statistical tests are best to use?
Relevant answer
Answer
If (1) your data are normally distributed AND (2) the score is a continuous data (not ordinal), THEN use the paired sample t-test or the one-sample t-test for the Post-Pre difference with the test value set to "zero". You have two options.
Otherwise, use the Wilcoxon's and Mann-Whitney instead.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I have recently started doing western blots in my lab. After transferring my gel onto the nitrocellulose membrane. I wash the blot 1 time with TBST then block with 5% non-fat milk for 1 hour at room temp. I don't wash the blot after blocking. I pour off 5% milk and add 1:1000 dilution of primary antibody in 1% milk at 4 degree overnight. I wash the blot 3 times with TBST in 5 minute intervals then I add the secondary antibody 1:5000 and 1:2000 dilution in 1% milk for one hour. Wash the secondary off with TBST 1 time for 5 minutes then I view on the imager.
Not sure what caused this smear? Any critiques to my protocol would be helpful.
Relevant answer
Answer
To get rid of your uneven blot with staining you are highly advised to reduce your load protein amount in the gel while keeping it within the allowed limit (for 10 well comb, no more than 60 protein should be loaded). Besides, to reduce the amount of primary/secondary antibody concentration and wash more stringently. if this does not work, in this case, you should try different blocking solution or different concentration of your blocking solution.
In fact, there are many other things which one can do to improve your blot. initially, always ensure that you cast your gel nicely and clean the wells before pipetting the protein as acrylamide residues can affect the running. In this way, u will get sharp bands. Moreover, start with low voltage and then increase after the protein is on the separation gel. like that, you will not have smiley bands :). Also, do not fold or touch the membrane as this can result in an uneven stain. Finally, in order to get ride of speckled background filter your blocking solution and secondary antibodies solution.
and remember that having good reagent and solution with the right pH and concentration is extremely important for beautiful western.
Good luck!
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I completed a pre-post test with students who participated in a simulation activity and I need to analyze the data. There are approximately 96 surveys (pre and post have equal responses) that have 7 questions regarding their knowledge/attitudes before and after the activity. The study involved students from different disciplines. The students had to indicate what their discipline is so I can also correlate that data separately.
1. What test is appropriate to run for the entire data set since it is ordinal data that is unpaired.
2. How do I analyse the questions to evaluate change from each discipline separately to see if their was a significant difference between the disciplines?
I've been out of the game for a long time and am relearning SPSS as well so any help you can provide is greatly appreciated.
Relevant answer
Answer
I presume it is meant that it is not clear which of the pre-test surveys is a 'pair' with which of the post-test surveys.
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
I am conducting a quasi- experimental research in (The effect of extensive reading on reading proficiency and strategies of EFL learners). I use two instruments for data collection ; a reading strategies questionnaire and reading proficiency pre- post test. I have only 10 weeks for the treatment, and there is not enough time to do test- retest to measure the reliability. There are about 35 participants in each group ( the experimental and control) so my question is that can I measure the reliability of the instruments on the same participants after using them ?
Relevant answer
Answer
Of course you can do that and all you want...
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
I am planning to train 2500 parents on parenting issues. I want to do pre and post test to determine immediate knowledge and attitude changes
Relevant answer
Answer
Since you will be testing two proportions, a Z-test would be applicable and in the case sample sizes larger than thirty would suffice
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
Hi all,
i have numerous articles that assessed single groups through dependent samples T tests and concerned themselves with within grouo comparisons. They however did not provide cohens d effect sizes for the pre and post intervention means and standard deviations that were given.
can anyone suggest an online calculator or other means to calculate cohens d with the info they have provided (pre and post test mean group scores as well as standard deviations associated with each)?
i would really appreciate some advice.
thank you
Relevant answer
Answer
This is complicated as Cohen's d isn't defined for a paired t test. There are at least 5 different ways to derive d in this case (all producing different results).
For some of these you'd need additional information to derive d (such the correlation between pre and post scores or the t statistic and n/df).
In practice I think the most useful d statistic here is the pre-post difference divided by the pre SD. This makes it more comparable to an effect from an independent measures design (and doesn't inflate d by removing variance owing to individual differences). However, this assumes you are trying to interpret the size of effect relative to variability in the pre population (estimated by the pre score SD). If you are trying to derive d for a sample size estimate for a future study you'd want a different estimate (assuming it used a pre-post design).
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I am teaching a public relations course in the fall. One of the dominant narrratives of the beginnings of PR as an industry is that it was heavily influenced by Freudian ideas about the importance of subconscious emotional impulses.
Of course Freudian psychology has been heavily criticized so I am looking for a nice, scholarly treatment of the problems of Freudian psychology that second year, non-psych students would be able to grasp. Is there anything out there you know of? Thank you.
Relevant answer
Answer
that looks great, thanks!
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
Hi all,
I conducted an experiment where I had three groups filling in the POMS and Affect Grid (mood/arousal questionaires) before and after the manipulation (a game-design).
My question is if the difference (POST-PRE) score of one group significantly differs than the difference score of another group. However there are a couple of things I (think I) need to take into account:
1 the POMS questionaire did not had the same amount of questions for every participants (because of offering the questionaire in 2 different languages)
2 the pre- scores of all the groups should be taken into account (to rule out pre-existing (significant) differences).
For point 1 I checked the internal consistency of the POMS questionaire with cronbach's alpha. These were good results. Can I therefore proceed and use the sum-scores and mean scores?
For point 2 I compared the pre-scores and there were no significant existing differences.
How should I now conduct the test to see if there are any significant differences between the difference scores of the three groups?
Relevant answer
Answer
If you have three groups and a pre post design, you should consider either using a two way ANOVA (split plot design) with one repeated measures and on independent factor. Another possibility would be an ANCOVA, where you could use the pre measures as covariable, the post measures as dependent and the groups as independent variable. This approach would have the advantage that the pre and post measures do not have to be on the same scale.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Hi all,
I conducted a quasi-experiment with a control and experimental group where both completed a pre- and post-test. The dependent variable uses a scale measure.
As the sample size was only 19, I read online that I need to use a non parametric test.
I will be using SPSS to analyse the data and was wondering which non parametric test is most appropriate?
Thanks in advance
Relevant answer
Answer
Hello Hm Mm ,
Sample size isn't the determinant for whether parametric or nonparametric methods are most suitable. Instead, it's the nature of the scores that are used, and how well the errors (residuals from the fitted model) conform to the usual parametric assumptions of normality, homogeneity, and independence that matters.
On the surface, a likely parametric method that could apply to your data set would be one-way ancova, in which pretest scores were used as a covariate, group membership as the IV/factor, and post scores as the dependent variable.
Good luck with your work!
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
HI All
Is the LR within a SLR descriptive or should there be elements of critical analysis as well. This is taking into account that the SLR will have a discussion section where appraisal/critique will take place.
Thanks.
Relevant answer
Answer
If you mean the introduction, that should be descriptive regardless of whether it is a LR or a SLR. It should describe the problem, previous research/ other similar reviews, and explain what your review is adding. Hope this helps.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
Good morning! I have started my dissertation work this summer. My topic is Online Student Orientation. I am currently looking for a Pre/Post Test Instrument that has already been tested for internal validity. Any thoughts as to where I can begin looking for this instrument? I do not want to create it from scratch, otherwise I will need to test the instrument for internal validity.
Thank you!
Elizabeth Rodriguez
Doctoral Candidate
Relevant answer
Answer
Good afternoon. Ideally, I am searching for an instrument that will ask questions as follows:
1. How would you rate your level of knowledge in technology?
2. How would you rate your familiarity with the concept of online learning?
3. How would you rate your level of knowledge as it pertains to Canvas (LMS)?
I will be conducting an experimental quantitative student for first-time online students. The research will examine the persistence and success rates of first-time online students who complete an online student orientation. The study will be conducted in a community college with 97% Hispanic student population. The study will also examine end of course final grades for students who completed the orientation with an 80 or better, to those students who did not complete the orientation.
Patsy Sheldon - I looked at the website you sent me and emailed Dr. Jennifer Lock but I have not heard back. Upon further research, I found an article that had been published by Dr. Kona Jones. I emailed her to see if she had an instrument I could look at, but I have not heard back.
David L Morgan Any thoughts?
Thank you!
  • asked a question related to Evaluation Studies as Topic
Question
6 answers
Can some one help with what sort of headings /subheadings to have in the Literature Review if the research hypothesis is as follows:
HO1: There is no significant difference in the mean achievement scores of learners taught using traditional and cooperative teaching strategies.
HO2: There is no significant difference in the learners’ mathematics pre- and post-test mean achievement scores in both the cooperative and traditional teaching strategies.
HO3: There is no significant difference in the mean performance scores of male and female learners taught using the traditional teaching strategy.
HO4: There is no significant difference in the mean performance scores of male and female learners taught using the cooperative teaching strategy.
Relevant answer
Answer
Review Literature on both the cooperative and traditional teaching strategies. Explain the steps involve in each of the strategies bringing out their advantages and disadvantages.(sub heading: Cooperative Teaching Strategies. Sub heading: Traditional Teaching strategies).
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
Hello,
I would like to measure the effectiveness of a hiring process. I have data about:
* the interview process (which could be mapped to a number / Likert scale, i.e. what the interviewers thought about the candidate)
* the employee assessment (once hired they are given feedback on a 5pts Likert scale underperforming to outstanding).
I would like to compare the interview score and employee assessment and see if they are as expected (i.e. if the interviewers were unanimous about hiring the candidate, we expect him/her to do well on the assessment)
I have used paired t-test / wilcoxon signed rank on pre-post tests before, but wondering if I shouldn't use a Pearson's correlation coefficient instead this time?
Thank you for any advice, good reads to help me decide!
Relevant answer
Answer
Using a paired t-test depends on two important factors. The first, and most important, is whether both measures are based on comparable scales. That does not mean both use a 5-point Likert scale, but the underlying scales are the same metric. The second is if the assumptions for running a paired t-test are met.
My feeling is that a relationship or regression would be more appropriate. If one of the measures is multivariate, multiple regression would be appropriate. If both measures are multivariate, canonical correlation would be appropriate.
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
I have ran a study comparing the Daily Mile and HIIT in children to see which is best for improving cardiovascular endurance (Beep test) and anaerobic power (20m sprint).
Scores on both test were measured before and after the interventions so it is a differences in the change in the mean of the scores post both interventions to see which is greatest.
Which is the correct statistical analysis to run on SPSS? I thought a one-way repeated ANOVA but I am now doubting myself.
Any help is appreciated.
Relevant answer
Answer
Hello Joel,
One-way ancova or mancova would likely be best. Intervention type is the factor (between-subjects variable; 2 levels), and post-intervention scores are the dependent variables. Pre-intervention scores would make good covariates. Be sure to check assumptions!
A technical issue in using change/difference/growth/gain scores as outcomes is that, if the individual scores are less than perfectly reliable, difference scores will be less reliable than either of the scores from which they are computed. This is exacerbated as the two scores are more strongly correlated.
Good luck with your work.
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
I have to establish a working evaluation of a nutrition couseling program in a village in Ghana. Because of time constraints it was suggested that I evaluate the effectiveness of the nutrition counseling by having a pretest immedicately before and a post-test immediatly after counseling. I instinctively think this is going to inflate scores and was thinking a longer interval may prevent this, but since this is my first research project I could be wrong. Any advice on testing intervals?
Relevant answer
Answer
The longer the time interval the better. Perhaps multiple time intervals is the best.
  • asked a question related to Evaluation Studies as Topic
Question
29 answers
hi
Libor Neumann published same results in physics essays 30,2(2017)
It is imperative some labs start to use this effect to produce electricity using horizontal gravity a descibed in Gravityforces.com
Louis
Relevant answer
Answer
Great and good luck...
Louis
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
I have pre and post responses for nominal variable (correct/ incorrect) for a large number of subjects. I would like to look at responses to individual questions, as opposed to an aggregate score on the questionnaire. Any recommendations on the best statistics to use to determine if there is a significant difference in performance?
Relevant answer
Answer
Hello Natalie,
If your principal concern is whether examinee success shifts on individual items that are dichotomously scored, you might look at:
1. McNemar's test (of the 2 x 2 table that accrues by matching Right/Wrong on pretest with R/W on posttest). This will compare the two cells that show change (either from W on pretest to R on posttest, or R on pretest to W on posttest) to see if they are equal or differ significantly. In IBM SPSS, you'll find McNemar's test available as part of the crosstabs subprogram, if memory serves.
2. Cox and Vargas (circa 1966 or so) suggested just looking at the proportion of successful examinees at pretest (p1) to that at posttest (p2) for each item. Their statistic, p2 - p1, quantifies the degree of change.
3. Others suggested indexing the Cox-Vargas change against maximum possible improvement: e.g., (p2 - p1) / (1 - p1).
Good luck with your work!
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
Hey there! Master's student with a question about whether the GEE logistic regression (population-averaged) model is appropriate for my research question.
I'm analysing results from a pre-post repeated measures survey study. Our intervention is a website with mental health information: we gave participants access to the website for 8 weeks, and asked them to complete a survey pre and post intervention. We were also able to measure how engaged participants were with the mental health sections of the website. We have no control group. I'm using STATA 11 for my analysis.
Research question: Is engagement with the mental health sections associated with a change in counselling behavior (i.e. increased counselling uptake)?
Sample: 169 people
Variables
-Use of counselling. Measured at T1 and T2 via the pre and post surveys. Responses are binary (0 = No, 1 = Yes). NOTE: these are not recorded as change scores.
-Engagement with the website. Measured at T1 and T2. By default, all participants have an engagement value of 0 at T1. T2 engagement is reported as a total value over the 8 week intervention. Responses are continuous, ranging from 0 - 5.
-Control variables: gender, immigration status, income, perceived stress, and depressive symptomatology
Univariate Analysis:
-30 people reported seeking counselling at T1. 28 people reported seeking counselling at T2.
Cross-tabulating counselling:
-119 people did not seek counselling across both waves
-11 sought counselling at T1, but not T2 ("drop outs")
-17 sought counselling at T1 and T2
-11 sought counselling at T1, but not T1 --> counselling uptake
Statistical Approach
I want to see if change in counselling behaviour is associated with engagement. I'm using General Estimating Effects logistic regression modelling.
My data is in long-format, and my participants are nested by time: pre and post intervention.
My question:
Is the GEE logistic model correct for this research question? What exactly is the GEE model predicting? Is it predicting change in behaviour? OR, is it predicting who accesses counselling generally across both waves of data?
If the GEE model is not the correct approach for answering my research question - I would really appreciate any suggestions for alternative models :)
I have included my STATA code below, if that helps!
My Data is shaped in long format by time. It looks like:
id | time | counselling | engagement
01___01_________0___________0
01___02_________0___________3.4
02___01_________1___________0
02___02_________0___________2.2
03___01_________0___________0
03___02_________1___________4.1
sort id time
xtset id time
xtlogit counselling engagement stress depression immigrant income, pa vce(robust)
Relevant answer
Answer
My initial instinct would be:
xtgee counselling i.time##c.engagement stress depression immigrant income, i(id) family(binomial) link(logit) corr(indep) robust eform
The exponentiated estimates you get from added "eform" will give you odds ratios.
Then the odds ratio for the engagement and time by engagement interaction would answer your research questions. Assuming I'm interpreting correctly.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
Simply as the title suggest, my question is: what are your thoughts of creating or critiquing research (Both negative and positive)?
For educational research
Relevant answer
Answer
Critical Analysis on others work and later Publication on that basis is a good thought. Regards
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
I am conducting a study on collaborative writing using an experiment (pre- and post tests). How can I measure students' writing motivation? i mean if they are more motivated or not.
Relevant answer
Answer
You can use the mean.....
  • asked a question related to Evaluation Studies as Topic
Question
11 answers
Dear Colleague,
Sri Lankan Journal of Cardiology- January 2019                                 (Official Publication of Sri Lanka Heart Association) We are pleased to inform you that the above mentioned issue of SLJC has been published. The next issue has to be published in time for the Annual Academic sessions of the Sri Lanka Heart Association, in June 2019. Hence, we earnestly solicit a  contribution from you .It would be greatly Appreciated and extremely valuable. We welcome, Reviews, Therapeutic Reviews, Research, Audits,Critiques of Guidelines, Analysis of important Trials, Milestones in achievements, Tutorials, Case Reports and Updates etc ,as contributions for the next issue of the SLJC.Could you please prepare your manuscripts and submit the same by end of April so that the editorial work could be completed in time (ruvan_nishali.ekanayaka@yahoo.com). The PDF version of this issue is attached herewith.  Thanking you in advance for your kind cooperation. Yours Sincerely, With Best regards,RuvanDr Ruvan EkanayakaMBBS,MD,MRCP(UK),FRCP(Lond),FRCP(Edin),FRCP(Glsg),FCCP, FACC,FESCConsultant Cardiologist / Editor in Chief SLJC
Relevant answer
Answer
We welcome, Reviews, Therapeutic Reviews, Research, Audits,Critiques of Guidelines, Analysis of important Trials, Milestones in achievements, Tutorials, Case Reports and Updates etc ,as contributions for the next issue of the SLJC.
Could you please prepare your manuscripts and submit the same by end of April so that the editorial work could be completed in time (ruvan_nishali.ekanayaka@yahoo.com).
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
When I searched on this I got nothing. On some click, I got an analysis of the journal, Cold War History, but couldn't find the article within that page, even after sorting through 5 pages of articles. I was offered no more pages, even though I know that there were more articles.
Relevant answer
Answer
Thank you. Rebecca Bowman
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
I am doing a systematic review on cochlear implantation and how it affect for ex: Spatial localization. The special case is that there are no control groups. The evaluation has been done for the same group but pre and post test. I tried RevMan from Cochrane but it require the sample size of the control group which is the same as the experimental group.
My question is how to calculate the I2 value for heterogeneity in this case? What other software you can recommend?
Thank you!
Relevant answer
Answer
Biostat's Comprehensive Meta-Analysis software handles the calculation easily (except that you need to know the correlation between the pre and post trials for each of the studies). See the attached PDF for a hypothetical example and how I2 is calculated. I believe the I2 formula is adequately explained except for df, which is the number of studies minus one. If you need clarification, see the book, Introduction to Meta-Analysis by Borenstein et al.
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
Dear,
I have a question about how i could analyse my data.
My question for my thesis is:
what is the effect of a game on the social skills of people with ass, and is this effect differ in gender, age, work and education level.
In my analysis i did a paired t-test, which allows me to check if the average on the pre-test differs from the average on the post-test.
But how can i do a paired test which analysis:
wheter the effect on the pre-post test differs in gender, work and education level?
Could someone help me, please?
My analysis are done with SPSS
Relevant answer
Answer
Where is your supervisor? You are doing a postgraduate degree – you should have people to teach and advise you. If you are here, on ResearchGate, it means that they are not doing their job.
Please insist on getting proper statistical help from your institution. You need to sit down with a statistician who you can explain your research to, and who will help you.
  • asked a question related to Evaluation Studies as Topic
Question
3 answers
I am designing an impact study to measure the impact of Entrepreneurship Education. For this study, I plan to use a pre-post-test design with control group and use latent variables to measure independent variables, mediating variables and dependent variable. Anyone could share opinion of the ideal sample size for this study? If I have about ~100 student in the treated group, ~ 100 student in the control group, is the sample size good enough for SEM?
Thank you very much.
Hieu
Relevant answer
Answer
Are you asking about statistical power or about model convergence?
David's advice pertains to having enough information in the data to enable the estimator to converge on a solution (parameter estimates).
The other important issue is power. For that, Monte Carlo simulation will probably be the best approach, because it can accommodate your exact model.
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
I have this project on communication intervention on teachers level of awareness, knowledge and perception of high school students substance abuse. I have the experiment and the control group. There are questions that would also require just descriptives.
Relevant answer
Answer
T-tests or multiple regression...but t-test can only tells you this much. You need to look into your research questions, the instruments and the number of participants and determine whether you can use more advanced stats. Hope this helps.
  • asked a question related to Evaluation Studies as Topic
Question
7 answers
I have a project on obesity prevention campaign. this project is aimed to study the effectiveness of the campaign on the targets' knowledge on obesity and healthy lifestyle. hence, i would like to find the most suitable questionnaire that can be used for the pre and post test of the campaign. the target of the campaign will be female university students ranging from 18 to 24 years old.
Relevant answer
Answer
I would imagine that your education program for young adults will cover key points such as awareness of the role of physical activity, diet and nutrition in obesity prevention/treatment, and the health implications of obesity such as cardiovascular disease, sleep apnea and diabetes risks.
Further, since you have a young target audience, I would expect coverage of the intermediate process variables such as endurance for sports, recreation, work and study.
Therefore, I would document your key educational objectives and incorporate these into the pre/post-test, taking care to include plausible but incorrect answer items as part of the set.
  • asked a question related to Evaluation Studies as Topic
Question
5 answers
In my study, participants are asked to read as much as possible over the length of the term. They are given a pre- and post-test to determine improvements in reading skills. I have data showing how many minutes they have spent reading and how many words they have read. I would like to know which statistical analysis to use to show the correlation between their gains on the post-test and a) the number of minutes they spent reading and b) the number of words they read. In other words, does the amount of time they spend reading or the number of words they read correlate with gains on the post-test?
Relevant answer
Answer
With just two occasions (pre and post test) you may wish to look at my answer to this question
  • asked a question related to Evaluation Studies as Topic
Question
1 answer
I have pre and post test repeated measures (public opinion) on same sample. Data is in Likert scale. Is there any way to apply chi square on data ?
Relevant answer
Answer
What is the goal of the analysis? A chi square will basically test the proportions. If, however, you want to know whether there is a difference between the pre- and post-test, then the chi square might not be the best choice of statistic.
For Likert scales, a repeated-measures t-test may be used to determine a change between the pre- and post-test. Now, some statisticians would consider a Likert scale to be rank-ordered and not interval. In such a case, they may argue a t-test is inappropriate. If you concur, then use the Wilcoxon rank-sums test, instead. These analyses are standard with most statistical software, but are also easy to compute using something like Excel, too.
I hope this is useful!
  • asked a question related to Evaluation Studies as Topic
Question
2 answers
in general, for healthy people, in the 3D motion analysis to define the anatomical coordinate system on segments, one
frame in static position is taken by the camera, which will make segment angular changes based on this. Now consider a patient with pelvic abnormalities. The pelvic anatomical frame in this case is defined as zero for a healthy person. It will be different now if a patient completes a corrective exercise. If these exercises affect on the pelvic inclination,our anatomical coordinate system will change in post test. As a result, may the effect of exercise be eliminated in the final results of the comparison of pelvic kinematic pre and post test.
What is the proposed solution?
Is there a resource to fully explain this?
Relevant answer
Answer
I am using Vicon system and trying to answer you according to Vicon.
Your concern is correct. The static frame will be used to zero the offset angle and regard it as the anatomical neutral position. If you do the standard procedure for normal subject, it will be wrong for abnormal offset angles.
If possible, you may do the calculation by "Body Builder", a software for Vicon data modelling.
If not, you may import the trails after intervention into the old data session. You trick the system they are data in the same session. Then, the angle change will be the difference between the old and new static frame.
Hope it helps
  • asked a question related to Evaluation Studies as Topic
Question
4 answers
"When in 1940, a committee established by the British Association for the Advancement of Science to consider and report upon the possibility of quantitative estimates of sensory events published its final report (Ferguson eta/., 1940) in which its non-psychologist members agreed that psychophysical methods did not constitute scientific measurement, many quantitative psychologists realized that the problem could not be ignored any longer. Once again, the fundamental criticism was that the additivity of psychological attributes had not been displayed and, so, there was no evidence to support the hypothesis that psychophysical methods measured anything. While the argument sustaining this critique was largely framed within N. R. Campbell's (1920, 1928) theory of measurement, it stemmed from essentially the samesource as the quantity objection." by Joel Michell
(1) Why "there was no evidence to support the hypothesis that psychophysical methods measured anything" because "the additivity of psychological attributes had not been displayed"?
(2) Item Response Theory (IRT) has no Additivity, Can IRT correctly measure educational testing performance?
Relevant answer
Answer
Dear Nan Kong,
The statement of true or false measurement is very rigid and is not even valid for the physical sciences. But it can measure with a certain degree of accuracy. The differentiation of the measurement theories is how to increase the degree of accuracy. It is not right to ignore the evolution of psychological measurement, all existing theories. Additivity is an important concept in all theories of psychological measurement, and each theory has its own way of collecting specific evidence for additivity.
Best
  • asked a question related to Evaluation Studies as Topic
Question
7 answers
I'm doing a research comparing two groups (control vs experimental groups) through pre- and post-test scores. What is the best statistical analysis to compare normality of scores and significant difference between two groups pre and post-test scores?
Thanks
Relevant answer
Answer
perhaps some form of paired t-test or some form of ANOVA -- both are good for examining differences between groups
  • asked a question related to Evaluation Studies as Topic
Question
7 answers
One of the critiques for systems theory of aeston is its limitations in non western systems? Do you agree with this ? Is it applicable in authoriterians context or it needs supportive theories?
Relevant answer
Answer
From the perspective of system theory a system is always contextual and locally embedded. I am gratitude for the dialogue in this forum. System theory helps us to understand sytemic-dynamic processes of selforganized systems. Human beings are selforganized systems. System theory is based on natural sciences and applied in social sciences. System theory is a form of epistemology. What do you want to explore? On micro or macro level? The process of synlogisation between the subsystems? or.... ?