Science topics: Qualtrics
Science topic

Qualtrics - Science topic

Explore the latest questions and answers in Qualtrics, and find Qualtrics experts.
Questions related to Qualtrics
  • asked a question related to Qualtrics
Question
3 answers
Dear experts,
I am struggling with my masters dissertation and SPSS at the moment. Participants had to fill in a Qualtrics survey in which they were directed to one of two questionnaires (PRFQ-C and PRFQ-A) depending on whether they had a child over 18 or under 18. Now I'm struggling to clean the data in SPSS, how do I remove all the missing data for participants who didn't need to fill in one of those two questionnaires?
I hope that makes sense.
Relevant answer
Answer
Hello Daria,
Your skip logic reflects an instance wherein missing data (e.g., the under 18 survey wasn't completed because the respondent was over 18) are generally ignorable (but see paragraph #3, below). Ignorable missing data are not a cause for concern; it just means that you are reporting on a subset of the entire sample for one or more variables (here, potentially an entire survey form).
If the two surveys are completely different, then it might make more sense to have two independent data files, and report the results for each survey separately.
If the two surveys have at least some identical questions, and you wish to compare the results for the under 18 respondents with those of the over 18 respondents to those questions, then you'll have to merge the two files such that the matched questions are coded the same way for both groups, and represent the same variable/column in your spss data file.
Good luck with your work.
  • asked a question related to Qualtrics
Question
2 answers
Hi all! I know this is a very basic question, but since I've never had to do this myself, I was curious how to clean data for a check all that apply question. I've uploaded my Excel file from Qualtrics into SPSS. The way it currently reads in data view, every choice is listed as a single string variable with commas in between. In all of the videos I have watched, each answer choice has its own column in SPSS already, and then multiple response sets are generated. But that is a step further than where I am currently at. Do I have to go back in Excel and create separate columns, or is there an easier way to do this in SPSS? Thank you in advance!!
Relevant answer
Answer
Hello Angela,
Well, at least next time you use qualtrics, you'll know to set up "choose any/all" options as separate variables! (There probably is at least one other option; it wouldn't hurt to touch base with tech support at Qualtrics, they usually are quite helpful.)
Assume your option list has 5 possible values: "A", "B", "C", "D", and "E" and the choices are currently saved as a text variable called 'text'.
In spss, open up a syntax box (file/new/syntax) and do the following:
Create and run a set of statements of this form:
compute option1 = (index(upcase(text), 'A')>0) .
compute option2 = (index(upcase(text), 'B')>0) .
....
execute .
The newly created variables (option1, etc.) will have a value of 1 if the designated choice was included, and a value of 0 otherwise.
Good luck with your work
  • asked a question related to Qualtrics
Question
2 answers
I'm trying to create an mTurk study using Qualtrics, but I need a way to implement the Wisconsin Card Sorting Task into the experiment. I found the WCST through PsyToolkit but can't seem to find a way to link the Qualtrics and WCST on Psytoolkit together.
Relevant answer
Answer
Hi, I myself am also attempting to capture the WCST scores via Qualtrics. Did you happen to find a solution, Dominik?
  • asked a question related to Qualtrics
Question
1 answer
I'm a 3rd-year psychology student at the University of East London and I'm conducting a 10-15 minute anonymous online survey to capture the everyday experience of Fibromyalgia patients and how they feel they are supported by their medical experts for my final year dissertation.
As leading voices for those who experience chronic illness and who may also be diagnosed with fibromyalgia, I would like to request your assistance in reaching those who often lack a voice, to allow me to capture their thoughts and feelings. Can you help me reach the 150 people that I need to complete the survey over the next two months.
All participation is anonymous and will be carried out under the strict guidelines of the British Psychological Society and the University of East London Ethics Committee.
As you are aware Fibromyalgia lacks robust research, I very much hope that gathering as many voices as possible through completion of the survey will be an opportunity to start addressing that.
To complete the fibromyalgia research survey please copy the address below into your browser.
Qualtrics Survey | Qualtrics Experience Management
The most powerful, simple and trusted way to gather experience data. Start your journey to experience management and try a free account today.
Relevant answer
Answer
good luck
  • asked a question related to Qualtrics
Question
2 answers
I'm doing an experiment in which I use Social Value Orientation (SVO) slider measure (Murphy et al 2011: ) as one of the tools.
I have tried to use matrix table following this instructions (attached) but ended up in different view of qualtrics
It seems that the matrix table needs more customization.
Need help.
Relevant answer
Answer
Hello, I used a matrix question with the following options:
  • Type: Likert
  • Answer type: One answer
  • Statements: 1 (I created a new matrix question for each item)
  • Scale points: 9
  • Format: Profile *** This selection aligned the response options with the 'you receive | other receives' statement.
Keeping the two extra paragraph marks to insert two extra lines above each of the responses will keep the responses lined up with the 'you receive | other receives' statement. I added the recommended text using the Rich Content Editor. Hope this helps!
  • asked a question related to Qualtrics
Question
1 answer
I would like to conduct two studies.
In the first study, I will collect data from 200 participants. I need to select around 30 participants from the first study (for two-group) and conduct an experimental study. I would like to pull out the first data ONLY for the selected participants to the second one. I will be using Qualtrics for the survey and the data will be collected anonymously.
Relevant answer
Answer
Hello Ömer Kaya ,
If both surveys (study 1 and study 2) are collected anonymously, there's no good way to selectively cull cases from your first study and use them in a second study and match the specific response records by person. Of course, you could ask in study 1 for contact information from respondents, but doing so removes anonymity. However, this may be the only viable option you would have for trying to match information by case or respondent across the two studies.
I believe that Qualtrics can collect IP addresses, but that is neither infallible linkage to a participant nor does it generally meet anonymity requirements imposed by IRB offices with which I have worked.
Good luck with your work.
  • asked a question related to Qualtrics
Question
5 answers
My name is Natalie, and I am a graduate student at the University of Tulsa. I am using the Trauma History Questionnaire for my dissertation to assess trauma exposure. My advisor is new to trauma research, and we are starting the data entry process for this measure. We plan on looking at the number of trauma exposures if traumas occurred during childhood or adulthood (or both), and if possible, looking at revictimization rates.
We are finding this measure complex to enter and build our SPSS dataset for. Our participants had put age ranges for when events occurred and used vague developmental stages to answer the age at which trauma occurred (putting "adolescence" or "high school," for example), to name a few of the issues we have run into. We have started to enter the data by creating multiple rows for each participant, with a row for each age that a trauma type has occurred.
We are wondering what the best way to build a dataset is for this measure. We welcome any insight! We tried to input this measure into an online survey platform such as RedCAP or Qualtrics. However, we were not able to input this measure as flexibly as needed. If you have any insight on that process, I would appreciate that as well!
We would appreciate any guidance on this issue. Thank you!
Relevant answer
Answer
HEIIO. MY DEAR. IAM NOT SPSS
  • asked a question related to Qualtrics
Question
56 answers
Now I want to implement Balloon Analogue Risk Task(BART) in Qualtrics, one way is adding Javascript or HTML in Qualtrics to realize the task. Does anyone know how to programming in Qualtrics? I have found some cods previous researchers have done for BART using Javascript, but not in Qualtrics environment.
Relevant answer
Answer
There is a simple solution. Convert the arrays into String variables. This solution was created with the help of Morgan Taylor.
Search the Javascript code for the following lines:
$('#message').html(msg_end1+total+msg_end2).show();
$('#outcomes').show();
$('#NextButton').show();
Replace the code following the three lines above with:
var Holder1 = number_pumps.toString();
var Holder2 = exploded.toString();
Qualtrics.SurveyEngine.setEmbeddedData('number_pumps', Holder1);
Qualtrics.SurveyEngine.setEmbeddedData('exploded', Holder2);
Qualtrics.SurveyEngine.setEmbeddedData('total_win',total);
  • asked a question related to Qualtrics
Question
3 answers
What should my sample size be for content analysis? I want to run an open ended qualtrics survey to come up with a list of behaviours associated with romantic felt love.
Relevant answer
Answer
If it is a qualitative study and focus is exploratory, then an N<50 would work.
  • asked a question related to Qualtrics
Question
4 answers
Dear Colleagues,
I am wondering How to handle the response rate using a qualtrics panel? I used their entrepreneurship panel.
thanks,
Relevant answer
Answer
Response Rate & Completion Rate In the dashboard settings, click on the Custom Metrics page. Click Add Custom Metric. Call it “Response Rate.” Add the following equation: (Count) / (Count).
Distribution Reporting (CX) - Qualtrics
https://www.qualtrics.com › support › vocalize › widgets
  • asked a question related to Qualtrics
Question
3 answers
Hi All!
We conducted research into obsessive compulsive disorder prevalence in the pandemic, and predicted higher Uk rates than those found in New Zealand.
Strangely, and unexpectedly, we not only found high rates for the UK (likely % with clinical levels of OCD =51), but found higher prevalence for NZ (likely % with clinical levels of OCD =61). This was a statistically significant difference. Previous average incidence was 1.3% for UK and p.6% for NZ, with some studies showing an increase but only to 10% of sample.
The participants were mixed but mainly students and mostly female. We recorded data via an online Qualtrics survey between Nov 2020 -Feb 2021.
Does anyone have any unpublished results showing similar results? We want to know we are not the only ones finding this.
P.S., We used the DOCS to measure OCD symptoms.
Hoping for some responses !
Scott Cole
Relevant answer
Answer
Perhaps the most frequent subtype of OCD is the obsession with cleanliness and the compulsion to wash, especially of the hands (framed in the guilt-forgiveness atavism of the Monotheistic Religions, in which washing and water have an ancestral lustral symbolism: remind Lady Macbeth that after the murder she does not stop compulsively washing her hands throughout the tragedy, although as its brilliant author says: "There is not enough water in all the lakes of Scotland to clean the blood of crime ").
In this framework, in the case of COVID-19, which also requires special hand washing, joins the supposed "guilt" that triggers every pandemic - remember, for example, HIV / AIDS - and the atavism that evokes hand washing and cleanliness-; with such ingredients that subtype of TOC is served; in fact, I have seen quite a few patients with skinned hands and "raw" from so much washing with alcoholic hydrogel
  • asked a question related to Qualtrics
Question
5 answers
My research is examining the relationship between language switching frequency and creative thinking.
I am looking into creative thinking performances within two bilingual groups (Korean-English and Japanese-English). I'm trying to find a control that can match my participant's executive functioning so that I make sure the performances on creative thinking is due to the language switching frequency variable not because of enhanced executive functioning.
Background info: Studies have found that bilingual people have more enhances executive functioning, and that executive functioning could impact the performance on creativity.
I found the Verbal fluency test because it is very short and convenient to implement through the Qualtrics Software. This is where you would ask participants to come up with as many words as possible if I give them a letter. However, I realized that the tip-of-tongue phenomenon might interfere with their performance because it is more relevant for bilingual participants. Does anyone know how I could solve that issue or would it still be okay to use if its not as significant?
I want to find a short executive functioning test that takes less than 10 min because of the time restriction I have for my study.
Relevant answer
Answer
Dear Maxim Maxim Likhanov
Thanks for sharing this and good luck with your paper. I would love to read it when it is published.
Best
Anastasia
  • asked a question related to Qualtrics
Question
1 answer
I am trying to avoid recreating the wheel. Has anyone created a Qualtrics Survey block using either 1) the Comprehensive Childhood Maltreatment Scale or 2) the Interpersonal Reactivity Index? If yes, are you willing to create a copy and share with me via Qualtrics? My email is sjadcock@uncg.edu
If interested, I have created blocks for the WISPI-BOR (free measure), the PANAS and POMS-SF in Qualtrics and can share those. Thank you. -Shannon Adcock
Relevant answer
Answer
Interesting
  • asked a question related to Qualtrics
Question
5 answers
What free, easy-to-use software can you recommend to collect self-report data for a three-burst ecological momentary assessment study? Each burst lasts 25 days, in which time, we will be collecting self-report data (mostly Likert-style responses) twice a day, morning and evening. The study is currently designed in Qualtrics, but we are looking for something a little smoother, better-looking, and where it is easy to use for both researchers and participants.
Thank you kindly in advance!
Relevant answer
Answer
Hi Jennie Blicher-Hansen, another option you could consider is Teamscope.
Teamscope is a secure and easy-to-use data collection app.
A feature that could be relevant in your study is the possibility of sending automatic reminders to participants: https://www.youtube.com/watch?v=CswaOIrDZeM
I hope that helps,
Diego
  • asked a question related to Qualtrics
Question
6 answers
Hello all!
I am a grad student working on my doctoral project and I had a few questions.
I have two questionnaires completed by my participants. These questionnaires are identical and contain both multiple choice (one correct answer) and one Likert style question (with 5 possible responses). I am looking to compare responses between the two questionnaires (I provided education to my participant group and am looking for changes in knowledge and attitudes). I am using Qualtrics and have SPSS.
What would the best way to go about doing this? I have outputs that I can load from both projects into SPSS, but I struggle with figuring out how to combine them so I can compare answers. I also am not sure 100% the best way to analyze my data.
I know very little of statistics (yay for having our statistics class be in the first semester so its fresh in our mind).
THANK YOU for your help :)
Relevant answer
Good morning
There is a software JASP
iT CAN HELP YOU
Also, review articles or thesis with Linkert
Best regards
Ph.D. Ingrid del Valle García Carreño
  • asked a question related to Qualtrics
Question
4 answers
Hello,
For my research, I have created UTAUT2 model for a survey I plan to distribute with either QuestionPro or Qualtrics XM. QuestionPro uses Spearman rho correlation to analyze the data, while Qualtrics XM has regular regression with its Stats iQ add-on (not sure if my university would pay extra for it just for me).
I'm wondering if any of these are sufficient and if anyone has experience using these tools? Or should I use a different approach; such as download the data from Qualtrics and use something like SmartPLS, IBM SPSS, or simply Microsoft Excel?
I have no experience doing this type of analysis so any advice on ease of use and low cost of these tools is greatly appreciated.
Thank you very much.
Relevant answer
Answer
Mahadi Hasan Miraz , I think I will use both actually. They do not seem difficult to learn, I have the basic use down thanks to the tutorials.
I am having trouble finding resources on how to actually create survey questions and then analyze the UTAUT model in AMOS etc. I suppose I will ask a separate question.
Thank you.
  • asked a question related to Qualtrics
Question
4 answers
I'm evaluating the knowledge, attitudes and perceptions of medical students; and their perceived usefulness of education so my questionnaire has "yes" "no" and "unsure" answers using Qualtrics. One question uses the Likert Scale; and the remaining of them are multiple select - what are the best statistical analyses to use to get a significant finding?
Relevant answer
Answer
I think this might require a multinominal logistic regression. I do not think the order Jamie Elsey gave is the right one. 'Unsure' could be thought of as a second factor that could be orthogonal to the yes=no direction.
  • asked a question related to Qualtrics
Question
2 answers
Are you aware of any Prolific Academic/mturk alternative with Japanese and Malay participants (n = 300/country)? We are planning to run a cross-cultural study including Japan and Malaysia and might have the funding to pay each participant US-$1.50-2.00 to participate in a 10-12min online study. Ideally, participants would be 30+ years of age from the general public. Recruitment services such as those offered by Qualtrics would be too expensive.
Relevant answer
Answer
One of my colleague applied survey technic to young (students) in Malaysia and it was interesting that in a short term he gathered hundreds responses. It seems that there is still easy to drive people to participate in research.
  • asked a question related to Qualtrics
Question
5 answers
Hello,
I am currently writing my master thesis where I have a 2x2 factorial design with one downstream variable (2 independent and 2 dependent variables). I need to conduct a multivariate analysis. I conducted an online survey in Qualtrics and need to proceed with data preparation.
My problem is that each scale for each variable has several items and is repeated across four test conditions. How can I summarize the answers across all conditions to receive data for my variables, so I can use it in the multivariate analysis?
My first idea was to evaluate means per scale per condition and then put them into one column (mean response per person in a specific scale). Is it correct?
Thank you in advance!
Relevant answer
Answer
Hello again Olena,
Let's talk first about the DVs. Here are some options for how to treat them (each being comprised of 4 or more related items; in general, these options would apply to any Likert-type response scale having multiple items per variable):
1. Sum or average the relevant item scores together into a "total," which is then used as a DV. Rensis Likert's original conceptualization of sentiment/opinion scales was that one would use a summated score as the outcome. Of course, be sure to reverse the scoring for items posed in the opposite valence/polarity.
2. Use common factor analysis to derive linear combinations of items that appear to have both empirical association and logical association as regards your target DV(s). It can be the case that not all individual items thought to be part of identification of a single attribute/construct actually show the requisite affiliations with estimates of that construct.
3. Use Item Reponse Theory (such as the graded response model) to both derive a total score that would have interval strength and to evaluate how coherent the item set is to form a unidimensional scale.
If more than one DV needs to be considered at one time to address your specific research question(s), then the analysis should be multivariate. This could include: MANOVA, multivariate regresssion, canonical correlation, or structural equation modeling. The specific choice depends on your research question/s.
For the IVs, as you have these dichotomized, they could be handled via (m)anova, (multivariate) regression, or SEM. All can lead to potential answers about the influence of IVs that you are investigating. All can handle the moderator variable as well.
Sorry if this is a bit vague, but in some situations there are often many ways to get to a desired goal.
Good luck with your work
  • asked a question related to Qualtrics
Question
3 answers
I am conducting a study examining the effects of childhood experiences on military service members and veterans with deployment experiences.
I have developed a questionnaire through Qualtrics (see the link below). However, I am struggling to get participants. I have focused on Reddit and social media platforms. Does anyone have suggestions for other ways to access military service members and veterans?
Thank you!
Relevant answer
Answer
If you have funds then Prolific.co is a great place to recruit. If your university has a license you might also check out Volunteer Science. Finally, if you have an undergraduate research pool at your university you might create a study with 18+ and military veteran as prerequisites. Of course all of these depend on what your IRB says is allowed. Best of luck!
  • asked a question related to Qualtrics
Question
4 answers
Background: I am offering a modest monetary incentive for the completion of an online survey and have publicized the survey on social media in order to reach the adolescent and young adult population. I have been inundated with 500+ fake responses (indicated by inconsistent responses, extremely quick response times, or made-up facilities in their open-ended responses). I realize this treads a fine line - I do not want to "cherry pick" the responses that I delete so I would prefer to have a concise way to identify spam responses or (even better) prevent them from occurring.
I have tried adding a CAPTCHA (did not work). I also recently added a password which could only be obtained upon emailing the research team. This also did not work - the fake respondents identified the password and the spam started back up again. I am hesitant to take the survey off of social media since it was the bulk of my participant recruitment plan.
Relevant answer
Answer
This is an interesting one; and makes me wonder what possesses people into going to this amount of "effort" to skew research (obviously, the prospective incentive, but jeeze).
Similar to Emmanuel ^^^, i'd have suggested screeners or attentional checks throughout the survey. While I know trying to find the sweet spot in making it as accessible for participants as possible, it does open us up to bots. The multiple IP suggestion seems good, HOWEVER, i've had the experience of some organisations using a similar router that repeats IPs, or if students (for example) share a computer in a library, they will flag. One solution I use was the response time, and working it into the methodology section to outline that bots are becoming (and are) a significant issue and the researchers will review the data to objectively identify suspicious participants.
Combining all of the above, writing a protocol on how you deal with this would mitigate the perception of your cherry-picking of the data, I would think.
  • asked a question related to Qualtrics
Question
2 answers
Hi,
I am struggling a little bit with a conditional branch on my survey flow on Qualtrics.
In a nutshell : my subjects are assigned to one of two conditions. As it is a double bind survey, my colleague create a liste with participants number and condition.
ex :
Subject Condition
001 1
002 2
003 2
004 1
What I want is to have a conditional branch saying if *Q Subject Number* match with Condition 1, then display bloc 1 else, display bloc 2.
But to do that, I need qualtrics to match the answer to the question "subject number" to the list "subject" and then find the associated condition.
Does anyone knows how to do that ?
NB : I can't just use a randomizer because I am already using this same list in other tasks out of Qualtrics and I need it to be exactly the same.
Thank you very much for your help!
Relevant answer
Answer
I think it is just like magic sq box...
  • asked a question related to Qualtrics
Question
2 answers
I am using Qualtrics for a Delphi survey.
Does anyone know if Qualtrics can generate reports that I can send to respondents. More specifically, I want to send respondents a report of their answers to selected questions (not all) from the first round survey,
Relevant answer
Answer
Thanks both. I have played around with both, and still can't do it. But the filter by respondent looks promising (I just haven't been able to do it yet!).
As far as I can see email triggers only generate a report with all responses in, and not a selected number?
  • asked a question related to Qualtrics
Question
2 answers
Hi everyone,
I need help to build a forced choice task in Qualtrics.
What I want is (quite) simple : I have a list of 50 easy activities and a list of 50 difficult activities.
For each trial, my participants have to choose between one random easy activity and one random difficult activity.
Thus, for each trial (x100), the question looks like :
Which activity do you prefer?
o Easy activity 4
o Difficult activity 7
I tried to create a loop and merge with field 1 filled by easy activities (one/row) and field 2 filled by difficult activities (one/row). Then, I created my question :
Which activity do you prefer?
o ${lm://Field/1}
o ${lm://Field/2}
But in the previewed question, answers are blank.
Does anyone ever build a question like that and could help me ?
Relevant answer
Answer
Szymon Mizak Thank you for your answer!
  • asked a question related to Qualtrics
Question
1 answer
  • Survey: pre- and post- test
  • pre and post test are similar in most of the items but they are slightly different in some inventories (i.e. pre-test: Inventory+demographic; post-test inventory+ satisfaction)
  • Participants' last 5 digits of phone number will be asked as identifyer
  • Is it possible to link the same participant's response and generate a spss output (.sav) that the same participant are in the same row of spss output; with different labelling of variable i.e. pre-test XXX_T0, post test: XXX_T1?
  • If it is possible, what are the detailed steps for this?
  • ( I cannot find answer at the existing responded question online or in the qualtrics community or guide)
Thank you!
Relevant answer
Answer
ok
  • asked a question related to Qualtrics
Question
3 answers
Thank you in advance for your help!
Two questions:
1) Can I use Qualtrics to conduct an experiment?
2) How do I get equal gender distribution to my experimental conditions when conducting a web-based experiment on a platform like Qualtrics?
Additional info: I have two treatment conditions and one control condition. The type of manipulation I am using is called experiential power priming. Participants will be primed with either social power, personal power, or no power. In order to prime participants, they will be asked to write a few lines describing a situation where they possessed either social or personal power (and describing an unrelated situation in the control treatment). Following, participants will respond to two measurements. 
Relevant answer
Answer
You could to follow the online experimental videos in YouTube. It does really work.
  • asked a question related to Qualtrics
Question
6 answers
Hi everyone,
I need to plan an online experiment in which each participant should watch a series of screens each containing an image (the screens/images must appear in a randomized order). During the whole series of screens, an audio file should be played, it should begin at the first image and it should end at the end of the session.
I have a Qualtrics account, but I'm not able to implement this kind of procedure. In general, as I build a page with the audio player, the audio won't be playing anymore as soon as the next screen is on. On the contrary, I need the audio to be playing in the background during the whole presentation.
Could I achieve my aim by programming something in Python / Java / Node JS / HTML? Or should I change software? Any suggestions?
thanks in advance for any help
all the best,
Alessandro
Relevant answer
Answer
Our lab at the University of Birmingham have just started using Gorilla.sc to build online experiments. So far, I have found Gorilla.sc really intuitive and easy to use and so I would definitely recommend it to other researchers. I'm not 100% sure whether you will be able to have the file playing in the background for the whole experiment, however, there is an option to have audio files playing in on each trial on Gorilla.sc so you might be able to?
If you do choose to use Gorilla.sc, some of the following webpages could be helpful to you! I referred to some of the following webpages to get an idea of how to build a task successfully:
Video walkthroughs that give a speedy introduction to using Gorilla.sc, some of which I found quite useful: https://gorilla.sc/support
Sample Code: https://gorilla.sc/support/script-samples#altercontent. I found the sample code really useful as there were examples for altering or adding content to the task via script (i.e. forcing participants to be in fullscreen when taking part, changing background text and colour, implementing live scoring etc.).
Hope this helps! Wishing you all the best with your research!
  • asked a question related to Qualtrics
Question
3 answers
Hi, I want to set up a time-use survey using Qualtrics. The instrument is modelled after the UK Adult Time Use survey (see attached file on the layout). As you can see from the layout of the questions, the time-of-day, activities, with whom, rating of experiences, etc are structured horizontally - i.e., respondents answer each row by row based on time-of-day. Is it possible to set up as it is on Qualtrics? The Qualtrics format seems limited to one column of question only, whereas in time-use, there are multiple columns. Any advice is most appreciated. Many thanks. Chan-Hoong (chleong@suss.edu.sg)
Relevant answer
Answer
Hello Chan-Hoong,
Have you asked the folks at Qualtrics? Their support for the platform is said to be very good. Whoever is the license holder for the version you're using may have a direct link to technical support, or you could try this link: https://www.qualtrics.com/support/
Good luck with your work.
  • asked a question related to Qualtrics
Question
1 answer
After exporting my data from Qualtrics to SPSS. The multiple answer options did not fit as assumed into the variable view. Instead of having (age) IV --> channel (DV) with several options, each answers option occurred one by one. After recoding each answer into 1/0, the test worked. However, now I have to run every answer category (11) for each main question (8), instead of having one main questions with the different categories. How to make this work more efficiently? PS: I want to know which age category (3 groups) selected which channel(s).
N=95
IV= Age (3 categories)
DV= channels (answer categories)
Picture 1) How it looks
Picture 2) How I would like it to look (combined with age groups)
Relevant answer
Answer
I am also facing same problem
  • asked a question related to Qualtrics
Question
7 answers
I am planning for a survey research project (national representative sample for 15 min survey) and am considering which panel/sampling company to use. I have used Dynata before, they are relatively cheaper ($3.5 per participant), but with my past experiences, not great data quality. I usually put attention check questions in my survey, and they will filter out a huge amount of participants. Even though they are not counted towards the total, I don't feel good about the quality of the data. So this time, I wanted to try Qualtrics panels. But they are a lot more expensive ($5 per participant), so I wanted to see if anyone has used Qualtrics panels before, and how's the data quality comparatively? Is the price worth the service? Thank you!
Relevant answer
Answer
Interesting question with great insights. Looking forward to the discussion!
  • asked a question related to Qualtrics
Question
5 answers
Hello, I am quite new and unfamiliar with SPSS so I am looking for advice. I am doing research about brands and prices in relation to quality associations. I am trying to perform 2 analyses on these hypotheses:
H1: There is a price-quality relationship where a higher price infers higher quality
H2: There is a brand-quality relationship where national brands infer higher quality than private label brands.
Price is a categorical variable with 3 levels (e.g., 0.99, 1.99 and 2.99) measure between subjects
Brand is within subject so no variable
Quality is continuous (measured with a 0 to 100 slider scale in Qualtrics) through two separate questions.
For H1 I believe I need to perform and ANOVA as I have more than 2 groups. For H2 I think I need a paired t-test as each participant saw both brands. I hope this makes it clear what I am trying to do. I am just not sure as quality is measured via two questions in the survey and not one that makes me think perhaps I haven't chosen the right analyses. In the second case, does it make sense to perform the t-test where PQ1 (and the two variables) will be pair 1 and and in the same way PQ2 would be Pair 2 for example?
Relevant answer
Answer
Thank you for your answers! I will do as you all suggested!
  • asked a question related to Qualtrics
Question
22 answers
I am looking for a recommendation about the best software to use for a choice experiment.
I would like to execute this study in multiple languages.
The software needs to be able to accommodate images of labels and to be able to randomise these.
Any advice would be appreciated.
Added features like QR codes would be beneficial.
Relevant answer
Answer
Surveyengine is specialized in DCEs: https://surveyengine.com/
  • asked a question related to Qualtrics
Question
9 answers
I need a practical measurement tool for assessing a risk taking behavior after an emotional manipulation on a qualtrics survey.
Relevant answer
Answer
Georg D. Granic thanks! Appreciate it!!
  • asked a question related to Qualtrics
Question
2 answers
I am trying to conduct some research that involves having teachers (and students) take a self-grading assessment (a Likert scale, not right/wrong answers) and view their own scores. (And I'd also be able to see them.)
For example, at https://www.authentichappiness.sas.upenn.edu/ visitors can take various inventories and see their customized results by category. Something like that, but simpler (as I'm sure they have their own programmers).
Is anyone aware of free tools to create such a quiz on a web site?
Notes on "I already tried that":
*Google Forms allows for self-grading quizzes but you have to assign a right answer. (No scoring for Likert scales)
*Qualtrics only allows test takers to view one overall score (and I need categories...e.g., 3 separate scores for memory, organization, and time management, etc.)
*WordPress may have something like this as a plugin but I'd have to pay $50/month for a Business Account to find out.
Thanks!
Relevant answer
Answer
Thank you so much, Marcel! I did have to fiddle around a bit but got my survey to work perfectly.
  • asked a question related to Qualtrics
Question
8 answers
Hi all,
I've been looking for a suitable online platform to host my Q-methodology survey. Most of the platforms now charge a LOT of money to host the survey (upwards of $500 a month!). I did look into QSortWare but don't think the interface is very user-friendly. I need something that is simple, clear and extremely easy to use.
I thought of using SurveyMonkey but this would have to be done so that each statement is ranked on a scale of -2 to +2 in an unforced structure. I know there's some debate about whether to have the forced or unforced distribution but some researchers seem to think it could be OK to allow participants to rank the statements in an unforced manner. I think this is what SurveyMonkey would allow.
Does anyone have any experience of running a Q on SurveyMonkey, or equally do you have suggestions for other platforms?
Cheers,
Niki
Relevant answer
Answer
Hi, I've now tested doing a Q-sort with Unipark, but I assume it would work with any other software that is not per se equipped to handle Q-methodology. I went this route because, like you Niki, I found all other programs challenging to deal with. It worked pretty well, I'd be interested to hear what you think about the approach! Here is how I went about it:
1. Participants rate all statements on a Likert scale (that corresponded to my ratings in the Q-sort, so in my case from -3 to +3)
2. After, each column of the Q-sort became a question to which participants responded by selecting as many statements as they would be allowed under that column in a Q-sort. In my case it looked like this:
- questions 1 and 2 (for +3 and -3, one statement each): Participants are asked to select the one statement that is most important / most important for them to decline. All statements are listed which were given a rating >0 (or +3) or <0 (for -3) on the Likert-scale.
- questions 3 and 4 (for +2 and -2, three statements each): Participants select 3 statements that are most important/ important for them to decline. All statements are listed which were given a rating >0 (or +2) or <0 (for -2) on the Likert-scale, except for the statement chosen in question 1 and 2.
- questions 5 and 6 (for +1 and -1, five statements each): Here, all statements are listed that have not been selected in questions 1-4, no matter their rating on the Likert-scale.
3. In cleaning the data afterwards, all statements that were never selected in questions 1 to 6 were interpreted to have been placed in the middle/ 0 column of the Q-sort.
There are two apparent limitations:
- the programming only works if participants rate at least 4 statements >0, and at least 4 statements <0 on the Likert-scale (otherwise there are not enough statements to do the Q-sort questions 1-4). While annoying for those participants who don't rate this way, the likelihood that people naturally rate this way is quite high. It didn't seem to be a huge issue for my testrun.
- the comparative nature of Q-sorting is of course "simplified" a bit, because participants no longer see all the statements when they select the statements to be placed on the extremes. This too I think is justifiable, but would be curious to hear if anyone thinks it isn't.
  • asked a question related to Qualtrics
Question
3 answers
Hi all,
Currently, I am working on my master thesis and I want to find out the effect of information on the eating behaviour of people. I want to study if people will eat less animal products after having seen a video with the negative effects of animal products on our planet.
For this study, respondents need to keep a food diary over a period of 3 weeks, nezt to that they have to fill in three short questionnaires. Every day they need to fill in how much meat/fish and how much dairy/eggs they have consumed during their three main meals. Does anyone have any recommendations on how to conduct such a study in Qualtrics?
Thank you!
Relevant answer
You could use the panel function. Create a panel with your participants.
Give each participant a special id number.
Thanks..!
  • asked a question related to Qualtrics
Question
2 answers
I have one Qualtrics survey including three different scales (not mixed - in different blocks). The scales measure different constructs but there is a common wider context. The wording of the items in one scale may "warm up" (prime?) participants towards the next ones and I am worried this may distort results. Any suggestions? Thank you.
Relevant answer
Answer
Hello Anastasios,
If you or your institution licenses Qualtrics, then I'd suggest contacting their support team (this service is included with the license: https://www.qualtrics.com/support/) and inquire as to how one might randomize the presentation of the three blocks of questions (and recording the sequence used for each case). Doing so would allow you to investigate to what extent, if any, sequence of presentation made in the results.
Good luck with your work.
  • asked a question related to Qualtrics
Question
4 answers
What would be the cheapest option for getting survey responses?
I looked at Google Surveys (limited countries), Poll fish and Qualtrics (a tad bit expensive), and Survey Monkey (sample is too small/expensive).
Any ideas?
Relevant answer
Answer
I don't know if you're an advanced or intermediate user, but for common surveys, tools like SurveyMonkey work quite well and they're not very expensive.
Good luck!
  • asked a question related to Qualtrics
Question
4 answers
I do understand they are being used in consumer or market research. But what about if you engage them for your thesis? Are they reliable? Because of time constraints and for convenience, some students, including those taking their doctorates, sometimes rely on these services.
Relevant answer
Answer
Hi, Daniel. Thanks again for your response. I would like to make my question as open as possible to get as much responses as possible. It's OK if you limit your response just to the sampling bias. I don't want to limit the discussion to this aspect because I might overlook others that are related to the reliability of getting third-party pollsters.
  • asked a question related to Qualtrics
Question
7 answers
MTurk seems to be difficult to user for cross-cultural studies. I was suggested Qualtrics - which is comparingly very expensive, but seems to be useful. Do you have any other suggestions and want to share your experience?
Relevant answer
Answer
Hi,
Want to share my experience up to now.
I sent two requests to Qualtrics - weeks ago and a lot of weeks ago, but haven't received an answer yet. It seems that the only way to get in contact with them is through their online form which does not allow for many words to explain the study in the small box (upper limit up characters). Yet, they promise to get in touch with you... well...
I am in contact with Kantar (new name for Lightspeed). I can confirm that it is pricey. My only reference for high data quality is the message by Timo Mandler (see above), so I haven't decided yet.
I am moving forward with Prolific, see what they can offer.
Best,
Christine
  • asked a question related to Qualtrics
Question
2 answers
I need a scheduling solution which would, depending on the outcomes of Qualtrics pre-screening, send emails with attachments for follow up data collection. The schedule woudl need to send an initial email then another one after 1 day then two subsequent ones after 5 and 10 days. It woudl be great if it also woudl enable me to monitor the number of active schedules and, also it need to be secure. Am I asking for too much?
I would be grateful for any help from anyone who has experience of using such software or perhaps knows how to achieve similar functionality via outlook.
Relevant answer
Answer
thank you, this looks promissing, I will have a read.
  • asked a question related to Qualtrics
Question
2 answers
The questions will be identical but collected from sites (possibility of institutions requiring the use of one type of platform each).
Relevant answer
Answer
Good day ma'am,
You can check the reliability of the two sets of data using a split half and parallel form reliability test. You can follow convenient sampling then the distribution becomes nonprobabilistic and you should nonparametric test.
  • asked a question related to Qualtrics
Question
7 answers
Hi all, I have conducted a research to see the cross-cultural differences for gender bias in recruitment. Data is collected through Qualtrics. Participants were randomly allocated to see either a company scenario going successful or going bad - and they selected a candidate out of two options. And they completed another likert scale survey about mindfulness. Then they answered the questions about the company's future in Likert scale.
My hypothesis was there is going to be a difference between UK and Canada population and gender bias will be correlated with mindfulness scores (i.e. those who chose male for successful company will be less mindful) irrespective of country of residence.
Here is how all things measured:
variable1: residence, 2 levels (UK, Canada)
variable2: gender, 2 levels (male, female)
--randomization happened here--- half of the participants read a company history going successful, the other half read a company history going bad.
variable3: candidate choice (female candidate, male candidate) - both groups saw the same candidates.
variable4: question asked "the company will be able to solve their problems in the future" - measured with Likert scale with 7 options
variable5: question asked "the company will be successful in 10 years" measured with Likert scale 1 being bankrupted, 10 being one of the most successful companies.
variable6: mindfulness, measured with Likert scale and scored as means of the scale (1-7).
I believe I have to run multinomial logistic regression as I have 3 IVs and categorical DV. But not sure if I can include mindfulness scale in this as it is an ordinal measurement - how should I go with the analysis?
Many thanks in advance!
Relevant answer
Answer
For variable 3 (candidate choice) you can run a logistic regression with residence, gender and company history (success/failure) as independent variables (+ their interactions) and male or female as the binary dependent variable.
For variables 4,5, and 6 you can a Residence X Gender X CompHistory ANOVA. But, as you observed, the scale is ordinal (Likert type). Yet, many researchers use these scales as if they were continuous. To my knowledge there are no non-parametric 3-way factorial procedures available. You could try multiple regressions. You might consider to run a PCA (principal component analysis) to see whether there is a common factor. If so, you could run an ANOVA on factor scores.
  • asked a question related to Qualtrics
Question
1 answer
I am trying to add a block that entails a memory game in which images flash on screen for 1000 milliseconds, followed by a word that flashes for 15 milliseconds, then another image, and finally another word. I have been reading various forums to find the right coding to add to the javascript to get the timer right but it doesn't seem to be working.
This is what I could find online:
Qualtrics.SurveyEngine.addOnload(function() { // first we wait ten milliseconds, for safety setTimeout(function(){ return undefined; }, 10); // make the div with id "subliminal" visible $("subliminal").style.display = 'block'; // make the div invisible again, after 15 milliseconds setTimeout(function(){ $("subliminal").style.display = "none" ; }, 15); // click the next button to move on to the next page $('NextButton').click(); });
But I don't think its working, or perhaps I'm entering it in wrong. I also would like for it to auto advance as opposed to using the next button.
Relevant answer
Answer
Hai,
Kindly Check this link:
Best Wishes..
  • asked a question related to Qualtrics
Question
1 answer
Are you aware of any reminder apps that can be connected to Qualtrics? I'd like to send daily signals to participants' phones and I want the participants to be able to open the qualtrics survey through the signal. Thanks!
Relevant answer
Answer
Hi Delaram - you might want to check out Expimetrics (www.expimetrics.com) which now has more than 1,300 researchers using it from all over the world. You can schedule either email notifications (and include your Qualtrics survey) or mobile notifications (and include your Qualtrics survey link) or just create surveys directly on the Expimetrics system which allows you to track response rates etc.
  • asked a question related to Qualtrics
Question
3 answers
Hi All,
I am conducting a survey on qualtrics and would like to include the RAVLT as my memory measure. I am thinking of including a link to another website. Has anyone else ever conducted similar memory test online?
Thanks
Relevant answer
Answer
I have done autobiographical memory research online:
But I have not used the RAVLT.
  • asked a question related to Qualtrics
Question
4 answers
Long story short, I have a longitudinal survey for participants and I'd like them to use an app interface to take them, as opposed to a website url-based interface (such as that offered by Qualtrics or Redcap).
There are easy online app builders for people who don't code (e.g. Appery.io), but I want to see if the research community (you!) has vetted any such app use. Or, even better, built your own from scratch.
Qualtrics and RedCap have apps but they are for administrators, not participants. I need an app for participants to easily access their surveys over weeks.
Thank you for your knowledge
Relevant answer
Answer
Surveymonkey is a good application for it, it is available on both Android and iPhone.
  • asked a question related to Qualtrics
Question
9 answers
I have utilized Qualtrics and SurveyMonkey in the past, and I truly appreciate the look/feel both for researcher and participant found with Qualtrics. What do you use, and what would you recommend to do if funding is difficult to secure for a more expensive survey application (i.e. Qualtrics) for a three to six month study?
Relevant answer
Answer
I am agreed with vidyasri khadanga
  • asked a question related to Qualtrics
Question
5 answers
Hi,
Can anyone help me integrate the Balloon Analogue Risk Task (BART) into a qualtrics questionnaire?
Thanks
Ya'akov
Relevant answer
Answer
Has anyone managed to do this?
  • asked a question related to Qualtrics
Question
3 answers
I am conducting survey research on MTurk that involves participants reading workplace sexual harassment scenarios that include potentially distressing depictions of sexual assault/violence. I want to design the survey in Qualtrics such that participants: (1) must spend a certain amount of time reading each scenario before advancing to dependent measures and next scenario (i.e., placing timer on block) and (2) may, at any point, advance directly to the end of the study to receive MTurk completion code if they wish to terminate participation for whatever reason. Is there a way achieve both of these requirements, or will I have to abandon (1) and allow participants to advance freely to the end of the survey by skipping questions? This is more of Qualtrics survey flow logic question.
More generally: how do researchers handle mid-study termination of participation and payment in Qualtrics survey research on MTurk?
Relevant answer
Answer
I think the easiest way of providing a 'quit the survey' option is to use Skip Logic. This allows you to send respondents to the end of the survey if they choose a particular answer to a question. For example, you could have a question that asks "are you happy to continue?" in each scenario. If the respondent chooses "no" it would trigger the skip condition and they'd be taken to the end of the survey.
You could set up the survey with different exit points (if you wanted to give different codes to respondents who read say one, two or three scenarios) using either branch logic or display logic. Branch logic would let you send respondents to different blocks depending on which scenario they quit at. Each exit block could contain a differnt exit code. and then lead to the end of teh survey
  • asked a question related to Qualtrics
Question
2 answers
Hi all, could anyone share some advice of which analyses I should use. I also analysed all my data but I am suddenly afraid it might be incorrect.
I performed an experiment where I presented messages to consumers. I am interested in how self-oriented (0) and other oriented (1) consumers react differently to these messages.
The experiment in which the messages were presented had the following design:
- 2 within factors: 1. positive/negative message (0-1), 2. environment subject/business subject (0-1)
- 1 between factor: 1. condition A (message signed by unfamous person), condition B (same message but signed by famous person)
So 2x2x2 = 8 different messages in total. Each consumer had to evaluate 4 messages (dependent variable = continuous).
I have 2 datasets: 1 wide format (cleaned qualtrics dataset) and 1 where I restructured the data from wide to long format, so each participant ID has four rows now, each including responses to one of the messages (e.g. a positive message with environment subject signed by a famous person). This was in order to create dummy variables for both the within factors (since the long version of data was all in one row). So for example now I have a row with: Subject_ID, followed by Message_Valence (ranging from 0-1), Message_Topic (ranging from 0-1) and the between variable indicating the condition: Message_Signer (ranging from 0-1), + all dependent variables.
I try to analyze the data in SPSS with univariate and to create a Three-Factor Mixed ANOVA. But I figured out this doesnt seem to deal with the between factor... Repeated measures in the wide format does not work because then I can't include the predictor variables (being self versus other oriented). What would you suggest and why?
Relevant answer
Answer
Hello Sam,
It sounds as if you really have two between subjects factors: (a) signature condition; and (b) self/other orientation. For spss, a wide data format would work:
Signature factor level Orientation level Score1 Score2 Score3 Score4
score 1 could be: message valence_0/subject_0 score
score 2 could be: message valence_1/subject_0 score
score 3 could be: message_valence_0/subject_1 score
score 4 could be: message_valence_1/subject_1 score
Use Analyze/General Linear Model/Repeated measures,
Then, in first dialog box, specify message_valence as first WS factor (2 levels), then subject as second WS factor (2 levels).
In next (main) dialog box, match data worksheet columns correctly to the four repeated measures scores combinations, then add in the two between subjects factors below.
The syntax would look like this:
GLM message0_subject0 message0_subject1 message1_subject0 message1_subject1 BY sig_condition
orientation
/WSFACTOR=message_valence 2 subject 2
/METHOD=SSTYPE(3)
/PRINT=DESCRIPTIVE ETASQ HOMOGENEITY
/CRITERIA=ALPHA(.05)
/WSDESIGN=message_valence subject message_valence*subject
/DESIGN=sig_condition orientation sig_condition*orientation.
Good luck with your work.
  • asked a question related to Qualtrics
Question
4 answers
I am using SPSS 25 to conduct data analysis for my bachelor thesis. I have used qualtrics to design my survey and exported the spss data-set from qualtrics.
The thing is, qualtrics coded each item from my likert scale as a different variable. For example, question 23 looks like Q23_1, Q23_2 .... Q23_5. Is it possible to recode this as a single variable and if so, which method is preferable?
Relevant answer
Answer
Dear Cristian,
I' m not sure I understood well your question, but I think so. I agree with Kenneth Horvath suggestion. With this procedure, you may get a sum of variables in a different variable.
Best regards
  • asked a question related to Qualtrics
Question
3 answers
For my Master thesis I had 4 different conditions in my Qualtrics survey. Respondents were randomly assigned to one of the four conditions.
(To be clear I am investigating whether the protein content of a protein bar influences how people estimate the sugar content. Thus does protein gives a health prime and thus a health halo resulting in lower sugar estimates whenever the protein content is high).
I have four conditions:
High protein, with the protein content displayed.
High protein, with the protein content not displayed.
Low protein, with the protein content displayed.
Low protein, with the protein content not displayed.
However, when I exported the data from my Qualtrics survey to my SPSS set, obvisouly the variables were only answered by 1/4 of the respondents, due to the randomization. But now I am not able to perform any descriptive statistics and compare the estimations in all four conditions. Because 75% of each variable consists of 'missing data', while it''s not missing if you know what I mean.
How am I able to work with these variables and should I fill up these 'missing data' or should I make 1 variable out of the 4 variables? What can I do to make it work in SPSS?
Relevant answer
Answer
I would probably open up the data in Excel and then copy & paste the data so that each variable appears once as a column and each participant appears once as a row.  If you set up Qualtrics so that all 4 conditions get the exact same items in the exact same order, this should take only a few minutes.  Add two columns: protein (high, low) and content_displated (yes, no) and enter those according to condition.  Then import this spreadsheet into SPSS.  Hope this helps, Anneloes! ~ Kevin
  • asked a question related to Qualtrics
Question
4 answers
I first aimed to administer the BIAT with IATgen but it is not possible with further reworking the software and I fear that goes beyond my skills.
Thought about Evaluative priming or the GNAT but did not find evidence wether or how they are applicable in Qualtrics.
Thankful for any help and advice!
Relevant answer
Answer
Consider using Inquisit. Inquisit offers test library with ready-to-use scripts. http://www.millisecond.com/download/library/. They have the IAT, but also for instance Payne´s Affect Misattribution Procedure and classic Affective Priming
  • asked a question related to Qualtrics
Question
4 answers
I know how to set up distribution panels/survey invitations in Qualtrics, but how do I send a message to the contact list without sending the survey with the message? Specifically, how do I send a pre-communication so I can give advance notice to the contacts that they will be receiving a request to participate in a survey?
Thanks,
M. Justin Miller, M.S.
Relevant answer
Answer
Through the Contacts tab at the top of the page, select your target distribution list. Once selected, go to "List Options" on the right side of the screen. On the drop-down menu, click "Send Email to List..." and a message window should appear. Be sure to include both a "From" and "Reply to" email address, or Qualtrics will not allow you to send your email.
Hope this helps!
  • asked a question related to Qualtrics
Question
2 answers
Hi,
I am working on a public health research project which is based on paper based interviews. I am trying to figure out whether i can design a database in Qualtrics on to which i could enter the paper based data (myself) and export it later to a statistical program like SPSS or STATA for analysis. Far as i understand, Qualtrics is a survey tool that sends out your designed survey questionnaire to several email recipients, who fill it out and return it back to you. but can it be manipulated to work in the way i am trying to?
I am more familiar working with MS Access and Epidata when it comes to designing databases, this software is completely new to me. Any help would be greatly appreciated!
Faraz.
Relevant answer
Answer
Hi Faraz,
Michael's answer is correct. I would add that with Qualtrics you can set up a survey so that when one is completed (i.e., transfer a paper instance to a Qualtrics instance), the website will redirect to the beginning of a new survey (as if you were using a tablet device to collect responses in the field).
Hope this helps.
Kim
  • asked a question related to Qualtrics
Question
2 answers
Disclaimer: Novice user but great at following directions. Can use SPSS successfully
For my dissertation "The perceived resilience and stress of K-12 teachers with adverse childhood experiences", I surveyed teachers to collect yes/no to 15 questions on adverse childhood experiences, 10 likert questions on resilience, and 15 likert questions on stress. Also some basic demographics (age, years of teaching, urban or rural school setting).
I used qualtrics to collect this information.
I summed my 3 different sections (adverse, resilience, stress) in SPSS so now I have 3 variables with summed scores.
I wanted to look at only the stress and resilience of teachers who reported 2 or more adverse experiences so I sorted it by <= 27 (yes is 1 point, so a perfect test was 30).
Here are my questions:
If I am wanting to establish correlations among these 3 variables, is summarizing them the best thing to do.
If so, what statistical test should I perform? My hypothesis is: there is no statistically significant difference in resilience and stress of teachers with 2 or more adverse experiences.
Also, when I want to throw in demographics for comparisons....how do I do that?
Relevant answer
Answer
I summed the separate variables since each scale is different. So now i have three different variable sum scores (1 for ACEs, 1 for Resilience, and 1 for Stress).
Research Questions
1) What levels of stress do K-12 teachers with three or more ACEs exhibit?
2) What levels of resilience do K-12 teacher with three or more ACEs exhibit?
3) What relationship exists between stress and resilience in K-12 teachers with three or more ACEs?
Null hypotheses based on these research questions:
1) There is no statistically significant difference among levels of stress in K-12 teachers with three or more ACEs?
2) There is no statistically significant difference among levels of resilience in K-12 teachers with three or more ACEs?
3) There is no statistically significant relationship between teacher stress and perceived levels of resilience in K-12 teachers with three or more ACEs.
We had 149 people complete the questionnaire. We summed the scores for the ACEs, summed the scores for resilience, and summed the scores for stress...resulting in three different variables with summed scores. (one column with ACE scores, one with resilience, one with stress).
The scales for each variable are different. ACEs had a total score of 15. If you had a 15, it means you reported no ACEs, 14=1, 13=2, so on.... we were concerned with three or more, so I filtered out cases that were <=12.
Resilience had a scale with a total score of 40. 0-29= Low resilience, 30-36= Mod resilience, 37-40= Most resilience. I recoded these into a different variable with a 1, 2, or 3 to represent these levels.
Stress had a scale with a total score of 80. 20-35= Few feelings of burnout, 36-55= strong feelings of burnout, 56-70= substantial feelings of burnout, and 71-80= experiencing burnout. I recoded these into a different variable with a 1, 2, 3, or 4 to represent these levels.
So my SPSS file has ACE sum (filtered to <=12), Resilience Sum, Stress Sum, Resilience Levels (recoded variable), Stress Levels (recoded variable), Age Bands, Years of Experience Bands, Location (urban or rural), Grade level (elementary or secondary).
The demographics are nominal level variables and the ACE, Resilience, and Stress Sums are nominal since I gave them a 1, 2, or 3 type rating. Even if they are ordinal, it doesn’t change much in data analysis (i think). The questions were a Likert scale, so that’s why I don’t think I should classify these summed scores as scale.
So, based on my research questions and hypotheses (1 and 2) I am looking to see if there is statistical significance in the levels of stress among teachers with 3 or more ACEs...and the same with resilience.
I used a paired samples T test to compare ACE sum and Resilience Sum, ACE sum and Stress Sum to answer this question. My questions about that: can I really compare the two when the scales don’t match? Should I change them to Z scores? I really want to know if people with more ACES have low res, mod res or high res and is there a difference when compared to people who have fewer ACES....knowing these are nominal variables, I am stumped on if this is the right test to give.
The last research question and hypothesis is to determine if statistical significance exists stress and resilience among teachers with three or more ACEs...for this one I used a Pearson r (bivariate correlation) to determine if there was a difference. Stress Sum and Resilience Sum were my two variables. Was that the best test?
Finally, I need to use each of my demographics to explain who these teachers are who have ACEs...so I have my frequencies of ACES, but then further....what age band, years of exp band, location and grade level are the teachers who reported no ACEs, 1 ACE, 2 ACEs, etc... I am having difficulty doing this as one collective descriptive because of my Age and Years of Exp having more than 2 levels.
  • asked a question related to Qualtrics
Question
3 answers
Hello everyone,
I would like to export my data from qualtrics to SPSS. The data includes various psychological assessment tests. The research is ongoing. My main question is whether I can export the data from qualtrics and still have them in qualtrics or not? What is the optimum way of exporting the data to SPSS? For your information, I have so many variables for each person which should be coded differently.
Thank you in advance.
Relevant answer
Answer
The export function in Qualtrics will not delete your data. You can use it as many times as you'd like and it will download a completely new data file each time (in whichever format you select). Just keep in mind that old files will not automatically update with new data as you continue your experiment, so you may have to continue updating your data set with more exports as your study continues.
Qualtrics also provides a great way to pull data directly from their API, using Python, Java, or R scripting, which could lead to better ways of autopopulating your data set as various studies progress. The following link provides more information on this: https://api.qualtrics.com/docs/response-exports
  • asked a question related to Qualtrics
Question
3 answers
I'm considering using them to purchase respondents for a survey about anti-tobacco advertising, but wondering if they provide quality participants/responses? Thanks for any feedback!
Relevant answer
Answer
Hi, I have used Qualtrics a few times in small surveys (less than 100 usually) - it works fine for our needs.
  • asked a question related to Qualtrics
Question
1 answer
I am currently trying to find an easy to use metaphor comprehension test. Preferably it is easy to administer through Qualtrics and does not require any additional software. If it is in a quantitative questionnaire format, then all the better! Thank you.
Relevant answer
Answer
Alger, C. L. (2009). Secondary teachers' conceptual metaphors of teaching and learning: changes over the career span. Teaching and Teacher Education, 25(5), 743-751. doi:http://dx.doi.org/10.1016/j.tate.2008.10.004
You can learn the method the author used to analyse metaphors. 
  • asked a question related to Qualtrics
Question
5 answers
I’m Adrian Stenton, and I’m a PhD candidate at the Leiden University Centre for Linguistics, where I’m investigating number concord across the species noun phrase in English, as part of the project Bridging the Unbridgeable: a project on English usage guides, which is supervised by Professor Ingrid Tieken-Boon van Ostade.
As part of my research, which has just started, I have set up a trial survey on Qualtrics. You will find the survey here:
The survey is open to both native and non-native speakers of all varieties of English, and to people from any discipline. Apart from teasing out your attitudes to number concord, the survey also gives you the opportunity to comment at length, and I am hoping to use your responses to refine the survey for a larger-scale survey of international academic authors some time next year.
If you would like more details on the survey, please go to the Bridging the Unbridgeable blog here:
Many thanks!
Relevant answer
Answer
Dear Pavanisasidhar Avula, Many thanks for your input. I hope you have time to take part in the survey, as many of the examples may be influenced by context.
  • asked a question related to Qualtrics
Question
3 answers
I am hoping to distribute a 10 minute Qualtrics survey to families of children dealing with a pediatric chronic illness (asthma, epilepsy, type 1 diabetes, juvenile RA....). Both children and parents answer some questions. The children must be between 8 and 17 and both parent and child must be able to read English. This is for my dissertation and I need about 100 more participants. Thank you!!
Relevant answer
Answer
In Morocco, you can contact 
  • asked a question related to Qualtrics
Question
4 answers
I am working in a project to collect cost data from the contractors of construction projects. My task is to create data sheets for the contractors to filling data. I am thinking about using Access, Qualtrics, or webpage for this job. Since I have no experience for this works while it is highly important in the success of the following phases, I really want to ask if you have any experience with those types softwares (advantages or disadvantages) or any better tool for this task. Thank you.
  • asked a question related to Qualtrics
Question
3 answers
I am using a pilot study to assess whether or not to provide incentives for my online survey that is being administered through Qualtrics. I would like to provide an incentive to one group (and none to the non-incentive group) at the end of their participation. The incentive will be a code to an online marketplace. There are different codes for each participant.
Does anyone have experience using incentives with Qualtrics? If so, how did you go about administering them?
Relevant answer
Answer
This is an interesting and new issue. May be there is no single answer for it. I may suggest {of course it depend on the research budget} that you get a deal from online stores for buying a number of gifts and to be delivered to the address of participants. {you may ask the participants to choose between e.g. 3 things: books,,mugs, ..accessories..etc.}
  • asked a question related to Qualtrics
Question
28 answers
Specifically looking for a free online platform.
Relevant answer
Answer
Hi,
I prefer this platform -  http://q-assessor.com/entries/3003. It includes creation of Q-set, Q-sorting and also the possibility of data analysis. 
  • asked a question related to Qualtrics
Question
11 answers
I want to conduct a longitudinal study with 3 time points (self-report). Any help would be greatly appreciated!
Relevant answer
Answer
I just starting using Qualtrics this past year, with one study being longitudinal (2 time points). In short, you have to create a survey for each time point and then use the panels function to import participant contact information (i.e., it's basically an address book of all your participants that completed T1). Once you have that, you can easily schedule for qualtrics to send out subsequent surveys at the desired time (T2 and T3 can be set up in advance so you don't have to actively monitor it). I'd be happy to provide a more thorough walkthrough in the next couple of days (I've also started creating some detailed instruction sheets for RAs...I already have one for using panels, but I can forward others along as I finish them)
  • asked a question related to Qualtrics
Question
1 answer
Are there any self-affirmation manipulations that are especially suitable for MTurk? The Allport-Vernon scale seems a little long for MTurk...
Thanks :)
Relevant answer
Answer
It depends on what you want to achieve,  but Value Affirmation (Cohen et al., 2006; 2009) can be used online. A pen-and-paper method was found to protect the self against perceived threats and was very successful in narrowing racial gaps in academic success. 
  • asked a question related to Qualtrics
Question
7 answers
The survey I conducted is short - nine questions - mostly multiple choice answers, and had 52 respondents. Am unable to download the data from qualtrics as an SPSS file. 
Relevant answer
Answer
Dear Stephen,
Yes, you can import raw Excel data files into SPSS. The variable names should be in the top row. Don't use spaces in the names as this creates labels which can be confusing. The rest of the rows should contain the data for your individual cases. Make sure your data starts in the top left hand corner and that there are no blank rows or columns. SPSS will ask you which sheet you want to import. You may then need to tweak a few of the variable settings in the Variable view but it is pretty good at guessing your data types (measures).
One final suggestion: use numbers for your data rather than text as SPSS does not work well with string data on the whole. You can then tell it what your numbers mean using the Value setting.
  • asked a question related to Qualtrics
Question
6 answers
I am having a lot of difficulty collecting data for my survey. The university does not pay for data collection, and my own friends are too different from the general population to be of use in the collection process.
My survey is web-based (Qualtrics), but it includes a couple of open-ended questions that are needed for experimental conditions. Some people drop off because writing is difficult.
I need samples from Russia and the Netherlands. I started with Russia (since I know the language), posted the link to a number of forums, created a new social networking account and payed for posts in some communities in social networks, but so far the collection goes very slow.
Would anybody may be have tips on how to proceed? How do you guys collect your data? Have you ever had to collect nice samples with 0 budget?
Thank you!
Relevant answer
Answer
I support Tracy's suggestion to try professional societies who can assist to get the word out. You didn't indicate what your research topic was. The networks you employ will be influenced by what you are researching. Try to identify those who have an interest in your research and who may benefit from it. They could help to "promote" and "market" the survey.......realistically though, poor survey response rates are more common than we might think and can quite often be a problem for us researchers.....
  • asked a question related to Qualtrics
Question
14 answers
Need information about response time and authenticity.
Relevant answer
Answer
I have used Qualtrics as an undergraduate back in 2011 when I was conducting my research. I had a mixed design (3 independent groups completing the same 7 questionnaires over 3 time points). The experience very intuitive, and the compatibility with SPSS was very helpful in saving a lot of time in not having to enter data manually. I did have to make a few tweaks to the SPSS file; the main thing of which was amalgamating the 3 separate datasets to one dataset, but apart from that, a very positive experience. I have also completed numerous questionnaires on the Qualtrics platform and found the experience fine.
  • asked a question related to Qualtrics
Question
4 answers
I'm trying to track participants in an individual level over time, in which participants have to report their experience every day.
I'm using Qualtrics for this study. One option is to distribute the survey through email which will allow me to track individual surveys. However, the link could be used only once so I'm not sure how will this work to track a partipant over time.
I would really appreciate your suggestions and help
Relevant answer
Answer
You could use the panel function.
Create a panel with your participants.
Give each participant a special id number.
Then you can track them over time.
I have done just this in two studies.
After that qualtrics can automatically send out emails to the participants with an individual link for the survey for that day.
You can even time it so it sends it out at a certain time. Also its real easy to send out reminders to only the participants that has not yet answered.
  • asked a question related to Qualtrics
Question
8 answers
3 colleagues of mine wish to use an online device/strategy called Qualtrics to collect and input data to be analyzed using SPSS. A 4th must collect the same data by pencil & paper, then put it in Excel to be delivered to our person who is using Qualtrics. Can we compare the input of the paper & pencil guy with the data collected through Qualtrics. Assuming no significant differences can we then combine the 2 data sets into one? Or, is there a good methodological reason why that should not be done?
Relevant answer
Answer
Hi, Lynn, you and your team might have gone ahead with your data collection since you posted this question six months back. Did you find any differences in the ease of administering your questionnaire and ease for participants to respond? How about a difference in response sets themselves as Alex, Jacqueline and Adria have pointed out above - for example, the average SD was higher for the Qualtrics responses vs. the P/P responses? (I'm referring to the average SD across all scales that you've used.) If you have further observations, they might be a big help for future researchers to make a more informed choice between the two.
Further, I would like to share two more big differences that I've found out between a Qualtrics experiment, and a traditional P/P one. (1) I had setup my online experiment with four different cells (i.e., conditions) in such a way that each participant is randomly allocated to a cell. My experiment needed priming, so I had four different descriptions (with time lock) for each cell. If I had to do this with P/P, I would have had to do the priming via a presentation, and thus remained stuck to the lab/ classroom. In my Qualtrics experiment case, I'm not restricted to the lab and am planning to put it up online. Of course, a matching reward to complete the questionnaire has to be given to ensure motivation of the participant does not drop. (2) By making responses mandatory, you avoid the problem of missing data easily. In a P/P situation, there has to be rigorous checking of the filled questionnaire right after submission to ensure no response is missed out.
Good luck with your work, Lynn, and please cons