Science topic

Interview Analysis - Science topic

Explore the latest questions and answers in Interview Analysis, and find Interview Analysis experts.
Questions related to Interview Analysis
  • asked a question related to Interview Analysis
Question
9 answers
I'm conducting a thematic analysis for my interview methodology (part of my thesis). The interview focuses on validating the metrics used to compare web application security testing tools, which I've identified from my literature review. I'm currently confused about codes and themes. I'm finding it confusing. As I mentioned, I've conducted a literature review and identified 37 metrics. Should I take those 37 metrics as codes, or is there something else I should use as a code? If there's something else, could you provide one or two examples? Please help me. If my 37 metrics are codes then I'm thinking of using 4 themes:
Commonly Used Metrics Additional Metrics Metrics that are Considered Unimportant Evolving Landscape of Web Application Security
Can someone please clarify this?
Relevant answer
Answer
If your interviewees discuss the specific metrics you've identified from the literature, then yes, you could use these metrics as codes. Each time an interviewee mentions one of the metrics, you would apply the corresponding code to that segment of the transcript.
However, interviews often yield insights beyond what you may have anticipated from the literature review. You might encounter new concepts, perspectives, or terminology that weren't captured by the original 37 metrics. In this case, you would create new codes to represent these additional insights.
  • asked a question related to Interview Analysis
Question
4 answers
I am in the process of finalizing my individual grant proposal.
I really need your recommendation and your suggestions.
I have a question regarding my research, which will include interviews with experts and scientists. To ensure methodological reliability, I need at least two intercoders to participate in data analysis.
Could you advise how I can include these people in the project as intercoders?
Could these be the scientists who signed the LoI to collaborate on the project?
What is the correct way to describe this thing?
I will be grateful to you for any recommendations and advice.
Best regards,
Sabina
Relevant answer
Answer
Whether or not you calculate inter-coder reliability depends on the kind of analysis that you are doing. This approach words best with content analytic coding where you have a detailed, pre-determined codebook. It is less effective with more inductive, meaning oriented coding. In particular, Brown and Clarke argue quite vigorously against using it with their version of Thematic Analysis (Reflexive Thematic Analysis).
As for who the coders might be, the most common choice is to train graduate students to do this work. A frequent format is to compare your own coding to that of a research assistant.
  • asked a question related to Interview Analysis
Question
7 answers
Dear colleagues,
My name is Sabina Augunas, and I hold a Ph.D. in Pharmaceutical Sciences. Currently, I am a fellowship at TIB -Leibniz Information Centre for Science and Technology and University Library, and I am preparing a grant proposal to participate in a competition for an individual postdoctoral grant. My research topic revolves around examining researchers' perspectives on predatory conferences.
Within this study, I plan to employ mixed methods, including conducting interviews with respondents. In the "Researchers in Germany and abroad with whom you have agreed to cooperate on this project" section of the grant proposal, I am seeking researchers who have experience with mixed methods and conducting research in the field of social sciences. If you possess such expertise, I would greatly appreciate your support and collaboration with this project, as it would significantly enhance my chances of obtaining the individual grant.
Below is a brief project description:
Scientific conferences have been an integral tool for scientific communication and knowledge dissemination among researchers for decades. In the modern world, where research evaluation, audit culture, and internationalization of science have become key factors, attending conferences and presentations has become a necessary component for achieving scientific goals in all areas of science. However, despite many scholars exploring available resources, there has been insufficient attention to predatory conferences. There is a lack of knowledge not only about the motivations of researchers to attend such conferences but also about the criteria that define a conference as predatory, as well as about the quantity of such conferences. Of particular concern is the statement that the number of predatory conferences may exceed an acceptable norm. If true, targeted efforts are needed to fill this gap.
The project aims to address the following research questions: What motivates participation in predatory conferences, and what are the long-term consequences for researchers? It is important to distinguish between legitimate and predatory conferences. To achieve these goals, qualitative and quantitative analytical tools will be utilized, including the Delphi method. Expert groups will be formed, taking into account scientific discipline, gender, career stages, and geographical regions, in order to broaden the scope of research. The study will involve comparing predatory and legitimate academic conferences, considering criteria such as peer-review processes, speaker quality, funding sources, publication opportunities, and reputation. The motivation and reasons for researchers participating in predatory conferences, as well as the role of organizers in this process, will be examined. Strategies and ethical principles will be developed during the research to assist researchers in avoiding predatory conferences and safeguarding their scientific interests. The impact of predatory conferences on the academic community, factors contributing to their proliferation, and ethical considerations will also be assessed. Ultimately, the project will enhance understanding of the differences between predatory and legitimate conferences, draw attention to the risks, and help researchers make informed decisions when choosing conferences and managing their careers.
I am looking forward to your feedback and the possibility of collaboration.
Best regards,
Dr. Sabina Augunas
Relevant answer
Answer
I like the idea!
  • asked a question related to Interview Analysis
Question
3 answers
I will conduct stimulated recall interviews with graduate students after eye-tracking. The interviews will be prompted by each participant’s eye-gaze replay in Tobii Studio. The data I will collect from these interviews, can I analyze them using thematic analysis?
Relevant answer
Answer
What analysis method you want to use depends on goals of the analysis as said above. Just looking at literature, stimulated recall interviews have been analyzed at least with EPP-method (which is used to produce themes and connections between the themes). I have seen methods looking like thematic analysis used with stimulated recall data without explicitly naming the method as thematic analysis. So if you want to find prior examples justifying the use of thematic analysis from previous research, I think you could find examples.
  • asked a question related to Interview Analysis
Question
55 answers
I am writing a qualitative research paper on EFL graduate students' academic writing challenges in a university in Turkey where English is the medium of instruction. The research instrument is a semi-structured interview, and thematic analysis (TA) will be implemented. Based on what should I choose the sample size? What is the best/ideal sample size to reach the principle of saturation?
Relevant answer
Answer
Congratulation to the excellent question of the sample size of qualitative research. Please refer to the sooner question about the same topic to get more information: https://www.researchgate.net/post/How_many_interviews_are_needed_in_a_qualitative_research_Is_there_any_rule_or_popular_practice
  • asked a question related to Interview Analysis
Question
9 answers
For my Master thesis, I am going to conduct a number of interviews with experts to assess my proposed tool. I have set up a decision support tool based on the literature and want to verify it for completeness, determine possible interrelationships between factors and ask a number of ranking questions.
My research is qualitative in nature, and the idea was to set up a semi-structured interview. A combination of open questions with a number of closed questions.
Which analysis technique can I best use for this? Is there a certain technique or coding scheme best suited to verify a tool?
Thank you!
Tim
Relevant answer
Answer
David, in his original post, alluded to the notion of 'experts'. This leads us nicely into 'mixed methods' (depending on currents debates around mixed methods) into the methodologies that use qualitative process to set the context for 'expert' consensus/ranking i.e. Delphi Technique - and Q-Sort/Q-Ranking. Have you considered these approaches Tim?
  • asked a question related to Interview Analysis
Question
4 answers
Hello All,
I am interested in consulting with someone about qualitative analysis for interviews. If you are available or know someone who may be, please let me know. I would be happy to pay for the consultation/consider including as an author on the research paper.
Thanks for your time.
Relevant answer
Answer
Thanks for your responses Ciro De Vincenzo and Joshua Ofoeda. I have sent you private messages.
  • asked a question related to Interview Analysis
Question
1 answer
I'd like to learn more about interesting environmental management and citizen science/stewardship studies that combine both quantitative and qualitative methods.
Relevant answer
Answer
While mixed methods approaches to research have been accepted practice within the social sciences for several decades (Tashakkori and Teddlie 2003), the rising demand for cross-disciplinary analyses of socio-environmental processes has necessitated a renewed examination of this approach within environmental studies. Urban environmental stewardship is one area where it is clear that neither a quantitative nor qualitative approach can provide a full understanding. Rather, the typologies and relationships identified by quantitative data are essential to structuring qualitative data collection strategies in such a way as to lead to specific knowledge of how stewardship groups affect governance systems by carrying information and resources across sectors and scales. In short, stewardship is an issue within environmental studies that demands a mixed methods approach in order to understand the social-ecological implications. This chapter demonstrates one way in which such research might be structured.
  • asked a question related to Interview Analysis
Question
10 answers
A researcher is investigating students' writing mistakes from teachers' perspectives. Of course, the researcher is going to conduct an exam for students. However, would you recommend an open-ended questionnaire or a semi-structured interview for teachers?
Relevant answer
Answer
It all depends on what you need. If you want to measure some variables and need some statistical quantitative metrics to do that, make use of survey questionnaires (quantitative research). On the other hand, if what you need is depths of analysis and explanation from the teachers, make use of interviews (interview the teachers) and collect relevant documents from them (qualitative research).
  • asked a question related to Interview Analysis
Question
19 answers
In regards to findings for qualitative research, can the themes emerging be different than what's written in litertature review. They may have been covered by some studies but that is not mentioned in the literature review but can I reference those studies in findings despite them not being in lit review? or would that be inappropriate?
Relevant answer
Answer
Literature reviews organize and present what is already known—or thought to be known—about a particular topic, including substantive findings as well as theoretical and methodological contributions to date, this to locate further research in relation to the existing body of knowledge. Literature reviews are secondary sources: they do not report new or original experimental work. And so, it is both acceptable—and indeed of the essence of research—if new themes or interpretations emerge from additional work.
  • asked a question related to Interview Analysis
Question
37 answers
We are working on a qualitative project that uses telephonic interviews. Most of the interviews have been transcribed so we want to start the coding process. We cannot afford Atlas.ti or NVivo, but many open source software programs either do not cater to multiple collaborators or are limiting. For example, we found Taguette really easy to use however it does not support nested/hierarchical coding or the visually pleasing multiple coloured highlighting.
Could you tell us about any other open source softwares that would overcome the above-mentioned shortcomings? We're open to using Google Docs and Sheets, however, to be honest we are still figuring out how to go about it without causing issues in the later stages.
Note: We're really new to qualitative data analysis
Relevant answer
Answer
QDA Miner Lite is free, and works well for basic qualitative data analysis.
  • asked a question related to Interview Analysis
Question
3 answers
The data coding process using NVIVO 12 software is relatively straightforward, but I'm having difficulty using the hierarchy charts to visualize the information in terms of demographics (e.g., age, gender, etc.). Does anyone have any tips?
Relevant answer
Answer
I generally use case classification sheets for the Demographic Statistics of my respondents. I know it is not the same as the charts you can implement in Nvivo but it does facilitate an easier management of your cases, especially in bigger research populations. You can use case classification in your analysis by using compound coding queries, but also in the representation of your population if you export your classification sheet and use the representation options of MS Office Excel. This way, you can combine both the benefits of Nvivo with the transparant representation of Excel.
  • asked a question related to Interview Analysis
Question
14 answers
Hi everyone,
I am a MSc student and currently in the early process of starting my dissertation proposal.
The study aims to evaluate risk and protective factors which influences the onset of body image dissatisfaction. This will be based on patient experience by obtaining data through an in-depth, open-question survey which will be completed online (this is due to being an distance-learning course, therefore semi-structured or in-person interviews are not possible).
Is it still possible to carry out IPA using an online survey, or is it mostly limited to in-person interviews? The survey will enable participants to write extensive accounts using open-ended questions, however will this still not provide appropriate data?
I welcome any advice, thoughts, feedback.
Thanks.
Relevant answer
Answer
The core IPA text by Smith, Flowers and Larkin suggest an openess to methods that allow exploration of the individuals sense of being- within the context under examination. I think you would need to consider whether the approach you are using will give access to this and whether the lack of opportunity to use follow up questions may reduce the quality of the information that you gather.
  • asked a question related to Interview Analysis
Question
7 answers
I am doing a research on defining the link between sense of belonging and use of urban space. I have designed a set of interview questions based on my literature review, other case studies, etc.
How to be sure that the designed interview questions are complete and appropriate enough to serve the purpose of the research question and will provide me with the data I may need ?
Relevant answer
Answer
A variation on what Marie Grasmeier suggests is to do pretests with your interview as written, but with a debriefing session afterwards, that would essentially be an open-ended interview where you ask what was covered and not covered by your questions, and how effectively your questions covered the core topics.
  • asked a question related to Interview Analysis
Question
45 answers
How to prepare for Interview of Assistant Professor ? Kindly suggest questions liked to be asked ?
Relevant answer
Answer
Q. 1 what's your skills why you think you are good for this job?
Q. 2 Why we will hire you?
Q. 3 tell me your skills which is best for this job? And what you know about Institute?
Q. 4 what's your future plan or goal in form of research and which specific field?
Q. 5 How many project/research work you have?
Q. 6 Which subject you are more comfortable for teaching ?
I hope these things help you.
Regards
MGK
President NFPS
  • asked a question related to Interview Analysis
Question
12 answers
I had a questionnaire with 18 close-ended items about factors of students' failure in English courses.
At the end of the questionnaire I asked respondents an open-ended question:
Why did you fail English in the previous semester(s)?
I made it optional and only 27 out of 56 responded to this question.
Was it correct?
Regards!
Relevant answer
Answer
It's certainly OK to ask open-ended questions after a set of closed-response questions, but in your specific case your question might have been a bit too abrupt to encourage responses. Many of your respondents might not have known the answer, or the answer might have been complex. If you had asked in a slightly different way, perhaps you would have received more answers. Furthermore, there might have been different reasons for failure in different semesters, and participants might have considered it too burdensome to go into details.
I wonder whether, with a bit of piloting and/or careful thought you could have asked for the information that was of importance to you in another closed-response question.
  • asked a question related to Interview Analysis
Question
3 answers
I would like to outsource the transcription of interviews (around 20-30h of audio recording/IDI). Do you have any experience with Polish companies in that field? Can you recommend any?
I would be really grateful :)
Relevant answer
Answer
It's a bit late but you may wish to use
<info@e-transkrypcje.pl> in the future - very quick and efficient service.
  • asked a question related to Interview Analysis
Question
4 answers
I am conducting a multiperspective interviews on cultural competence in healthcare institutions (management level). Some interviews are individual, but in some institutions, they expressed the wish to conduct the joint interviews (e.g. medical director, nursing director, HR director)- which I could not decline. Is it aceptable to analyze all the data jointly (treating each respondent as a single unit)? Any references or suggestions? I want to add that I am investigating their views, beleifs and attitudes towards the topic, and I was careful that all of them had a chance to express them. Thank you kindly.
Relevant answer
Answer
I would be concerned about treating each individual separately when then they are responding to your questions in the presence of others who have a relevant role in with regard to the interview topic. You might consider analyzing the data from the individual interviews first, and then comparing their content with the data from the dyadic and triadic interviews.
  • asked a question related to Interview Analysis
Question
24 answers
Interested in peoples opinions of preparing for a job interview:
From an interviewee point of view, what do you prepare and how do you prepare?
From an interviewer point of view, what do you expect of the candidates your are interviewing, in general?
Relevant answer
Answer
Eman Ali Hadi Al- Khafaji thanks that is sound advice.
  • asked a question related to Interview Analysis
Question
14 answers
Any experiences with MECANALYST?
We are going to analyze 150 interviews and plan to create Hierarchical Value Maps.
Thank you
Relevant answer
Answer
Dear all, Mecanalyst seems to be out of market... Any other suggestion, please???
  • asked a question related to Interview Analysis
Question
11 answers
I would like to know if it is okay to use the responses of one interview for more than one research article? From what I understand, it is okay to use different sections of an interview for different research as long as the same questions are not used in both of the papers? Is it correct? Or would one be able to use the same questions as well or questions as well as answers should only be used once?
Relevant answer
Answer
Hi Muhammad,
Surely, As you have number of Questions in an interview for addressing them , You Can also use each question or an issue in a single article.
Regards
Almaamari
  • asked a question related to Interview Analysis
Question
7 answers
I have 38 semi-structured interviews and this will be my first time using a software program to conduct my coding. Usually I use a whiteboard and post-its but with the richness of these data, it is getting unwieldy. I would like a more efficient way to visualize things across participants. Thanks!
Relevant answer
Answer
Use Qiqqa, it has autotags as well as multiple tags for you to do your own coding. It will automatically suggest themes! It also does Brainstorms.
  • asked a question related to Interview Analysis
Question
176 answers
I find it time consuming to do transcriptions on my oral history interviews. Is there a software that will expedite the process.
Relevant answer
Answer
From my experience, Computer-generated transcription can provide some support. For example, you can upload your audio file to YouTube and click the box that generates a transcription. This is completely free — just be sure to mark your file as “private” if you’re just uploading to get the transcription. The singular caveat is that you there is a level of uncertainty on the accuracy side, that you still require you to confirm by checking.
Transcribe is another computer tool that can assist: https://transcribe.wreally.com
As the site suggests: Transcribe offers an audio player that's tightly integrated with a text editor on the same screen. In other words – you hear the text, and you type it. 
The plus side is that there is no more switching back and forth between the audio player and the editor.
Google Docs offers a speech to text option. It appears to work well and a big plus is that it is free. You can use it manually or go to: https://support.google.com/docs/answer/4492226?hl=en
Dragon voice recognition software is also another voice recognition software with potential; again, you have to consider the set up time to ensure the most accurate transcription – and this does not include the interviewees voice recognition.
Other options include:
Transcription services
Large transcription companies can give you cheaper rates if you’re not committed to working with a single transcriptionist. A few popular options include:
Transcribeme:  http://transcribeme.com
Offers transcription delivery within one to seven days. A 10-minute recording with two speakers and a two-to-three day turnaround, for instance, costs about $20. Longer recordings requested with one-day turnaround will be the most expensive, around $4 a minute.
 This service can accommodate almost any project. Its express service, with turnaround in 8-12 hours, costs $3.00 per minute. If you can wait up to a month for your completed transcription, you can pay as low as $.80 per minute.
Rev’s pricing is the most simple: just $1 per recorded minute with 24-hour turnaround. The only extras that cost more are adding timestamps or requesting verbatim transcription, in which you’ll see all of the “mmhmms” and “uhhs” that were recorded.
This service prices based on turnaround time and accuracy. The most expensive level, which guarantees 99% accuracy and includes speaker identification, costs $2.00 per minute with a five-to-seven-day turnaround. That rate goes up to $2.50 per minute if you need the file in a maximum of four days. Need it in a day? That’ll cost you $3.00 per recorded minute.
So, all in all, the best solution is likely a combination of the above based on your own time constraints, how quickly you will need the information, and whether or not you want to pay to have the services provided by someone else.
Lastly, I do know that a one hour interview will generate 20 -30 pages of typed notes, so taking time to identify the pros and cons of an approach is well worth the time and effort it will take you.
  • asked a question related to Interview Analysis
Question
4 answers
Hi All
I seem to be stuck at present. I am at the point where I have ben asked to show how I am going to analyse my data, and CDA seems to fit to an extent, but I am also assuming it can be used as the main stance and structure of my thesis.
I am quite interested in using CDA in my project which is based on how people who  live in areas of disadvantage view themselves and the world around them (their identity). I am aiming to use small group interviews and individual interviews.
I am a little confused in regards to CDA - It states it has to be a multidisciplinary approach. Am I barking up the completely wring tree to think I could use texts etc that form the part of my literature review to note the views of institutions with regards to identity of these groups and also analyse my own field work with regards to the way the people themselves view their own identities? 
If someone could help I would be grateful!
Jess 
Relevant answer
Answer
Thank you both so much!
  • asked a question related to Interview Analysis
Question
10 answers
I am working on drivers for participating wildlife harvest/trade related qualitative data from a survey and have many open-ended questions. Any suggestion would be of great help.
Thank you,
Relevant answer
Answer
Compared to the commercial qualitative analysis packages that others are recommending, RQDA has notably fewer features and very little in the way of support. So, I would investigate whether your university supports any of the following: ATLAS.ti, MAXQDA, or NVivo. Another alternative is the online program Dedoose, which charges by the hour rather than requiring a purchase.
In general, these programs all do what you are describing under the heading of "mixed methods."
  • asked a question related to Interview Analysis
Question
24 answers
I am using mix method research approach for my study. My study is explanatory sequential, using positivism for quantitative data collection. But I am abit confused about what epistemological stuns should I used to collect interview data. Whether it should be phenomenology or social constructionism?  
Relevant answer
Answer
I disagree with Creswell's suggestion that you should have separate philosophical paradigms for each portion of your study. Instead, I would recommend pragmatism as an overall paradigm.
In particular, if you start by establishing quantitative results, then the next step is to design your qualitative study so that it contributes to and integrates with those results. This means that designing the qual study according to how it meets the needs of the overall project, rather than designing it to fit a philosophic paradigm.
  • asked a question related to Interview Analysis
Question
9 answers
When we conduct interviews, we look to gain enough data that can offer a reliable picture of the issue being examined.  Depending on the field, interview numbers in a study can be very small (I have even heard of a published study with only 1 interview), to >20.
  • What is the best way to determine data saturation - i.e. that conducting further interviews will be unlikely to reveal pertinent new data ?
Relevant answer
Answer
Hello Nicholas
This is quite an informative paper about this subject:
Fusch, P. I., & Ness, L. R. (2015). Are we there yet? Data saturation in qualitative research. The Qualitative Report, 20(9), 1408.
This also might be of interest:
Mason, M. (2010, August). Sample size and saturation in PhD studies using qualitative interviews. In Forum Qualitative Sozialforschung/Forum: Qualitative Social Research (Vol. 11, No. 3).
This might be helpful, but I haven't read the full text:
Bowen, G. A. (2008). Naturalistic inquiry and the saturation concept: a research note. Qualitative research, 8(1), 137-152.
Again, I have not read the full text, but this paper questions the concept of data saturation:
O'Reilly, M., & Parker, N. (2012). ‘Unsatisfactory Saturation’: a critical exploration of the notion of saturated sample sizes in qualitative research. Qualitative Research, 1468794112446106.
https://www.researchgate.net/publication/257413822_Unsatisfactory_Saturation'_A_critical_exploration_of_the_notion_of_saturated_sample_sizes_in_qualitative_research
Very best wishes with your PhD,
Mary
  • asked a question related to Interview Analysis
Question
30 answers
I am trying to choose a method to analysis semi-structured interviews within midwifery, where I really need to understand the individual experience deeply and perhaps identify themes. Both these methods seem potentially appropriate. Any thoughts regarding the methods and the required sample sizes would be helpful.
thanks
Jenny
Relevant answer
Answer
I think of both of these as variations on a fairly generic, inductive approach to  analysis. The best known alternative within this group of techniques is thematic analysis (Braun & Clarke, 2006), which is very similar to framework analysis.
Between the two methods that you mentioned, I would identify IPA as closer to your goal to "understand the individual experience deeply." This is due to its background in phenomenology, but that does apply more to its theoretical origins than its manifest procedures.
  • asked a question related to Interview Analysis
Question
10 answers
we have been using a sequential explanatory mixed method research where the  findings from the quantitative study are reassessed with qualitative approach such as through interview. The selection of participants is based on purposive sampling but the appropriate number will be guided by data saturation. so when shall we say that there is data saturation? what's the minimum number of interview needed to be conducted?
Relevant answer
Answer
There are basically two approaches to saturation. The original one comes from grounded theory and is known as "theoretical saturation." This means that the data you are collecting adds nothing new to your understanding of the research topic (i.e., your data no longer contributes anything new to your ability build theory). Note that in grounded theory, one continually modifies the data collection procedures according to what was learned from previous data, rather than simply repeating the use of one standard data collection instrument
More recently, people have shifted that early definition of saturation into something close to what Ruchi describes: not producing any new codes. This implies that you are using the same data collection instrument and you repeat it until no new codes are produced. I would thus propose that we label this "code saturation" to distinguish it from grounded theory's concept of theoretical saturation.
The best known citation on code saturation is by Guest et al., but the paper by Galvin has a stronger theoretical basis
  • asked a question related to Interview Analysis
Question
36 answers
I am using group interviewing technique for a research study. I conducted a pilot study on few respondents. Can I use the results of the pilot study also to write my findings and conclusion? So if I interviewed 10 respondents in the pilot study and 30 later, can I say that my sample size is 40? Thanks. 
Relevant answer
Answer
Hi Ruchi
Just to add :
Leon, Davis ,Kraemwr (2011) mentioned that the very purpose of conducting a pilot study (PS) is to examine the feasibility of an approach that is intended to be used in a larger scale study.PS can be used to evaluate the feasibility of recruitment, randomization, retention, assessment procedures, new methods, and implementation of the novel intervention. But among problems of PS are:
1.Completing a pilot study (PS) successfully is not a guarantee of the success of the full-scale survey.
2.PS findings may offer some indications of the likely size of the response rate in the main survey, they cannot guarantee this because they do not have a statistical foundation and are always based on small numbers.
3.  Contamination may arise in the following ways: (i)where data from the pilot study are included in the main results; (ii) where pilot participants are included in the main study, but new data are collected from these people.
Social scientists engaged in quantitative research are likely to argue that: "an essential feature of a PS is that the data are not used to test a hypothesis or included with data from the actual study when the results are reported" (Peat et al. 2002: 57). The obvious concern is that if there were problems with the research tool and modifications had to be made in the light of the findings from the pilot study, data could be flawed. But if an established and validated tool is being used and the pilot study is determining other methodological aspects such as recruitment rates, it could be argued that such data may be of value. So when to decide whether to include pilot study participants or site(s) in the main study?
Respondents who have already been exposed to an intervention may respond differently from those who have not previously experienced it. It may be positive, when participants may become more adept at using a new tool/ procedure. It may also be negative with participants showing a decline in following a protocol because it is no longer novel. Indeed both changes in behaviour have long been recognised and a 'run in' period, where an intervention is introduced prior to a study, is often used for these reasons:
 (1)The concern about including participants from the pilot study in the main study arises because only those involved in the pilot, and not the whole group, will have had the experience. In some cases, it is simply not possible to exclude these pilot-study participants because to do so would result in too small a sample in the main study.
 (2)When samples are clusters, for example schools, prisons / hospitals. In such cases one can conduct a sensitivity analysis (or sub-group analysis) to assess to what extent the process of piloting influences the size of the intervention effect.
Contamination is less of a concern in qualitative research, where researchers often use some or all of their pilot data as part of the main study.
Qualitative data collection and analysis is often progressive, in that a second or subsequent interview in a series should be 'better' than the previous one as the interviewer may have gained insights from previous interviews to improve interview schedules and specific questions.
Some argued that in qualitative approaches separate pilot studies are not necessary (e.g. Holloway 1997: 121). For example, a qualitative interviewer conducting 15 focus group interviews will listen to the recordings or read through the transcripts of the first three or four in order to improve the questions, the way of introducing the issues into the group interview or even to add new topics. Thus, although there is no specific pilot study, analysis of the earlier focus groups may help improve the later ones.
Frankland and Bloor (1999: 154) argue that piloting provides the qualitative researcher with a "clear definition of the focus of the study" which in turn helps the researcher to concentrate data collection on a narrow spectrum of projected analytical topics. Piloting of qualitative approaches can also be carried out if "the researcher lacks confidence or is a novice, particularly when using the interview technique" (Holloway 1997: 121).
Another problem may arise where a PS requires a significant investment of resources, making it difficult for the study team to call a halt to the research after an unsuccessful PS.
Researchers might be tempted to make considerable changes in the main study, rather than deciding that the proposed study is not possible with the available resources, time, population, etc. It follows that papers reporting methodological issues, such as those identified during the pilot phase of a study, will also be less attractive to publishers. In the past, editors have recognised the dangers of publication bias with respect to clinical trials and have offered 'an amnesty for unpublished trials' in an attempt to overcome these problems (Smith & Roberts, 1997). However, it is equally important to ensure that lessons learned with respect to the research method are shared. Thus, when pilot studies are mentioned in more detail in academic papers and reports, researchers regularly comment that they "had learned from the pilot study" and made the necessary changes, without offering the reader details about what exactly was learnt.
Some of these processes and outcomes from both successful and failed pilot studies might be very useful to others embarking on projects using similar methods and instruments. This is particularly important because pilot studies can be "time-consuming, frustrating, and fraught with unanticipated problems, but it is better to deal with them before investing a great deal of time, money, and effort in the full study" (Mason and Zuercher, 1995).It has also been argued that the current research climate demands accountability from researchers, which means that there is a need to ensure the best possible use of research results (Crosswaite and Curtice 1994). Therefore, investigators should be encouraged to report their pilot studies, and in particular to report in more detail the actual improvements made to the study design and the research process(Leon AC, Davis LL, Kraemer 2011).
References
Crosswaite, C. and Curtice, L. (1994), Disseminating research results-the challenge of bridging the gap between health research and health action. Health Promotion International 9: 289.
Frankland, J. and Bloor, M. (1999), Some issues arising in the systematic analysis of focus group material, In: Barbour, R. and Kitzinger, J. (eds) Developing Focus Group Research: Politics, Theory & Practice, London: Sage
Holloway, I. (1997). Basic Concepts for Qualitative Research, Oxford: Blackwell Science.
Leon AC, Davis LL, Kraemer HC. J Psychiatr Res. 2011 May; 45(5):626-9. doi: 10.1016/j.jpsychires. Epub 2010 Oct 28.The role and interpretation of pilot studies in clinical research.
Mason, D.J. and Zuercher, S.L. (1995). Pilot studies in clinical nursing research. Journal of the New York State Nursing Association 26: 11.
Peat, J., Mellis, C., Williams, K. and Xuan W. (2002), Health Science Research: A Handbook of Quantitative Methods, London: Sage.
Smith, R. and Roberts, I. (1997) An amnesty for unpublished trials British Medical Journal 315: 622
  • asked a question related to Interview Analysis
Question
10 answers
  1. I am looking for articles to read for in depth interview analysis.  I am doing a discourse analysis study.  
Relevant answer
Answer
Read Hermeneutics and Discourse Analysis in Social Psychology by S. Rettig & T. Hayes. {Publisher is Nova Science series. 2012.  It provides theoretical material as well as actual analyses of discourses .
  • asked a question related to Interview Analysis
Question
25 answers
In mixed method studies where a questionnaire is the main instrument while semi-structured interview is used partially. What are the best method which can be followed to analyze the open-ended questions.  
Relevant answer
Answer
The analysis will depend on the nature of your research and your definition of semi-structured interviews.
Interviewing when doing qualitative research is generally unstructured and open-ended.  In those cases you need to use an analysis method that aims at revealing themes, concepts and/or hypothesis.  The type of analysis depends upon the type of qualitative research.  Ethnographic studies, Phenomenological studies and
Grounded theory to mention a few use different analysis approaches.
Your semi-structured interviews may be set up to in fact give you quantitative data if the questions are more 'how many' or where, when and how type of questions.  
  • asked a question related to Interview Analysis
Question
6 answers
Atkinson (2002) suggests a three steps process of life story interviewing viz., planning for interview (1), process of doing interview (2) and transcribing along with interpreting interview (3).
By following all these steps, I have converted the interview into a story, removed interviewer's comments and remarks, as guided by Atkinson 2002. My goal behind conducting this interview is to understand the cultural construction of an issue, a truth. To achieve this goal I want to apply the reading method of deconstruction on the target narrative.. 
Can anyone give me surety for my plan... how far am I correct? 
Relevant answer
Answer
Katherine, my aim is to understand how perspectives on an issue come to be Constructed as Truth
  • asked a question related to Interview Analysis
Question
9 answers
I designed a face-to-face interview protocol in English to collect data from Irish physicians. I am planning to replicate the study in the Lebanese context using the same protocol and was asked to check the protocol for cultural relevance and sensitivity prior to collecting data from Lebanon. 
Does anybody know how to assess the interview protocol for cultural relevance? are there tools to do so?
Thank you
Mohamad
Relevant answer
Answer
Have you thought about doing pilot interviews to check the cultural relevance with physicians (presumably of both genders)  familiar with and/or in the Lebanese context?
  • asked a question related to Interview Analysis
Question
38 answers
I am going to conduct a series of semi-structured interviews (on conferences & poster presentation) with RG members via Skype. The interviews will be conducted in English, and the interviewees come from a variety of backgrounds.
I have the usual demographic questions, some questions that ask the 'importance' of things (which I will rank/scale during analysis), and open questions that ask their views on issues.
I think that if potential interviewees have my questions in advance, they can see clearly what the interview is about, think about their willingness to participate, and also be better prepared to answer the questions. Especially, if English is not their main language, knowing what will be asked may help them express their answers more effectively, which is good for them & me :-)
I don't think this advanced knowledge will negatively influence/bias the answers they give, but is there any particular reason this should not be done?
Relevant answer
Answer
Hi Nicholas, I've been doing research interviews since 1999 and I always offer potential participants the chance to see the questions before they decide whether or not they want to take part in the interviews - or if this is not possible for some reason, e.g. they can't read, I explain what kinds of things I'm interested in hearing their views on. For me this is an ethical stance, it means they are giving more fully informed consent.
I see you're considering different types of interviewing, and can suggest a couple of references which you may find useful. Paul Hanna (2012) compared face-to-face, telephone, and Skype interviewing in this paper http://qrj.sagepub.com/content/12/2/239.short (he is not on ResearchGate, though a couple of other researchers with the same name are here). Kaye Stacey and Jill Vincent (2011) did some interesting work on multimedia interviewing in a structured format which they sent to participants on CD to be completed on screen - very similar to web-based interviewing - they are both on ResearchGate, and their paper is here http://qrj.sagepub.com/content/11/5/605. Gemma Pearce and her colleagues (2014) have developed a method of web-based interviewing using instant messaging which may be helpful to you: http://www.tandfonline.com/doi/full/10.1080/13645579.2013.827819#.VeapBJfYqzw (she is on ResearchGate too).
I hope this is helpful. Good luck!
  • asked a question related to Interview Analysis
Question
16 answers
Is it necessary to transcribe recorded interviews in times where audio files can be easily annotated, bookmarked, archived and even implemented in written text? Looking forward to hearing your opinion on that issue. Thanks
Relevant answer
Answer
If the goal is to be systematic in one's analysis of qualitative data, there are several software programs that allow you code audio data without transcription. Even so, I think there is a major element of convenience here because audio data cannot be skimmed through or searched. Not transcribing will thus save money but not time.
As for the unique advantages of listening to the spoken word, there is nothing that stops you from listening to recordings once they are transcribed. And, if you want to go the effort, several of the CAQDAS program let you link the audio and text versions of files and move back and forth between them (basically involves a lot of "time stamping").
Also, there are already several discussions on RG about automated transcription and the simple answer is that it doesn't work for interviews. Instead, it is optimized for one person speaking in a dictation format.
  • asked a question related to Interview Analysis
Question
6 answers
 I know that in quantitative content analysis we may use specific coefficients or ratios for example to measure the degree of agreement between coders (krippendorff 's alpha, kappa coefficient,..). I am interesting in using criteria no associated with coefficients in qualitative content analysis.
Thanks in advance for your support.
Jairo Raúl Chacón
Relevant answer
Answer
I've found the following article extremely helpful in discussions of reliability and validity in qualitative research. I hope it helps.
Shenton, A. K. (2004). "Strategies for ensuring trustworthiness in qualitative research projects." Education for Information 22: 63-75.
  • asked a question related to Interview Analysis
Question
17 answers
Having difficulty knowing many numbers of participant to use for pilot study and if there's need for any because I'm interviewing people living with diabetes. Working towards 40 participants in the main study( semi-structured interview)
Relevant answer
Answer
Pilot studies are not necessary in qualitative studies. However, with that said, I think that conducting one or two "test" interviews can be very helpful for refining your interview guide (if you are using one) and getting a general feel for how the interviews will go. Doing this will help you iron out some of the kinks before you proceed with your sample. I did this with my dissertation research and it was beneficial. This is useful especially if you are new to qualitative interviewing.
  • asked a question related to Interview Analysis
Question
4 answers
example: A is my informant for pilot test.
Could I add A with B, C, D, E (my real informants) and claim that I have 5 informants including A? 
Relevant answer
Answer
Dear Azlina,
Yes off course you can use that interview for the purpose of your real interview session,
But,
you have not to use it or mentioned in your study that you have already use it in pilot testing.
  • asked a question related to Interview Analysis
Question
15 answers
qualitative reserachers
Relevant answer
Answer
I am coming into this discussion late so apologies if this has already been covered. From your two suggested options Mashael (thematic or IPA), just based on your numbers alone, I would suggest that IPA is not suitable. IPA is very idiographic and focuses more on the experience of the individual and as such sample numbers are usually smaller, ranging from 1-12ish people. You get masses of data from IPA as it is so in depth - you would be swamped with data for 40 people. IPA is also concerned about how people experience/make meaning of an event such as having an illness. As others have suggested it depends on your research question and aim - based on these it could be content analysis, thematic or grounded theory (among others). As above I have used Braun & Clarke's guide to thematic analysis - these authors have also recently released a book on qualitative research which was useful. Wishing you luck in your project!
  • asked a question related to Interview Analysis
Question
8 answers
I have to analyse and interpret my transcript data which I have obtained from semi structure interview. Do you have any idea how I can formulate best a framework to do this.
Relevant answer
Answer
Hello Sharda Suman
I used 'Framework' for my PhD qualitative research (constructivist grounded theory) and for my 2 qualitative follow-ups (I used semi-structured interviews as my method of data collection for each study). I used spreadsheets package (Microsoft Excel) on my computer to allow me to compile thematic frameworks to allow constant comparative analysis. I carried this out by entering each participant's ID into the cells of the first column, using a different row for each participant, and entered the index codes (a different index code for each concept) and a brief explanation (one in each cell) along first row. This gave space for brief notes relating to the data that I had about each participant in the cell corresponding to the index code for the column. I used the same type of framework to complete master charts later in the analysis. The book I used was:
Ritchie J, Lewis J, editors. Qualitative Research Practice: A Guide for Social Science Students and Researchers. London: Sage Publications; 2003
It looks as if there is a more up to date version:
Ritchie, J., Lewis, J., Nicholls, C. M., & Ormston, R. (Eds.). (2013). Qualitative research practice: A guide for social science students and researchers. Sage.
This is by the same team of authors:
Spencer, L., Ritchie, J., Lewis, J., & Dillon, L. (2003). Quality in qualitative evaluation: a framework for assessing research evidence. http://dera.ioe.ac.uk/21069/2/a-quality-framework-tcm6-38740.pdf
Also see:
Grewal, I., Lewis, J., Flynn, T., Brown, J., Bond, J., & Coast, J. (2006). Developing attributes for a generic quality of life measure for older people: Preferences or capabilities?. Social Science & Medicine, 62(8), 1891-1901.
On p.1893 in the above paper, the authors have described 'Framework' in a similar way to how I have.
The below reference is by other researchers who also used this method:
Smith, J., & Firth, J. (2011). Qualitative data analysis: the framework approach. Nurse Researcher, 18(2), 52-62. http://eprints.hud.ac.uk/18884/1/RepositoryFrameworkNResearcher.pdf
I hope this helps 
Good luck with it
Mary
  • asked a question related to Interview Analysis
Question
7 answers
I am beginning a qualitative research project and unfortunately I will not be able to conduct face-to-face interviews with all the participants so will need to do some by phone. Any advice from others who have done this would be very much appreciated.
Thanks a lot.
Relevant answer
Answer
Today there are recorders that can connect to the phone, recording audio with great quality, some are well priced and a good qualitative researcher should have one!
Good luck! 
  • asked a question related to Interview Analysis
Question
10 answers
I am going to be analysing up to 100 interviews, coding for different affects/emotions in the text.  I need to find a good, simple, reliable programme.  I will have to learn it myself, and then teach non-academics how to use it.
Thanks!  
Relevant answer
Answer
Dear Joaquin, Edison and Sarah
I really appreciate your suggestions on this.  I'll explore Atlas and Nvivo - intuitive sounds good, especially to a reluctant techno like me.  I've only just moved on from papering the room with Post-it notes....
Best to all,
Alison
  • asked a question related to Interview Analysis
Question
20 answers
We interviewed couples and I would like to determine "how much" they agree or disagree on the themes that emerged from the data. Anyone has an idea how this can be done?
Relevant answer
Answer
The purpose of quantifying things in qualitative data isn't necessarily to do statistical testing or claim generalizability. I have argued for it as a systematic way to find patterns that might not be as easily detected just from reading and similar forms of "immersion." For this purpose, descriptive statistics like percentages are basically all you need.
In the articles below, my approach is basically two steps. First, use systematic counts of codes to find patterns. Second, return to the original qualitative data to explore and interpret the sources of those patterns. 
For example, lets imagine that Catherine's counting show systematically higher levels of agreement about some topics rather than others. That patterns tells us something about "what" is in the data, but a next step would be to try to understand more about "why" that pattern occurs. Another example might be that some kinds of couples show higher levels of agreement than others. Etc.
FYI the first of these papers describes the method in general, while the second paper applies it to a specific case.
  • asked a question related to Interview Analysis
Question
5 answers
I'm using NVivo for this.
I have a few questions and would like to read the opinions of people that are more experienced than me:
- Do you code everything, or skip coding information that is not so relevant?
- I think the wisest would be to code interview by interview instead of ttheme by theme (the interview is semi-structured which means that each topic is sometimes spread out throughout the whole interview). Am I wrong?
- I think I'll have codes that fit several themes (or maybe they'll just be slightly different...). Should I repeat them under each theme?
- I have read through all the interviews carefully and I attempted to "build" a node tree in NVivo to be aware beforehand of the themes emerging from the interviews and the problems (like too much overlapping etc). Was this a good strategy?
Thank you very very much.
Relevant answer
Answer
If you are using a grounded theory approach, then your themes are emerging from the interviews and everything should be coded. Then you would use your emergent themes to aid in the following interviews. You would keep this up until you start seeing fewer new themes and more repeats of existing themes.
  • asked a question related to Interview Analysis
Question
17 answers
Dear Colleagues, I am currently coding my first interviews for my PhD and was wondering if it is the best idea to do it alone in order to reach high reliability and objectivity. On the other hand, I consider the PhD as an own work, and with this prerequisite given I have to do it on my own. So I would like to ask you: Is the a convention or best practice among researchers how to ensure high quality of coded data (except for those written in books like Mayring or Glaser/Strauss)? Thanks a lot. Anja
Relevant answer
Answer
Regarding your question specifically about having others check your coding for your PhD: I did all the coding myself and then had my supervisors look at it and together we agreed on the coding and themes. When I wrote this up for a journal I said that 'inter-rater agreement was reached on themes and coding'. I hope this helps!