Question
Asked 25 July 2016

Need some suggestions on sentiment analysis?

I am working regarding  sentiment analysis of about 500 comments over a blog. The blog states the career frustrations of professionals in a particular profession (i.e it itself reveals the negative aspects related to that profession). 
Firstly, I have performed the content analysis (using the QDA Miner) of the blog to find the career aspects that are causing career frustrations among the professions.
Next, I have planned for sentiment analysis (using Python NLTK Text Classification/ http://text-processing.com/demo/sentiment/ ) of the comments (given exclusively by the  professionals associated with that particular career) on the blog post . However, on moving  further I have obtained that in some comments, there is fragmentation of sentiments. The first fragment which is related to the blog gives a positive sentiment whereas, the second one which is related to descriptions of career aspects gives a negative polarity.
For eg: Excellent article (+ve Sentiment related to the blog post). the problem is that you learn this once you have spent 15 yrs in this field trying to achieve what you dreamt of...... it's a complete waste going into this career field in this country. (-ve Sentiment wrt career aspect) it's better if you aim early and move out...to the US or any other place of your liking...(-ve Sentiment wrt career aspect).
Kindly give me some advice on how to conduct sentiment analysis of such type of dual-natured comments that reflects sentiments for the blog post and the blog aspects itself.

Most recent answer

Jolly Soparia
Zydus School for Excellence
So u r doing directly sentiment analysis on these documents.
R u using any tool?
I have worked on Sentiment Analysis and the Easiest Tool for it is Rapidminer and it has many features which is necessary for Sentiment Anaysis.

All Answers (5)

Mani Mehraei
Girne American University
Dear Sayoni,
To be honest I think you have chosen the long road to gain information about this topic.
You may easily obtain this information by asking direct questions in a questionnaire. Collecting data from blogs for the topic that participants would willingly share information with you in a questionnaire wouldn't be a good idea.
This is an interesting topic though. I hope you won't limit yourself in these blogs.
Good luck
Ramkrushna Pradhan
National Institute of Technology Rourkela
I think the problem you are dealing with is "Sarcasm Detection", (as the example says). It's also a form of sentiment analysis, but slightly varying.
You can follow this paper for more info,
 
@Mani...I agree with you Mani, but I have already started the work and I can`t quit in between..Let's see how it gets configured.
@Ramakrushna..Thanks for the article.
1 Recommendation
John Tumaku
Ho Technical University, Ghana
Please can you try using R to alleviate your difficulties. Try the link below
Jolly Soparia
Zydus School for Excellence
So u r doing directly sentiment analysis on these documents.
R u using any tool?
I have worked on Sentiment Analysis and the Easiest Tool for it is Rapidminer and it has many features which is necessary for Sentiment Anaysis.

Similar questions and discussions

Designed RCB with repeated measures assessing digital vs paper mosquito surveillance. Did not go as planned. Alternatives for assessing data?
Question
1 answer
  • Michael ClarkMichael Clark
I have data sets from multiple phases of a pilot study in which a digital alternative was proposed for government-led mosquito surveillance. As an example, in the first phase, I designed for 5 Ministry of Health officers to assess 80 mock premises each, 40 with the digital tool and 40 with pen-and-paper. I planned to block by MOH officer, use premises inspection tool as my independent variable of interest, have 40 replicates, and analyze predefined time and accuracy dependent variables. Due to work-day related time constraints, I have varying numbers of completed replicates per MOH officer. Further, due to secondary processes at work (e.g., natural limits for my dependent variables, a learning curve with the digital tool for MOH officers unfamiliar with tablets, plus the user variable I blocked for), my data is non-normal. I've pursued the Sheirer-Ray-Hare test as a possible nonparametric assessment alternative, forfeiting excess replicates from individuals who completed more of the study than the MOH officer who completed the least, but I'm concerned that its esoteric status will obfuscate my conclusions. Further, in one subsequent phase, only 4 replicates were achieved, which fails to satisfy the Sheirer-Ray-Hare requirement for 5 replicates per block.  
If I take the mean value of what I intended to be individual replicates, I can theoretically treat my analysis as simply a paired t-test. The replicates were collected in succession all in one session, though MOH officers rotated between using digital vs paper tools every 20 mock premises (sidenote: MOH officers were randomly assigned which collection tool they started with and at which premises they started). Per Shapiro-Wilk normality assessment, my non-normality issue is nullified. However, I am concerned about the appropriateness (re ethics) of this statistical maneuver, in addition to losing all the power behind the replicates we collected. Any advice?

Related Publications

Chapter
In diesem Kapitel schreiben wir unterschiedliche Funktionen zur statistischen Berechnung. Darunter befinden sich einfache Lagemaßzahlen, wie der Mittelwert, aber auch komplexe Berechnungen, wie der Korrelationskoeffizient nach Karl Pearson. Zudem schreiben wir eine Funktion zur Standardisierung von Daten und zur Berechnung der Stichprobengröße. All...
Article
Full-text available
El presente artículo es una reflexión sobre el modelo estadístico y su utilización en el ámbito de las ciencias sociales. En él se plantea estudiar los fundamentos teórico- metodológicos de la disciplina así como el estudio de su Historia. Conocer el contexto histórico del pensamiento estadístico y sus principales desarrollos matemáticos, junto a l...
Got a technical question?
Get high-quality answers from experts.