Toggle navigation
Home
▼ Details
Products and pricing
Chart gallery
User stories
Text analytics
CDC NAMCS Library
Blog
Tutorials
Contact
Sign in
Post Editor
← All help posts
View post
Save
<img src="/uploads/upload/image/5200/direct/1582568883778-1582568883777.png" alt="Colorful conversation heart candies with messages like "KISS ME", "BEST DAY", "FOR YOU", "SMILE", "LAUGH" displayed with dark gray sentiment score labels: 0.89, 0.97, 0.67, 0.46, 0.90, and 0.07, demonstrating sentiment analysis scoring on positive text." style="display: block; vertical-align: top; margin: 5px auto; text-align: center; width: 390px;"> Protobi can give automated sentiment analysis scores for text verbatims using leading AI libraries from [Indico](https://indico.io/), OHMSense and [ParallelDots](https://paralleldots.com/). Above is a stock photo of classic candy hearts, annotated with the sentiment analysis scores from Protobi. We imagine you’d use this to evaluate open-end survey responses. But the candy hearts illustrate the strengths and limitations of sentiment analysis. ## How to access To use sentiment analysis on a question, first select the element. Then, from the "Advanced" button on the toolbar choose "Sentiment (BETA)." <img src="/uploads/upload/image/5200/direct/1582570285420-Sentiment%20(BETA)%20image1.png" alt="Dropdown menu showing "Advanced design actions" with options including Hide/unhide (D), Group (G), Dissolve (U), Clone (simple) (E L), Change key (E K), Edit properties (E M), Edit JSON (E J), Translate (BETA) (X T), Sentiment (BETA) (X S) highlighted with red border, and Recode (BETA) (X R). Top toolbar shows Format, [NA], Crosstab, Scenarios, Export, Save, and Advanced buttons with tabs for Report, Screener, training, Patient treatment below." style="display: block; vertical-align: top; margin: 5px auto; text-align: center; width: 603px;"> From the Sentiment dialog choose which AI library you want to use. <img src="/uploads/upload/image/5200/direct/1582570883929-Sentiment%20image%202.png" alt=""Sentiment" dialog with blue header and white help icon, displaying text "Calculate sentiment score for text values. Select which library to use:" followed by three radio button options: "Use Indico.io" (selected), "Use Parallel Dots" (unselected), "Use OHMSense" (unselected). Gray "Cancel" and blue "Ok" buttons at bottom-right." style="display: block; vertical-align: top; margin: 5px auto; text-align: center; width: 350px;"> ## How it works These AI libraries score text on a scale from 0 to 100%, where 100% is very positive, 0% is very negative, and 50% is neutral. Here’s one example scoring a random list of adjectives: <img src="/uploads/upload/image/5200/direct/1582568575975-1582568575974.png" alt="Table titled "sentiment" with blue square icon, displaying two columns: "WORD1" containing words like cautious, difficult, weary, courageous, precious, alive, exuberant, fancy, adorable, charming, and "WORD1_sentiment" showing corresponding sentiment scores (+4%, +10%, +12%, +100%, +66%, +96%, +89%, +86%, +100%, +98%). Bottom shows pagination "1 of 5" and note "WORD1 is NOT: [NA]"." style="width: 548px; display: block; vertical-align: top; margin: 5px auto; text-align: center;"> At heart, computerized sentiment analysis is a bit simplistic from a human perspective. The computer doesn’t really get in the mind of the author to divine the actual sentiment. It scores the words within the text and returns an aggregate summary score. ## Strengths Sentiment analysis is reasonably good at appropriately scoring words that are widely considered positive or negative. **“True love” (98%) “Best day” (97%) “Laugh”: (90%)** **“Fart monster” (2%)** And it rates the following as having a low sentiment even though might intend to communicate quite the opposite: And it m In this sense, automated sentiment analysis is effective at quickly sorting through lots of verbal expressions and extracting general trends. ## Limitations The scores in the candy hearts image are taken directly from the algorithm. We assume it gives the following ratings because the computer simply doesn’t understand the experience: **“XOXO” (67%) “First kiss” (47%)** The following phrase has a high sentiment score even though the actual meaning may not be all that positive: **“You’re really nice…” (98%)** And it rates the following as having a low sentiment even though the intent may be to communicate quite the opposite: **“You’re not half bad” (32%)** It may even completely miss subtle British-vs-American interpretations, at least according to [this Guardian reporter](https://www.youtube.com/watch?v=VWrfaNN7DGg "Go to YouTube video") who explains that in British English, this is not a high compliment: **“Quite good” (98%) **
Publishing
Date
Status
Published
Draft
Slug
edit
Content
Thumbnail
Categories
Manage
New to Protobi?
Charts
Making Changes
Intermediate topics for editors
Frequently Asked Questions
SERMO Topics
Tutorial Pages
Internal Docs
Data Processing
Videos
Obsolete
GSG Admin
SERMO Admin
GSG Topics
How to...
Basics for viewers
Basics for editors
For project admins
Advanced topics
Assessments
Articles (in-progress)
New and updated articles
Process data in Protobi
superseded
Text open-end questions
Troubleshooting
Tracking studies
Organizing the view
API References
Tools
AI Database
Checking AI...
Convert to MD
Danger zone
Delete