The danger of Twitter sentiment analysis

So I was reading an article from TechCrunch entitled “Sentiment Is Split On The iPad: People Either Love It, Or Hate Others For Not Shutting Up About It“. The subject was funny so I decided to read it. But, when I started to look at their sources I realized they were pretty much just using TweetFeel which is a service that tries to do sentiment analysis on the tiny twitter messages flowing around with the given keyword.

Sentiment analysis is a very hot topic lately and there are lots of interesting results from it. However, it doesn’t work that well, because most of the methods are based on keywords around the concept you are looking for and language is not very good at being locally unambiguous. Twitter makes it different:

– It has a positive thing that people can’t write much, so they will put their sentiments there and not just make a reference to it in an far away phrase
– It’s bad because there is only so much context that can be obtained from 140 characters.

So I decided to use TweetFeel to see what data they were using. They made some references in the article, but I wasn’t sold. TweetFeel is quite interesting: it keeps streaming the references to the keyword you enter (in this case “ipad”) and highlights it in green if it’s considered good and red if it’s bad. It also keeps count of good and bad references.

After letting it run for a minute or so I was seeing about the same thing that the TechCrunch article mentioned:

Negative: 37 (52%)
Positive: 34 (48%)

But when I started looking at what was considered positive and negative, I started seeing some very interesting tweets (I don’t recommend people clicking on the links):

Free ipad WTF http://j.mp/cQdSbk Risen #thefeelingyouget #TLS 5lko
Free ipad WTF http://sn.im/v8uda #OMGThatsSoTrue Feliz Páscoa #TheFeelingYouGet #HappyBdayKoba j59y

In other words, lots of spam sources that were trying to use common keywords to get people to click on their links hoping it had something to do with the their keyword spam. Moreover, because had the word “WTF” I’m guessing TweetFeel considered that negative. My 1-minute sample is not significant, but if I remove all those spam tweets, here is the new count:

Negative: 26 (43%)
Positive: 34 (57%)

(as I said, this is not statistically significant, so don’t take these numbers too seriously)

Anyway, now that I’m talking about the iPad, one might be wondering if I’m planning on buying one. The answer right now is “no”. If I looks at how I access the information that I want to access and interact, I don’t really think that there is a gap that is worth $500. Although there are some apps on it that I really wished I could access without having one, even if it’s just to play around with it for some time (like the Marvel app for reading comics). I just hope that the trend is not for thing to migrate all to the iPad framework and not to also have a web or other computer-based way of accessing it.

One thought on “The danger of Twitter sentiment analysis

  1. Although to some it may feel oh-so-far-off, spring is on it's way, and here are the louis vuitton to prove it! New Christian Louboutin spring shoes are hitting the shelves and they are colorful, whimsical and playful,perfect for a spring or summer wedding looking for a little jolt of fun! and now discount for Gucci,Which are your faves?louis vuittonlvlouis vuitton walletslouis vuitton purseslouis vuitton sunglasseslouis vuitton bagslouis vuitton handbagslvlouis vuitton bagslouis vuitton outletlouis vuittonlvlouis vuitton walletslouis vuitton purseslouis vuitton sunglasseslouis vuitton bagslouis vuitton handbagslvlouis vuitton bagslouis vuitton outletlouis vuittonlvlouis vuitton walletslouis vuitton purseslouis vuitton sunglasseslouis vuitton bagslouis vuitton handbagslvlouis vuitton bagslouis vuittonlvlouis vuitton walletslouis vuitton purseslouis vuitton sunglasseslouis vuitton shoeslouis vuitton bagslouis vuitton handbagslvlouis vuitton bagscugg boots cheapcheap ugg bootsdiscount uggsuggs on salecheap ugg boots on salecheap uggs on salediscount uggs on saleugg classic boots salecheap ugg boots for sale onlinecheap ugg boots wholesalecheap ugg classic boots on saleUGG classic bootscheap ugg classic bootsugg discount bootsdiscount uggs bootsdiscounted ugg bootscheap uggs bootsuggs for cheapugg tall bootsugg short bootsugg boots saleugg boots on saleugg boots on cheapugg discountcheap ugg boots for womencheap ugg boots onlinecheap ugg boots for salecheap ugg boots for Kidscheap ugg boots on salecheap ugg boots for sale onlinecheap ugg boots wholesalecheap ugg boots for girlscheap ugg classiccheap ugg classic tall bootscheap ugg classic cardy bootscheap ugg classic short bootsUGG SlippersUGG Slippers for womenugg slippers for women ukcheap ugg slippers for womenUGG Slippers for menugg slippers for men on saleUGG Slippers for men ukUGG Slippers on saleugg slippers on sale for womenwomens ugg slippers on salecoquette ugg slippers on saleUGG Slippers salemens ugg slippers saleUGG Slippers cheapugg slippers discountugg slippers discountedugg slippers for kidsugg slippers clearancemens ugg slippers clearanceugg slippers outletUGG Sandalsugg sandals for womenugg sandals on saleugg sandals menugg sandals for menugg sandals womenugg sandals saleugg sandals halendiugg sandals amazonugg sandals clearanceUGG Sneakersugg sneakers for womenugg sneakers womenugg sneakers ukugg sneakers everamens ugg sneakersUGG Classic Sheepskin Gloveugg sheepskin glovesfingerless sheepskin glovesugg shearling glovesugg igloo glovesugg fingerless glovesugg men's glovesugg australia glovesugg long glovesugg gloves saleugg gloves womenugg gloves blackugg gloves australiaugg gloves ukugg gloves cheapugg gloves and mittensmens ugg glovesblack ugg glovesUGG Fringe Cardy Knit Bootsugg cardy bootsugg cardy boots reviewsugg cardy boots sizingugg fringe cardy bootsugg boots classic cardyugg cardy reviewsugg cable knit bootsugg classic argyle knit bootscheap ugg knit bootsugg knit boots with buttonsUGG Classic Kids Bootsugg boots for kidsugg boots for kids on saleugg boots for kids cheapugg boots for kids ukugg boots for kids canadafake ugg boots for kidsdiscount ugg boots for kidsclearance ugg boots for kidspink ugg boots for kidsreplica ugg boots for kidspurple ugg boots for kidsugg style boots for kidsugg kids bootsugg kids boots saleugg kids boots clearanceugg kids boots on saleugg kensington kids bootsugg kids cardy bootsugg kids cardyugg kids cardy iiugg kids cardy pink multiugg kids classic tallugg kids classic tall marquis knitugg kids classic tall stripe cable knitugg kids lil sunshineugg kids size chartugg kensington kidsugg kensington kids bootsugg look alikes for kidsugg knockoffs for kidsugg shoes for kidsugg boots on sale for kidsugg style boots for kidsuggs for kids on saleuggs for kids outletUGG Kenly Bootsugg kenly greyugg kenly reviewsugg kenly chocolateugg kenly espressowomens ugg kenly bootscheap ugg kenlywomen's ugg kenlyUGG Adirondack BootsUGG Adirondack Boots iiUGG Adirondack Boots men'sUGG Adirondack Boots ukUGG Adirondack Boots tallugg adirondack boots canadaugg adirondack iiugg adirondack ii saleugg adirondack ii bootsugg adirondack tall bootsugg adirondack saleUGG Adirondack Boots ii saleUGG Adirondack Boots ii otterugg adirondack boot reviewsugg adirondack boot otterUGG brookfield tall Bootsugg brookfield tallUGG brookfield Bootsugg brookfield shortugg brookfield blackUGG Classic Argyle Bootsugg argyle boots on saleugg argyle boots saleugg argyle knit bootsugg argyle knitugg argyle Bootsugg argyle Boots on saleugg argyle Boots saleugg argyle UKugg argyle reviewugg argyle knit ukUGG Classic Bailey Button BootsUGG Bailey Button Bootsbailey button triplet uggsbailey button uggsbailey button ugg boots on saleUGG Bailey Button Boots on saleUGG Bailey Button Boots leopardUGG Bailey Button Boots kidsUGG Bailey Button Boots saleUGG Bailey Button Boots cheapUGG Bailey Button Boots cheatnutUGG Bailey Button Boots ukUGG Bailey Button Boots 5803UGG Bailey Button Boots reviewsUGG Bailey Button Boots blackugg bailey button tripletugg bailey button on saleugg bailey button bomberugg bailey button triplet bootugg bailey button reviewugg bailey button triplet kidsugg bailey button triplet saleugg bailey button toddlebailey button uggs saleUGG Classic Cardy BootsUGG Classic Cardy saleUGG Classic Cardy reviewUGG Classic Cardy blackUGG Classic Cardy on saleUGG Classic Cardy mossUGG Classic Cardy oatmealUGG Classic Cardy greysUGG Classic Cardy tallUGG Classic Cardy figUGG Cardy figUGG Cardy bootsUGG Cardy saleUGG Cardy boots on saleUGG Cardy reviewUGG Cardy kidsUGG Cardy boots saleUGG Cardy iiUGG Cardy sizingUGG Classic Crochet Bootsugg suburb crochet bootsUGG Crochet Bootsugg crochet boots saleugg crochet collectionUGG Classic Mini BootsUGG Mini Boots on saleUGG Mini Boots ukugg mini melUGG Mini Classicugg mini blackclassic ugg miniugg mini mel largeugg mini mel pinkUGG Classic Short BootsUGG Classic Short Boots on saleUGG Classic Short Boots black 5825UGG Classic Short Boots chestnutUGG Classic Short Boots blackUGG Classic Short Boots graywomen's UGG Classic Short Bootscheap UGG Classic Short BootsUGG Short Boots on saleUGG Short Boots saleblack UGG Short Bootsugg short black bootsugg australia classic short bootsclassic short bootsUGG Classic Tall BootsUGG Classic Tall Boots on saleUGG Classic Tall Boots chestnutUGG Classic Tall Boots blackUGG Classic Tall Boots graycheap UGG Classic Tall BootsUGG Classic Tall woolUGG Classic Tall saleUGG Classic Tall cheatnutugg classic tall wool stripeugg classic tall blackugg classic tall blackberry wineugg classic tall fancy women'sugg classic tall fancy bootugg classic tall logougg classic tall metallicugg classic tall metallic bootUGG Classic Tall Romantic Flowerugg classic tall romantic flower 5802ugg romantic flower bootugg romantic flower boot on saleUGG Classic Tall Stripe Cable KnitUGG Tall Stripe Cable KnitUGG Classic Stripe Cable KnitUGG Classic Tall Stripe Cable Knit bootsUGG Stripe Cable Knit bootsUGG Elsey BootsUGG Elsey Boots on saleUGG Elsey wedgeUGG Elsey wedge bootsUGG Gissella BootsUGG Gissella blackUGG Gissella reviewUGG Gissella ukUGG GissellaUGG Highkoo BootsHighkoo uggshighkoo boot by uggHighkoo ii uggsHighkoo iihighkoo ruched boot uggUGG Infant Erin BootsUGG Infant ErinUGG Infant BootsUGG Infant Boougg infant bootiesugg infant snowsuitugg infant shoesUGG Erin pinkUGG Erin blueUGG Erin saleUGG Erin babyUGG jimmy choougg jimmy choo siobhanugg jimmy choo ukugg jimmy choo priceugg jimmy choo collaborationnicky hilton ugg jimmy chooUGG Knightsbridge BootsUGG Knightsbridge Boots blackwomen's UGG Knightsbridge BootsUGG Knightsbridge Boots ukUGG Knightsbridge Boots saleUGG Knightsbridge Boots 5119ugg knightsbridge boots women's reviewsUGG Knightsbridge reviewUGG Knightsbridge size 10UGG Knightsbridge black size 7UGG Knightsbridge 5119UGG Knightsbridge blackUGG Knightsbridge greyUGG Knightsbridge saleugg knightsbridge espressoUGG Langley BootsUGG Langley Boots on saleugg langley siltUGG Metallic BootsUGG Metallic cardyUGG Metallic logoUGG Metallic copperUGG New Style BootsUGG Nightfall Bootsgenuine ugg nightfall bootsUGG Nightfall Boots saleUGG Nightfall Boots chestnutUGG Nightfall Boots ukUGG Nightfall ukUGG Nightfall blackUGG Nightfall 5339UGG Nightfall reviewUGG Sheepskin Cuff BootsUGG Sheepskin Cuff Boot reviewUGG Sheepskin Cuff Boot ukUGG Sheepskin CuffUGG stella tall BootsUGG Suburb Crochet Tall BootsUGG Suburb Crochet Tall blackUGG Sunburst BootsUGG Sunburst tallUGG Sunburst tall blackUGG Sunburst ukUGG Sunburst tall saleUGG Sunburst cheapUGG Sundance II blackUGG Sundance II chestnutUGG Sundance 2ugg sundance limited editionUGG Tess Suede BootsUGG Tess bootsugg suede boots 5230UGG Ultra Short BootsUGG Ultra Short Boots ukUGG Ultra Short 5225UGG Ultra Short saleUGG Ultra Tall BootsUGG Ultra Tall balckUGG Ultra Tall cheatnutUGG Ultra Tall reviewUGG Ultra Tall ukUGG Ultra Tall 5245UGG Upside BootsUGG Upside 5163ugg handbags on saleugg handbags ukcheap ugg handbagsugg handbags sale

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s