Can computers really tell what we think?

Clipped from www.abc.net.au
“Julia Gillard was in my dream last night. It was quite bizarre.” One point for Julia.

“Tony Abbott’s laugh is a little bit terrifying, but at least he can laugh.” One point for Tony.

This is how computers are determining whether our political leaders are in or out of favour with the public. Chunks of text are fed into a program and each tweet, Facebook status, blog post or news article is given a positive or negative stamp. It’s all totalled up and you end up with a single figure between -100 and 100. They call it sentiment analysis.

But are computers smart enough to understand the nuances of language, from cultural differences to sarcasm and irony? Or is sentiment analysis nothing but snake oil for marketing agencies to sell to the many corporations eager to get on the social media bandwagon, but unable to even locate the wagon in the car park?

Brand management is where most sentiment analysis is currently happening. Chocolate milk makers, fearing their product will be seen as a daggy school-related drink, are monitoring kids on social networks to see how their product is being talked about. Car companies are monitoring how many Facebook groups have been setup about their brand – both positive and negative – as well as how many people are in the groups and whether they’re making positive or negative statements.

Corporations love being talked about, and being talked about in social media circles is an enticing way to be in the headspace of the lucrative Gen Y-ers. There is a rush to know how to react when things go wrong, or to control what is being said. Sentiment analysis offers a foothold into this area, a modern day media monitoring service sans humans. The truth is that the best sentiment analysis providers claim to provide only a 70-80 per cent level of accuracy.

It is still a new and experimental area, so despite the low accuracy rate the technology shouldn’t be completely dismissed. As trivial as the above commercial uses may sound, sentiment analysis has the potential to provide analysis of human reactions in ways that online polls or questionnaires cannot, especially once the understanding of language, and therefore the levels of accuracy, improve.

For Jon Gray, a project leader in the area of e-Government at the National ICT Australia (NICTA), sentiment analysis is just one aspect of machine learning and language analysis. NICTA have been doing research into machine learning and semantic technologies for some years. Their tool, OpinionWatch, is designed to do a general analysis of opinion, which includes sentiment but also extends to categorisation of data.

For instance, a ministerial staffer could use the tool to gauge opinion on a new policy across blogs, news sites and social media. Once the machine has categorised the data into specified topics, the staffer could then confirm the analysis is correct. It’s machine-assisted work, rather than machines having the final say.

NICTA’s prototype is highly customised for each individual project with algorithms being tailored to the needs of the project. Gray does insist it’s still a tool for expert users due to the complicated nature of semantic technology.

Despite this, it’s still remarkable to see how far computers have come with analysing the complex interconnected world of human discourse. While we may not be living in George Jetson-land just yet, who knows how close we’ll be in five to 10 years. Now, that reminds me, who out there is working on a jet pack for me?Read more at www.abc.net.au

 

Link for June 24th, 2010

  • Typisch Nederlandse woorden als 'gozer' of 'mazzel' worden door Vlamingen vlotter begrepen dan typisch Vlaamse woorden als 'goesting' of 'ambetant' door Nederlanders. Vlamingen hebben minder moeite om het Nederlands van hun noorderburen te verstaan dan andersom het geval is. Tot die conclusie komt Leen Impe van de KU Leuven na onderzoek in vier Belgische en vier Nederlandse regio's: de provincies West-Vlaanderen, Antwerpen, Brabant, Limburg, Noord-Brabant, Groningen en Nederlands-Limburg en de Randstad (Amsterdam, Rotterdam, Utrecht, Den Haag en omgeving). Samen met collega's van de universiteiten van Nijmegen en Groningen onderwierp Impe er zo'n duizend middelbare scholieren (zeshonderd Vlamingen en vierhonderd Nederlanders) aan een luistertest die peilde naar hoe goed ze woorden begrepen die werden uitgesproken door taalgebruikers uit noord en zuid.

Links for June 24th, 2007

1 of 3123


elsewhere


DandyID Delicious Flickr ClaimID Soup (Soup-Tacular) Amplify Visualizeus Google Profile Posterous StumbleUpon (Morgaine) PeoplePond Twitter Clipmarks YouTube 43 People 43 Places 43 Things 30 Boxes Bloglines Brightkite Chimp CoComment FriendFeed Newsvine Vox Jaiku Multiply My OpenID Tumblr (Morgaine) DeviantArt TypeKey Technorati Wakoopa Facebook LinkedIn Plurk LastFm Kaboodle Netvibes MySpace MyBlogLog Google Reader Disqus Icq LibraryThing Shelfari Simpy AllConsuming Colourlovers Digg 43 Marks Squidoo Blip Fm Dipity Diigo Mixx Koornk Blogger Plinky Libre Fm Card.ly Getsatisfaction Goodreads 12 Seconds 97 Bottles Big Think You are My Mashable Flixster Vimeo Veoh Weheartit Reddit Identi.ca  Facebook Page