13 September 2012

Making investment decisions based on insight from Twitter

Predicting individual shares and stock market movements is one of the oldest professions and there are people far better qualified than me to assess the validity of the models used. Automating this process is also not new.

Tech-savvy traders have been sourcing data from reports, press releases and corporate Web sites for years. Genuine advocates of automated predictive models use powerful computers to speed-read content and then letting the machines decide what it all means for the markets.

However, using Twitter is still a relatively new phenomena. In this and my next blog, I will explore how two studies I have come across can inform our thinking on social media and share price.

Twitter mood predicts the stock market. (Johan Bollen, Huina Mao, Xiao-Jun Zeng)

The Bollen et al study results indicated that the accuracy of DJIA predictions from Twitter can be significantly improved by the inclusion of specific public mood dimensions. They claimed an accuracy of 87.6% in predicting the daily up and down changes in the closing values of the DJIA and a reduction of the Mean Average Percentage Error by more than 6%.


The study investigated whether measurements of collective mood states derived from large-scale Twitter feeds are correlated to the value of the Dow Jones Industrial Average (DJIA) over time.  They analysed text content of daily Twitter feeds with tracking tools that measure positive vs. negative mood and mood in terms of 6 dimensions (Calm, Alert, Sure, Vital, Kind, and Happy).

Now I’m not convinced by this study.

It seems to me, if the mood is being reflected in the Twittersphere, everyone probably already knows how it will move markets, so there isn’t a whole lot of competitive advantage. Unless of course, it’s insider information, in which case and putting aside the regulatory and moral minefield that comes with this hypotheses; Investors would need a high risk tolerance to act on it without verification and the opportunity cost of seeking verification would render the Twitter news obsolete.

If that isn’t enough to be wary of, as a researcher posted on Quora “There's also a paradox: once there are enough tweets about the inside information it's no longer really inside information. Twitter is probably best used for assessing the herd mentality. One strategy might be to look at all the dumb stuff people are saying and then bet the opposite.”

In my next blog, I will look at the sales effect of the volume of positive, negative, and neutral online communications captured by social media monitoring technology and classified by automated sentiment analysis.

2 comments:

  1. The research you refer to has been pretty thoroughly discredited since then (see link below). There has however, been massive advances in this area which have breathed new life into the whole area of data analytics and consumer insight. Advances in search and the ability to mine massive amounts of data cheaply in recent years now means that creative approaches and combinations can be employed in really new and innovative ways.

    With these new capabilities, new propositions are emerging from companies like Datasift and Recorded Future that can harness this torrent of information and present it in a usable way (more links below). Combinations of these flows together with other pieces of information out there or in your domain will be valuable.

    I remain a little sceptical about the predictive power of all this but feel there is certainly real value from a risk management perspective.

    http://sellthenews.tumblr.com/post/21067996377/noitdoesnot#disqus_thread


    Reading (UK) based DataSift --> http://datasift.com/
    Boston (MA) based RecordedFuture https://www.recordedfuture.com
    Good paper by Deutsche Bank https://www.recordedfuture.com/assets/SignalProcessing20111118.pdf

    ReplyDelete
  2. Thanks for taking time out Morgan. Econometrics wan't my strongest subject at during my Masters, so I am glad you could source such an articulate reviewer of Bollen et al that reached the same conclusion as me, albeit in a very different way.

    I am familiar with DataSift's work on this and here is a link to some of their work for other readers of this blog. http://blog.datasift.com/2012/05/18/twitter-sentiment-mirrors-facebook-stock-prices/#.UCNvo_ZmSRY via Paul Hawtin at DCM Capital.

    ReplyDelete