Using Social Media Attention as a Market Sentiment Signal
Summary
The document considers which market variables might be studied alongside Twitter activity, including index and stock prices, price differences, trends, and expected returns. A response recommends treating posts as a source of market sentiment rather than assuming that social media activity directly predicts whether prices will rise or fall.
A related experiment used Google Trends search volume for company-related keywords as a proxy for attention. It flagged unusually large increases in search activity, then combined that signal with a momentum indicator to help interpret direction. The author reports that a simple daily-data, weekly-rebalancing backtest performed acceptably, but the time series was too short for reliable conclusions. Access to historical social-media and search data was also described as a practical limitation. The example suggests testing attention as a signal of potential market activity, while requiring independent directional information and stronger data for validation.
Key ideas
- Social-media activity can be modeled as a measure of attention or sentiment rather than a direct prediction of price direction.
- Potential targets include prices, trends, volume, volatility, and expected returns.
- The described experiment flagged unusually high search volume for company-related keywords.
- The experiment combined attention spikes with a momentum indicator to help infer direction.
- Its short backtest and limited access to data leave the reported performance inconclusive.
Tags
Full text
# What stock market indicators to model based on twitter feed? # What stock market indicators to model based on twitter feed? We are developing an algorithm that models twitter users and groups of words that may indicate real world events. One application is modelling elections, i.e which party is likely going to win. Another application is modelling the stock market. In addition, we are also interested in how the tweets, elections and stock markets correlate with each other. With regard to stock market, what would be sensible indicators to model? One obvious metric would be the index price movement. Another we were thinking about is volume of trade and perhaps volatility. Anyway, not really sure. What I'm looking for is a list if indicators that would be sensible to model. What I have so far: - Index price - Specific stock prices - Price differences - Trend - Expected future returns Any additions that would make sense? ## Answer by pyCthon (score 2) https://quant.stackexchange.com/a/7254 You may be interested in the twitter based hedge fund that recently fell under, but what you will be looking to model is market sentiment from the tweets and there are different ways to do this and a whole field of literature on this topic. Here is a decent thesis from MIT on the topic ## Answer by zuiqo (score 1) https://quant.stackexchange.com/a/7261 I implemented (purely for testing purposes, no real world application) a similar system which was based on Google Trends, where you get data on relative search query volume for a given keyword over time (weekly intervals). The important point is that you cannot directly link social media buzz to an up- or downmove. It will however give you an idea about larger-than-usual movements in any direction. We used a list of companies we wanted to look into, build a list of related keywords (like 'Apple' and 'iPhone'), and then aggregated the search query volume over the keywords and used a slightly modified version of the ADX Indicator. We only considered up-movements to have means to recognize when the search volume would rise exceptionally. The idea behind this was that when the search volume goes up, something is happening, or going to, without knowing whether its good or bad news, so this had to be interpreted in combination with something else, in that case we used a momentum based indicator I believe. In a simple backtest (daily data, weekly rebalancing) it worked actually fine, but the timeseries where too short, and its pretty hard to get the required data for a sensible test, as most of it is buried in the databases of google or twitter and I'm not sure whether API-Access is possible.
Shown in full with attribution under the source's licence. Licence: CC BY-SA 4.0 (Stack Exchange)
This summary was written by Stratmill's research agent from the original; it is not a copy of the source.