Nate Silver wrote a good book about predictions. I told myself that is an interesting topic since I have seen enough failures trying to predict where the market is going. I want to know what an expert predictor has to say about that. Although he had a chapter dedicated to predictions about the economy and the financial markets, I have included relevant content from the other chapters into this article.
A Beautiful Strategy is Risky
“Hedgehogs are type A personalities who believe in Big Ideas – in governing principles about the world that behave as though they were physical laws and undergird virtually every interaction in society. Think Karl Marx and class struggle, or Sigmund Freud and the unconscious. Or Malcolm Gladwell and the “tipping point”.
Foxes, on the other hand, are scrappy creatures who believe in a plethora of little ideas and in taking a multitude of approaches toward a problem. They tend to be more tolerant of nuance, uncertainty, complexity, and dissenting opinion. If hedgehogs are hunters, always looking out for the big kill, then foxes are gatherers.”
We adore concepts or theories that are neat and simple to understand. They help us understand the world better. However, the world is complex and beautiful theories oversimplify the matter.
Hedgehogs are very good story tellers and we all love to listen to them. Stories are captivating. Complex stories are confusing. We prefer simple theories that can help us organise our thoughts about the world.
Someone must have told a story about the “Golden Cross” and the “Death Cross” in the past and the society sort of accepted it. These are technical analysis jargons. A “Golden Cross” means a 50-day moving average has gone above the slower 200-day moving average in a price chart, and this is a bullish signal. The “Death Cross” is the opposite and it usually signify a crash is imminent. In a short history, we have seen the failure of the “Death Cross” during 2011, which the stock market did not crash after the signal was formed. In fact, the Straits Times Index went higher than the 2011 high.
Some would argue not all technical indicators are accurate all the time, and to complete a trading strategy requires money management rules to limit losses when the indicators fail. I agree. But my point is to identify the need to challenge our investment or trading beliefs, and not blindly believing in them. We need to accept we can be wrong all these while and take the courage to change our approach to the market.
Strive to be Less Wrong, to be Right
“[W]e can never achieve perfect objectivity, rationality, or accuracy in our beliefs. Instead, we can strive to be less subjective, less irrational, and less wrong. Making predictions based on our beliefs is the best (and perhaps even the only) way to test ourselves. If objectivity is the concern for a greater truth beyond our personal circumstances, and prediction is the best way to examine how closely aligned our personal perceptions are with that greater truth, the most objective among us are those who make the most accurate predictions.”
To Nate, the best way to be more right is to put your money where your prediction is. We will know how true our beliefs are by the amount of money we have made or lost.
We Need a Longer Period of Backtest
But you could construct a facetious argument for driving yourself home that went like this: out of sample of 20,000 car trips, you’d gotten into just two minor accidents, and gotten to your destination safely the other 19,998 times. Those seem like pretty favourable odds. Why go through the inconvenience of calling a cab in the face of such overwhelming evidence.
The problem, of course, is that of those 20,000 car trips, none occurred when you were anywhere near this drunk. Your sample size for drunk driving is not 20,000 trips but zero, and you have no way to use your past experience to forecast your accident risk. This is an example of an out-of-sample problem.
And the problem of not taking a longer period of historical analysis happened in the rating agencies leading to 2008 financial crisis.
“As easy as it might seem to avoid this sort of problem, the ratings agencies made just this mistake. Moody’s estimated the extent to which mortgage defaults were correlated with one another by building a model from past data – specifically, they looked at American housing data going back to about the 1980s. The problem is that from the 1980s through the mid-2000s, home prices were always steady or increasing in the United States. Under these circumstances, the assumption that one homeowner’s mortgage has little relationship to another’s was probably good enough. But nothing in that past data would have described what happened when home prices began to decline in tandem. The housing collapse was an out-of-sample event, and their models were worthless for evaluating default risk under those conditions.”
STI ETF exist for 12 years and made 8% per year on the average. To Nate Silver, this history is insufficient to determine 8% as the true average, even 120 years is too short in his opinion.
“Take, for instance, the oft-cited statistic that the stock market returns 7 percent annually after dividends and inflation. This is just a historical average. Reliable stock market data only goes back 120 years or so – not all that much data if you really want to know about the long run. Statistical tests suggests that the true long-run return – what we might expect over the next 120 years – could be anywhere from 3 percent to 10 percent instead of 7 percent. The answer to what economists call the “equity premium puzzle” – why stocks have returned so much more money than bonds in a way that is disproportionate to the risks they entail – may simply be that the returned stocks achieved in the twentieth century were anomalous, and the long-run returns is not as high as 7 percent.”
Hence, a proper backtest is more tedious than we desire to conduct it. Taking an easier way out, we often test strategies in the past few years, and it may not be sufficient as market conditions do not stay the same all the time. Volatility spikes once in a while. Market booms and busts happen time to time. We may naively comfort ourselves to assume the strategy works in the future as it had, in the previous few years.
“Chaos theory applies to systems in which each of two properties hold:
- The systems are dynamic, meaning that the behaviour of the system at one point in time influences its behaviour in the future;
- And they are nonlinear, meaning they abide by exponential rather than additive relationships.
If you drop another grain of sand onto the pile (what could be simpler than a grain of sand?), it can actually do one of three things. Depending on the shape and size of the pile, it might stay more or less where it lands, or it might cascade gently down the small hill toward the bottom of the pile. Or it might do something else: if the pile is too steep, it could destabilise the entire system and trigger a sand avalanche. Complex systems seem to have this property, with large periods of apparent stasis marked by sudden and catastrophic failures. These processes may not literally be random, but they are so irreducibly complex (right down to the last grain of sand) that it just won’t be possible to predict them beyond a certain level.”
The Chaos theory applies to the financial market. Booms and busts happen. Price changes are non-linear. There are a million possibilities that may unfold, depending on the interactions among the market participants and the feedback loops they acted upon. Hence, it is a extremely complex matter and we should be wary with the kind of predictions about the economy others try to sell to us.
Correlation not necessarily Equates to Causation
“Likewise, of the millions of statistical indicators in the world, a few will have happened to correlate especially well with stock prices or GDP or the unemployment rate. If not the winner of the Super Bowl, it might be chicken production in Uganda. But the relationship is merely coincidental…
Most of you will have heard the maxim “correlation does not imply causation.” Just because two variables have a statistical relationship with each other does not mean that one is responsible for the other. For instance, ice cream sales and forest fires are correlated because both occur more often in the summer heat. But there is no causation; you don’t light a patch of the Montana brush on fire when you buy a pint of Haagen-Dazs.”
We may have quirky habits. Is there a lucky shirt you would wear whenever you invest? I won’t be surprised if there are such practice somewhere in the world. It may be coincidental that this guy made money from stocks whenever he wore a particular shirt, and it has become a causation factor for him. Is it true or not? It may be an extreme example, but did we mistake correlation for causation?
The Challenge in Predicting where the Economy is Going
“As Hatzius sees it, economic forecasters face three fundamental challenges. First, it is very hard to determine cause and effect from economic statistics alone. Second, the economy is always changing, so explanations of economic behaviour that hold in one business cycle may not apply to future ones. And third, as bad as their forecasts have been, the data that economists have to work with isn’t much good either.
…Most statistical models are built on the notion that there are independent variables and dependent variables, inputs and outputs, and they can be kept pretty much separate from one another. When it comes to the economy, they are all lumped together in one hot mess.
…one difference between weather forecast and economics: “The physics and chemistry of something like a tornado are not all that complicated. That does not mean that tornadoes are easy to predict. But meteorologists have a strong fundamental understanding of what causes tornadoes to form and what causes them to dissipate.
Economics is a much softer science. Although economists have a reasonably sound understanding of the basic systems that govern the economy, the cause and effect are all blurred together, especially during bubbles and panics when the system is flushed with feedback loops contingent on human behaviour.
…If you look at the economy as a series of variables and equations without any underlying structure, you are almost certain to mistake noise for a signal and may delude yourself (and gullible investors) into thinking you are making good forecasts when you are not.
…Who needs theory when you have so much information? But this is categorically the wrong attitude to take toward forecasting, especially in a field like economics where the data is so noisy. Statistical inferences are much stronger when backed up by theory or at least some deeper thinking about their root causes.”
“…can be applied to traders on Wall Street, who often think they can beat market benchmarks like the S&P 500 when they usually cannot. More broadly, overconfidence is a huge problem in any field in which prediction is involved.
It probably isn’t mutual funds that are beating Wall Street; they follow too conventional a strategy and sink or swim together. But some hedge funds (not most) very probably beat the market, and some proprietary trading desks at elite firms like Goldman Sachs almost certainly do. There also seems to be rather clear evidence of trading skill among options traders, people who make bets on probabilistic assessments of how much a share price might move. And while most individual, retail-level investors make common mistakes like trading too often and do worse than the market average, a select handful probably do beat the street.”
The danger is that we always look at the select few who beat the market and think we have the chance to do so too. If he can do it, so can I!
“Most poker players are smart enough to know that some players really do make money over the long term – and this is what can get them in trouble.”
Be a Big Fish in a Small Pond
“[W]hen a field is highly competitive, it is only through this painstaking effort around the margin that you can make any money. There is a “water level” established by the competition and your profit will be like the tip of an iceberg: a small sliver of competitive advantage floating just above the surface, but concealing a vast bulwark of effort that went in to support it. Baseball, in the pre-Moneyball era, used to be one of these. Billy Beane got an awful lot of mileage by recognising a few simple things, like the fact that on-base percentage is a better measure of a player’s offensive performance than his batting average. Nowadays pretty much everyone realises that… Poker was also this way in the mid-2000s. The steady influx of new and inexperienced players who thought they had learned how to play the game by watching TV kept the water level low.
If you have strong analytical skills that might be applicable in a number of disciplines, it is very much worth considering the strength of the competition. It is often possible to make a profit by being pretty good at prediction in fields where the competition succumbs to poor incentives, bad habits, or blind adherence to tradition – or because you have better data or technology than they do. It is much harder to be very good in fields where everyone else is getting the basics right – and you may be fooling yourself if you think you have much of an edge.
In general, society does need to make the extra effort at prediction as more of a business proposition, you’re usually better off finding someplace where you can be the big fish in a small pond.”
Is the market you choose to invest or trade a small pond or a big pond with many professionals? Personally I do not like to invest in big caps or stocks that are popular because it is a highly competitive game. Predicting earnings growth is a professional game and I do not think I have much edge in this big pond. I rather invest in undervalued but fundamentally strong small caps. It is a smaller pond with less competition and the low liquidity speaks for that. There aren’t many fund managers, analysts, professional traders in this small pond.
Focus on the Process, and Less on the results
“Play well and win; play well and lose; play badly and lose; play badly and win: every poker player has experienced each of these conditions so many times over that they know there is a difference between process and results.
…The irony is that being less focused on your results, you may achieve better ones.”
It pays to be Patient
Speaking about edge, there is one that you can easily exploit, but you may not want to wait. Or would you?
“When the P/E ratio is 10, meaning that stocks are cheap compared with earnings, they have historically produced a real return of about 9 percent per year, meaning that a $10,000 investment would be worth $22,000 ten years later. When the P/E ratio is 25, on the other hand, a $10,000 investment in the stock market has historically been worth just $12,000 ten years later. And when they are very high, above about 30 – as they were in 1929 or 2000 – the expected return has been negative.
However, these pricing patterns would not have been very easy to profit from unless you were very patient. They’ve become meaningful only in the long term, telling you almost nothing about what the market will be worth one month or one year later. Even looking several years in advance, they have only limited predictive power.
…So long as most traders are judged on the basis of short-term performance, bubbles involving large deviations of stock prices from their long-term values are possible – and perhaps even inevitable.
…[O]verconfidence alone was enough to upset an otherwise rational market. Markets with overconfident traders will produce extremely high trading volumes, increased volatility, strange correlations in stock prices from day to day, and below-average returns for active traders – all the things that we observe in the real world.”
We May Be Trading Noise Instead of the Signal
“Some theorists have proposed that we should think of the stock market as constituting two processes into one. There is the signal track, the stock market of the 1950s that we read about in textbooks. This is the market that prevails in the long run, with investors making relatively few trades, and prices well tied down to fundamentals. It helps investors to plan for their retirement and helps companies capitalise themselves.
Then there is the fast track, the noise track, which is full of momentum trading, positive feedbacks, skewed incentives and herding behaviour. Usually it is just a rock-paper-scissors game that does no real good to the broader economy – but also perhaps no real harm. It’s just a bunch of sweaty traders passing money around.
However, these tracks happen to run along the same road, as though some city decided to hold a Formula 1 race but by some bureaucratic oversight forgot to close one lane to commuter traffic. Sometimes, like during the financial crisis, there is a big accident, and regular investors get run over.
…Much technical trading in the stock market probably obeys this sort of cat-and-mouse dynamic, with technical traders simply trying outguess other technical traders. However, the patterns they are trading on can dissipate or even reverse themselves once other investors become aware of them. The result is a lot of money being passed around from trader to trader, but the pile slowly growing smaller as it is eaten away by transaction costs.”
Nate Silver seems to be inclined to fundamental analysis, or value investing, as he called it the Signal. He is opposed to trading, which he described it as making buy and sell decisions based on noises.
Some of these points have made me challenged my assumptions and I felt uncomfortable at times. But we need to be truthful to ourselves and review what we are doing. We become more right when we are less wrong. Nate Silver did a good job with this book – challenging the way we conduct ourselves in the real world.
What do you think? What do you agree or disagree on?