← Research library
Research · 研究 · 108 · Foundations

Why most active traders underperform a simple index

4 Oct 20268 min readFoundationsShishin Research

This article explains why the average active trader tends to lag a simple index. It is educational and general, not personalised investment advice, and nothing here is a recommendation to buy, sell, trade, or allocate anything. Where it references research findings, those describe widely-observed patterns; past performance does not predict future results.

It is one of the most reliable findings in all of finance, and one of the least welcome: most people who try to beat the market fail to, and most professional funds that try fail too. Lack of talent and effort explain very little of it. Part of it is a mathematical certainty that has nothing to do with skill at all. Here is why the average active dollar underperforms, the specific drags that pull it below the index, and the honest other side, the persistent minority who do outperform and what they tend to have in common.

The short version

Active traders underperform for two compounding reasons. First, an accounting identity (William Sharpe’s “arithmetic of active management”): before costs the average active dollar earns the market return, so after costs it must, in aggregate, earn less than a low-cost index. Second, real drags (fees, trading costs, taxes, and behavioural errors like overtrading) subtract further. SPIVA-style evidence confirms it over long horizons.

The arithmetic: why the average must lose (before anyone trades badly)

Start with the part that is not an opinion. In 1991 the Nobel laureate William Sharpe laid out an argument so simple it is almost uncomfortable, and he called it “The Arithmetic of Active Management.” It goes like this. Every share of stock is held by someone. Split all investors into two groups: those who hold the market passively (owning every stock in proportion to its size) and those who are active (holding anything else). Together, the two groups own the entire market, so together they must earn exactly the market return, no more, no less.

The passive group, by construction, earns the market return (minus its very small costs). That forces the conclusion: the active group, in aggregate, must also earn the market return before costs, because the two groups add up to the whole. And here is the sting: active investors pay far more to play, higher fees, more trading, more taxes, so after costs the average active dollar must earn less than the average passive dollar. This is not a claim about markets being efficient, or about traders being foolish. It is an identity, true by arithmetic, the way the average cannot exceed itself. As Sharpe put it, properly measured, the average actively managed dollar must underperform the average passively managed dollar, net of costs. Full stop.

Two things follow that people often miss. It is a statement about the average, and an average can hide a wide spread of winners and losers, so it says nothing about any single investor. And it does not depend on the efficient market hypothesis being true. Even in a market riddled with mispricing, the arithmetic holds, because it is about who owns what, not about whether prices are right. The identity is the floor under everything else in this article.

The evidence: what actually happens over long horizons

The arithmetic predicts that most active managers should trail their benchmark after costs, and the data agrees with unusual consistency. The standard scorecard is SPIVA (S&P Indices Versus Active), a long-running study that compares actively managed funds against the indices they aim to beat. Its headline finding, repeated across regions and asset classes year after year, is that a large majority of active funds underperform their benchmark over multi-year periods, and the majority that lags grows as the horizon lengthens. Over a single year an active fund has a fighting chance; over ten or fifteen years, the share that beats the index shrinks toward a small minority.

Two subtler points make the picture worse than a first glance suggests. One is persistence: the funds that win in one period are, on the whole, not the same funds that win in the next, so last year’s star table is a poor guide to next year’s. The other is survivorship bias: funds that perform badly get closed or merged away, quietly vanishing from the averages, so the surviving funds flatter the industry’s record. Correct for the funds that died and the aggregate looks weaker still. The evidence, in short, points the same way as the arithmetic, and it points hard.

The drags: where the return actually leaks out

The arithmetic says the average active dollar must underperform after costs. This section is those costs, named. They are the channels through which an active approach bleeds return relative to a cheap index, and they stack.

DragWhat it isWhy it costs
FeesManagement fees, fund expenses, advisory and platform charges.A guaranteed, compounding subtraction from return every single year, win or lose.
Trading costsCommissions, plus the bid-ask spread and market impact paid on every trade.More turnover means more spread crossed; the frictions are invisible on a statement but real.
TaxesRealised gains, especially short-term, taxed as they are booked.High turnover realises gains early and often, dragging the after-tax return below the pre-tax one.
OvertradingTrading more than an edge justifies, churning the account.Each trade pays costs and taxes; activity feels productive but usually just transfers money to intermediaries.
Performance-chasingBuying what has already run, selling what has already fallen.Systematically buying high and selling low; the classic behaviour gap between fund returns and investor returns.
Cutting winnersSelling gains quickly while holding losers to “get back to even.”The disposition effect caps the upside that pays for the losses; it is exactly backwards.

The first three drags, fees, trading costs, and taxes, are the mechanical ones: they follow directly from cost and turnover, and Sharpe’s arithmetic already guarantees they bite in aggregate. The last three are behavioural, and they are what separate the average active trader from the average active fund. A pile of research, most famously work by Brad Barber and Terrance Odean on individual brokerage accounts, found that the investors who traded the most earned the least, and that the more someone traded, the further they fell behind a simple buy-and-hold. The activity itself was the problem. The specific mental glitches behind overtrading, chasing, and cutting winners, overconfidence, recency, loss aversion, the disposition effect, are catalogued in behavioral biases in investing; the point here is that they are the default settings of the human mind, careless or not, and they cost money on a schedule.

The honest other side: the minority who beat it

None of this means beating the market is impossible, and a piece that claimed so would be lying by omission. The arithmetic guarantees the average active dollar underperforms; it does not guarantee that every active dollar does. Someone has to be on the other side of the losers. There is a persistent minority, smaller than the marketing implies, larger than zero, that does outperform over long horizons. The useful question is what they tend to share, because the common threads are strikingly consistent and they map, almost one for one, onto the drags above.

The survivors tend to run low costs, refusing to hand back the edge in fees and turnover before they start. They tend to have a genuine, repeatable edge, an actual reason their process should work that is more than a good run, rather than a story fitted to past luck (the difference between a real edge and a backtest that flatters itself is most of the game). They tend to be disciplined, following the process through the stretches when it feels wrong, which is when most people abandon it. And they tend to have long horizons, letting an edge compound instead of trading it away. Notice the pattern: the winners are largely defined by not doing the things in the drag table. They are minimising the costs the arithmetic makes decisive and holding an edge long enough for it to matter.

How a rules-based process treats the behavioural drag

This is the one place a systematic approach connects naturally, and the connection is narrow and worth stating precisely. The mechanical drags, fees, spreads, taxes, are a matter of cost discipline that any approach can pursue. The behavioural drags are different: overtrading, chasing, and cutting winners are failures of temperament, and they are exactly the failures a rules-based process is built to remove. Shishin is a systematic signal service precisely so the entry, the ranking, and the exits follow the same rules every day regardless of how any single position feels. A rule does not get bored and overtrade, does not fall in love with a name that has already run, and does not snatch a small gain to feel clever while holding a loser to feel hopeful. That is the entire design intent: to close the behaviour gap that turns an ordinary edge into an underperforming one. No process repeals Sharpe’s arithmetic.

The honest framing keeps the two apart. A systematic process still pays fees and spreads, still owes taxes, and still has to earn a genuine edge that survives out of sample, none of which discipline alone provides. What it removes is the human variance: the good decision skipped on a bad day, the bad decision taken on an emotional one. That is a descriptive statement about how a rules-based system relates to one specific family of drags, not advice to trade actively or passively. Whether an approach clears the bar after all costs is a matter for its record, examined honestly, which is why a transparent system publishes an independently verifiable one at its public attestation rather than asking to be taken on faith.

So, why do most active traders underperform?

Because the deck is stacked before anyone places a trade, and then most traders push it further over. The arithmetic guarantees that the average active dollar, after costs, earns less than a cheap index, that is an identity, not a market view. On top of it, fees, turnover, and taxes subtract mechanically, and behavioural errors, overtrading, chasing, cutting winners, subtract on top of that. The evidence, SPIVA and the studies of individual accounts, confirms the prediction over long horizons with uncomfortable consistency. The comparison with the simple alternative is the subject of active versus passive investing.

And yet a minority persists, defined mostly by refusing the drags: low costs, a real and repeatable edge, discipline, and the patience to hold it. That is the quiet lesson underneath the discouraging headline. The market is beatable, but unforgiving of costs and temperament, and the honest way to try is to attack the leaks you control and to prove the edge in the open rather than assume it.

Sources & further reading

  • Sharpe, W. F. (1991). “The Arithmetic of Active Management.” Financial Analysts Journal, 47(1), 7 to 9 (the accounting identity behind aggregate active underperformance).
  • S&P Dow Jones Indices, SPIVA (S&P Indices Versus Active) scorecards, the long-running evidence that most active funds trail their benchmark over long horizons.
  • Barber, B. M. & Odean, T. (2000). “Trading Is Hazardous to Your Wealth.” Journal of Finance, 55(2), 773 to 806 (the more individuals traded, the worse they did).
  • On the mental glitches behind the behavioural drag, see behavioral biases in investing; on the broader choice this sets up, active versus passive investing; and on telling a real edge from a fitted one, why backtests lie.
  • On proving an edge in the open rather than assuming it, see Shishin’s public attestation and track-record analysis.
Related reading
FoundationsActive vs passive investing: when stock-picking is worth it9 min readFoundationsBehavioral biases in trading (and how rules avoid them)9 min readFoundationsMarket cap explained: small cap vs large cap, mid and micro11 min read
Frequently asked

Why do most active traders underperform the market?

Two compounding reasons. First, an accounting identity William Sharpe called the arithmetic of active management: before costs the average active dollar earns the market return, so after costs it must in aggregate earn less than a low-cost index. Second, real drags such as fees, trading costs, taxes, and behavioral errors like overtrading subtract further. SPIVA-style evidence confirms the pattern over long horizons.

What is Sharpe's arithmetic of active management?

It is a 1991 argument by Nobel laureate William Sharpe that active investors, in aggregate, must earn the market return before costs, because passive and active holders together own the whole market. Since active investors pay higher fees, more trading, and more taxes, the average active dollar must earn less than the average passive dollar after costs. It is an accounting identity, true by arithmetic, not a claim that markets are efficient.

Does the arithmetic depend on the efficient market hypothesis?

No. The identity holds even in a market full of mispricing, because it is about who owns what, not about whether prices are right. Passive and active holders together own the entire market, so the two groups must together earn the market return before costs regardless of how efficient prices are. That is why Sharpe's point survives even if you reject the efficient market hypothesis.

What does the SPIVA evidence actually show?

SPIVA (S&P Indices Versus Active) is a long-running scorecard from S&P Dow Jones Indices comparing active funds to the indices they aim to beat. The widely-observed pattern, repeated across regions and asset classes, is that a large majority of active funds trail their benchmark over multi-year periods, and that majority tends to grow as the horizon lengthens. It is framed as a general tendency, not a precise fixed figure.

What are the main drags that make active approaches underperform?

They split into mechanical and behavioral. The mechanical drags are fees, trading costs (commissions, bid-ask spread, market impact), and taxes on realized gains. The behavioral drags are overtrading, performance-chasing (buying high and selling low), and cutting winners while holding losers (the disposition effect). Research by Barber and Odean found that individuals who traded the most earned the least.

If the average underperforms, how does a minority still beat the market?

The arithmetic constrains the average, not every individual, so a persistent minority can outperform over long horizons. Those who do tend to share four traits that map onto avoiding the drags: low costs, a genuine and repeatable edge rather than a story fitted to past luck, discipline through stretches when the process feels wrong, and long horizons that let an edge compound. They are not beating the identity, they are minimizing the costs it makes decisive.