Index Funds: What They Are, Why They Work, and How to Pick One

In 1975, a man named John Bogle launched a fund that Wall Street openly mocked. The fund didn't try to pick winning stocks. It didn't employ an army of analysts. It just bought every stock in the S&P 500 and held them. Competitors called it "Bogle's Folly." Fidelity's chairman said that most investors want to beat the market, not match it.

Fifty years later, that idea manages more money than all actively managed stock funds in America combined [1].

Bogle's Folly became Vanguard's Total Stock Market Index Fund. And the logic behind it hasn't changed: if you can't consistently beat the market, buy the market.

30-Second Summary: An index fund holds every stock (or bond) in a specific market index like the S&P 500. It charges almost nothing in fees (often 0.03%–0.05% per year). Over 15 years, 65% of professional fund managers fail to beat the index. For most investors, one or two index funds is all you need.

What Is an Index Fund?

An index fund is a type of mutual fund or ETF that mirrors a specific market index [2]. Instead of a portfolio manager choosing which stocks to buy and sell, the fund simply holds the same stocks in the same proportions as the index it tracks.

The S&P 500 index, for example, contains the 500 largest publicly traded companies in the United States. An S&P 500 index fund (like Vanguard's VOO or Fidelity's FXAIX) owns shares of all 500 companies. When you buy one share of VOO, you're buying a sliver of Apple, Microsoft, JPMorgan Chase, Procter & Gamble, and 496 other companies. Instant diversification.

There are index funds for nearly every corner of the market:

The differences between a "Total U.S. Stock Market" fund and an "S&P 500" fund are smaller than you think. VTI holds 3,600+ stocks, but the S&P 500 companies make up roughly 80% of its total value anyway. Over the past decade, the two have tracked within about half a percentage point of each other annually [3].

Why Index Funds Beat Most Professional Managers

This isn't opinion. It's one of the most documented findings in finance.

The SPIVA Scorecard, published by S&P Dow Jones Indices, has tracked the performance of active fund managers against their benchmark indexes since 2002. Their most recent data (year-end 2024): over a 15-year period, 65% of large-cap U.S. equity funds underperformed the S&P 500 [4]. In some categories, the failure rate exceeds 90%.

Why? Three reasons.

Fees. The average actively managed equity fund charges 0.64% per year. The average index fund charges 0.05% [5]. That 0.59% gap seems tiny until you compound it over decades.

Let's make this real. An investor puts in $500/month for 30 years at an 8% gross market return:

• Index fund (0.05% fee): Net return 7.95%. Ending balance: ~$736,200
• Active fund (0.85% fee): Net return 7.15%. Ending balance: ~$632,600

The active fund manager would need to beat the market by 0.80% per year, every year, for 30 years just to break even with the index fund. Most can't do it for five.

That $103,600 difference is the price of paying someone to try to outsmart the market. It's also roughly 57% of all the money you actually contributed out of pocket ($180,000 total contributions). More than half your personal savings, gone to fees.

The zero-sum problem. Before fees, the stock market's total return is split among all investors. For every manager who beats the index, another manager must underperform by the same amount. After fees, the math tilts heavily toward the index investor. John Bogle called this "the relentless rules of humble arithmetic" [6].

Survivorship bias. The funds that underperform tend to close or merge into other funds. The SPIVA data corrects for this. Many "track records" you see advertised only include funds that survived, making active management look better than it actually is.

Warren Buffett was so confident in this logic that in 2007 he bet $1 million that an S&P 500 index fund would beat a hand-picked basket of hedge funds over 10 years. He won. The index returned 125.8% cumulatively. The hedge fund basket returned 36% [7].

How to Pick an Index Fund

You've bought the philosophy. Now the practical question: which fund?

Here are the four things that actually matter, ranked by importance.

1. Expense Ratio

This is the annual fee, expressed as a percentage of your investment. Lower is better. Always.

For S&P 500 index funds, expense ratios now range from 0.00% (Fidelity's ZERO funds) to 0.10%. Anything above 0.10% for an index fund is overpaying. For context, 0.03% on a $10,000 investment costs you $3 per year.

2. The Index It Tracks

Decide what market you want to own. For most beginners, two choices cover everything:

• Total U.S. Stock Market (VTI or FSKAX): Broadest domestic coverage. One fund, every American public company.
• S&P 500 (VOO or FXAIX): The 500 largest. Slightly more concentrated, essentially the same performance.

If you want international exposure (and many financial advisors suggest 20–40% of your stock allocation should be international), add a total international fund like VXUS.

3. ETF vs. Mutual Fund

Both can track the same index. The difference is mostly mechanical. ETFs trade throughout the day like stocks. Mutual funds execute once per day at closing price. ETFs have no minimum investment (you can buy one share or even fractional shares). Many mutual funds require $1,000–$3,000 to start, though Fidelity and Schwab offer $0-minimum mutual funds.

For a detailed comparison, our article on ETFs vs. mutual funds covers the tax efficiency, trading, and cost differences.

4. Tracking Error

This measures how closely the fund follows its target index. A well-run S&P 500 fund should match the S&P 500 return minus its tiny expense ratio. Vanguard's VOO, Schwab's SCHX, and Fidelity's FXAIX all have negligible tracking error. Any of the big three providers will be fine here.

One thing that doesn't matter when choosing an index fund: share price. A $500 share of VOO and a $150 share of SCHB can both give you the same exposure. With fractional shares available at all major brokers, the price per share is irrelevant. You invest dollar amounts, not share quantities.

A Three-Fund Portfolio

The Bogleheads community popularized an approach that's as close to "optimal simplicity" as investing gets:

1. U.S. Total Stock Market Index Fund (VTI or VTSAX): Your core U.S. equity holding
2. Total International Stock Index Fund (VXUS or VTIAX): Diversification outside the U.S.
3. Total Bond Market Index Fund (BND or VBTLX): Stability and income

A 29-year-old might allocate 60% U.S. stocks, 25% international stocks, and 15% bonds. A 55-year-old might go 40% U.S. stocks, 15% international, and 45% bonds.

That's it. Three funds. Rebalance once a year (sell what's grown too large, buy what's shrunk). Total annual cost: roughly 0.04% blended. On a $50,000 portfolio, that's $20 per year in fees.

Compare that to a financial advisor charging 1% ($500/year on fifty grand) or an active fund at 0.85% ($425/year). The math is hard to argue with.

If even three funds feels like too much, a target-date retirement fund from Vanguard or Fidelity wraps all three into one fund and adjusts the allocation automatically as you age. Vanguard's target-date funds charge 0.08%. It's the one-fund solution for people who want to invest and forget.

See how these funds fit into your actual portfolio by using our compound interest calculator to project growth at different contribution levels.

Common Concerns (Addressed Honestly)

"But what about the next market crash?" Index funds will drop when the market drops. That's by design. The S&P 500 fell 34% in early 2020. By August 2020, it had fully recovered. In 2008, it fell 38%. By 2013, it was at new all-time highs [3]. If you're investing for a goal 10+ years away, crashes are buying opportunities, not disasters.

"Doesn't the S&P 500 concentrate risk in a few tech stocks?" Yes, the largest companies (Apple, Microsoft, Nvidia, Amazon) make up a disproportionate share. As of early 2026, the top 10 holdings represent roughly 35% of the index. This is worth monitoring, but it's also self-correcting: as companies shrink, they lose weight in the index. No human decision needed.

"What if I could just pick the winners?" You probably can't, and the data backs that up. But if you want to try, use the "core and explore" approach: put 80–90% in index funds, and allocate 10–20% to individual stock picks. That way your financial future isn't riding on your ability to outperform thousands of professional analysts.

Real talk: the boring part of index investing (buying the same fund, month after month, year after year, through crashes and booms) is also the hardest part. Humans crave action. Index funds demand patience. The investors who succeed aren't the smartest. They're the ones who can sit still.

For more on the strategy of consistent, automated investing, see our piece on why dollar-cost averaging works.

Your Next Move

1. Choose your fund: If you want simplicity, buy VTI (total market) or VOO (S&P 500). If you want international exposure, add VXUS.
2. Choose your account: A Roth IRA is ideal for long-term index investing. Already maxed out? Use a taxable brokerage account.
3. Buy your first shares: At Fidelity, you can invest as little as $1 in fractional ETF shares. No excuses.
4. Automate: Set up recurring monthly purchases so you never have to make the decision again.
5. Ignore the noise: Delete the stock-picking apps. Unsubscribe from the "hot tip" newsletters. The S&P 500 returned 25.02% in 2024 and 26.29% in 2023 [3]. You didn't need to pick any individual stocks to earn those returns. You just needed to own the index.

References

1. Morningstar. (2025). Active/Passive Barometer. Morningstar.com. https://www.morningstar.com/lp/active-passive-barometer
2. U.S. Securities and Exchange Commission. (n.d.). Index Funds. Investor.gov. https://www.investor.gov/introduction-investing/investing-basics/glossary/index-fund
3. SlickCharts / YCharts. (2025). S&P 500 Historical Annual Returns. https://www.slickcharts.com/sp500/returns
4. S&P Dow Jones Indices. (2025). SPIVA U.S. Year-End 2024 Scorecard. S&P Global. https://www.spglobal.com/spdji/en/research-insights/spiva/
5. Investment Company Institute. (2025). Trends in the Expenses and Fees of Funds, 2024. ICI Research Perspective. https://www.ici.org/research/stats
6. Bogle, J.C. (2003). John Bogle's Advice: Live Long and Prosper, on Index Funds. Knowledge at Wharton. https://knowledge.wharton.upenn.edu
7. Buffett, W. (2017). Letter to Shareholders. Berkshire Hathaway. https://www.berkshirehathaway.com/letters/2017ltr.pdf