Because 46% of Americans have no stock investments, a booming stock market is not felt by the whole population.