Shares of the controversial retailer plunged on a lousy earnings report. Maybe the company would do better if it didn't have such an exclusionary attitude.