Usually refers to the equity market. "The market went down today" means that the value of the stock market dropped that day.