A Brexit would trigger a sell-off in the pound and a decline in household income, according to the billionaire investor.