The U.K.'s vote to leave the EU will be "bad news" for the country itself more than for anyone else, according France's central bank governor.