London's office buildings may become a lot less crowded if the U.K. votes to exit the EU in its referendum Thursday, a survey found.