The U.K. hospitality industry may suffer a manpower crunch in the aftermath of a Brexit, a hotelier warned Thursday.