Japan's retail sales fell more than expected in August, adding pressure on policymakers to lift household spending.