Sir John William Bowen (1876–1965), Politician