Bernard Fergusson (1911–1980), Lord Ballantrae