James Middleton, Factor of the Kilmarnock Estate