Penrhyn Slate Quarry, Property of Lord Penrhyn