Joseph Allen (1770–1845), Fellow, Bishop of Bristol (1834–1836), Bishop of Ely (1836–1843)