During Kett's rebellion he was allowed to preach in the rebels' camp on Mousehold Hill, but without much effect; and later on he encouraged his chaplain, Alexander Neville, to write his history of the rising.
In 1383 Bishop Fordham gave the burgesses licence to receive tolls within the borough for the maintenance of the walls, while Bishop Neville granted a commission for the construction of a pier or mole.
With the erection of this tower the church was completed as it now stands, and on the 3rd of February 1472 it was reconsecrated by Archbishop Neville.
The castle and lordship descended by heirship, male and female, through the families of De Clare, Despenser, Beauchamp and Neville to Richard III., on whose fall they escheated to the Crown, and were granted later, first to Jasper Tudor, and finally by Edward VI.
Later cadets were John, brother of the 3rd earl, who carried the standard at Crecy, became captain of Calais, and was summoned as a peer in 1350, but died unmarried; and William, brother of the 4th earl, who was distinguished in the French wars, and succeeding to the lands of the Lords Abergavenny was summoned in that barony 1392; his son was created earl of Worcester in 1420, but died without male issue in 1422; from his daughter, who married Sir Edward Neville, descended the Lords Abergavenny.