The present Norman church, which has its origins in the 12th century, is set on falling ground to the west of the town.
The churchyard contains the ancient monument of St Withburga's Well, supplied by a spring that is said to have issued forth from the burial place of Withburga, one of the four daughters of King Anna of East Anglia who reigned in the 7th century. Saint Withburga laid the foundation of a church and convent, the first Christian settlement in the area in the year 654.
Points of interest within the church include the 'Seven Sacrament Font', made in 1488, which has the Church's sacraments carved on the sides, the eighth showing the crucifixion, the eagle lectern, made in Liege around 1475, beautiful Tudor ceilings in the north and south transept, painted in the 15th century and the burial place of the poet William Cowper (1731-1800)with the famous Cowper window sited above the tomb.
The reredos (behind the high altar)was made in 1857 and painted in 1929.