The parish church of St Edmund has been in constant use for over 950 years. The church stands in the south-east corner and within the walls of the Roman Town of Venta Icenorum, which went out of use some 750 years earlier. There are two possible reasons why the church was built here. Firstly it may have been rebuilt on the site of an earlier church found here. A second possibility is that the present church was built by the owner of an Anglo-Saxon manor house which may have stood in or near the abandoned Roman town. Certainly a church stood here in the reign of King Edward the Confessor (AD 1042-1066). He gave the manor and the church at Caistor to the Abbey of Bury St Edmunds which probably accounts for the dedication of the church and the village to St Edmund.
