The large mound, or motte just to the north of the church is of Norman origin. It stands on the east end of a rectangular bailey platform of fair size. The castle which stood here may have been a stone structure. The doomsday book records Lingen as being held by a knight called Turstin and he was under the overlordship of the Mortimers of Wigmore. The site is accessible.

Another motte about 1km to the north is reached via paths across the fields and crossing Limebrook. It has traces of a bailey to the SE and is also most likely to be Norman. There is some controversy as to whether this site was a castle or a fortified house. It is rather confusingly known locally as the Churchyard