The motte and bailey is a typical Norman fortification in the frontier zone that existed between England and Wales. In the doomsday book it was the possession of Osbern le Scrob of Richards Castle who had been given estates around here by Edward the Confessor in the 1040's. The exact date of construction of the castle is not known but is most likely to date to the late 11th century following the Norman conquest. There are traces of a stone tower, probably built around 1195 as part of a refortification licensed to Hugh de Say, one of Osberns descendants. In the mid 13th century the castle became part of the Mortimers estates by marriage. It was captured and destroyed in a local uprising by the Maelienydd Welsh in 1262. Masonry from the tower was used to build a now collapsed church tower.