The Manor house of Ifield, and the moated site on which it sat, was likely to have been constructed around 1250. The tithe map of 1840 shows a substantial building in the northern corner of the island, but this was destoyed by fire in the mid 1800s and by 1870 no buildings existed on the island. The site is a scheduled monument.