The de Marney/Marney family came over from Normandy in the wake of William the Conqueror. The earliest record of the family at Layer Marney dates from 1166, when they were under the overlordship of the Bishop of London. Layer Marney Tower was built between 1515 and 1525 and is the tallest Tudor Gatehouse in the country.