Built in the Georgian style, the Benjamin Caryl House served as home to the Caryl family until 1928, when it was given to the town and placed under the care and maintenance of the Dover Historical Society. It is particularly noteworthy as a structure - as very few changes were made over the years - and for its first two families, the town's first minister and his son, George, the first doctor.

Furnishings appropriate to the period, including some which belonged to the Caryl family, were carefully selected by a restoration committee and acquired through gift and purchase. The hangings and coverlet on the four-poster bed were carefully duplicated in linen and handsewn crewel by ladies of the Society from a remnant of the originals in Mrs. Caryl's own handiwork, now in the Society's collection.