Henry Toelle bought the log cabin in 1846, and later, in 1849, moved his family here from New York. The cabin was located on Highway 50, west of the Fox River bridge, on the south side. A stone house replaced this cabin. It was started in 1850 and took two years to complete. The lime found nearby was burned and used in the making of the second Toelle home, and the stones were brought from Southport. The house had an old-fashioned German fireplace.