The house was originally owned by the Lyons, a prominent family in 19th century Greenport that included a lawyer and department store owner. The building is a 2-story Italianate with flat roof, double bracketed cornice and ornate widow's walk with arched windows on 4 sides. The porches have gingerbread railings, decorative brackets and square columns.