What is Newland's connection to Mrs. Thorley Rushworth in the novel, The Age of Innocence?

A few years prior to the events of the novel, Newland had an affair with Mrs. Rushworth, a married woman. While the affair in no way marred his reputation, public knowledge of it tarnished her good name.