A Tale of Two Cities

Who does Dr. Manette fixate his looks upon? What possible reasons could there be for this look of fear and distrust?