What frightens the narrator at the beginning of "Section 2: Part 6"?

The narrator is frightened because he can no longer hear the sea. Having heard the sea throughout the rest of the novel, the narrator associated the sound with Anna haunting him. Now he feels that she has left again.