Where do the guards take Rodrigues in Chapter 5?

In the evening the guards remove Rodrigues from the hut and take him through the village to the wharf. They board a ship and set sail. The guards tell the priest that they are going to Yokose-no-Ura.