Who is the Old Gentleman and where does he live?

Sometimes, Kino and Jiya see the kind-faced Old Gentleman looking out to sea, yet he never notices the boys. Kino worries about using the island without permission, but Jiya insists the Old Gentleman never uses it and only the sacred deer live here. Though Kino wants to spend the night on the island, Jiya is unwilling.