What happened to the Lizabeth and Joey’s older and younger siblings?

From the text:

By the time I was fourteen, my brother Joey and I were the only children left at our house, the older ones, having left home for early marriage or the lure of the city, and the two babies having been sent to relatives who might care for them better than we.