How can that be phrased?

Quite simply, you could say:

The children shall live with the wife subject to the husband’s visitation time as set forth herein or elsewhere (the parenting agreement).

The clause would also emphasize the wife as having sole physical custody of the child(ren).