I'm not a lawyer, but I beleive in cases of abandonment, the law will err on your side. I would seek help from a professional family lawyer. Judging from your post, it sounds like he's not just abandoning you, but the kids as well. He is definately an unfit father. Check out http://www.ehvlp.org and see if you qualify for their services.

BigSister