You said:

my attorney said to relax and try and get thru it, it is just temporary he will never have 50/50.

My response:

Your stbx already has 50/50 custody. That's going to be hard to change.

Start documenting all of the times that he doesn't follow the court order (and if a judge signed off on it, it is a court order) and how he won't work with you when you need to switch. That will show that he really doesn't want to co-parent. And it just may help to reverse the 50/50 custody. Because right now, that is going to be hard to change.

By signing that agreement, you established that you are okay with him having 50/50 custody.

And you aren't going to be able to use his drug and alcohol problem as you knew about them when you signed the agreement.

I am sorry that you are going through this, but you do have a lousy attorney. Have you considered consulting with another one?