Wow that is exactly how it started with my stbx. Then he would get all mad and say that I couldn't take a joke. From there it just escalated to the point where he treated me like a prison bbitch. To this day he still doesn't understand what he was doing was abusive.
Sorry your marriage had to end before you realized your problem, but admitting it is the first part of recovery.

Good luck to you.