That's actually totally incorrect and untrue. There is a statute under CO law that has to do with Non-Compliance with Failure to Exercise Parenting Time - in which case an Absentee parent can be held accountable in court for ignoring his/her parenting responsibilities. Under CRS 14-10-123.4 "The court will consider failure to exercise parenting time in ruling upon decision making, primary physical residence and parenting time." A parent can, in fact, have his or her parenting time restricted for being a jackass.
Further, a child DOES in fact have a say, and a judge will take into consideration (usually around the age of 12) what the child thinks about visitation. Theanswerguy, you cannot be from Colorado.
At the very least, you should seek to modify visitation based on his unreliability and have sanctions written into the order to dissuade this kind of irresponsible behavior.