My mother lived in Dulce, NM for a while, so I got a chance to enjoy some of SW Colorado--beautiful! Never took Wolf Creek Pass, though.
We decided to drive from Albuquerque to Telluride one year for the Jazz Fest. It was rainy by the time we reached Silverton, CO, so the roads were pretty sketchy around there (we were not in a 4WD). In Silverton, we were told NOT to go through Ophir because we did not have the right kind of vehicle, but to go up to Ouray and make a loop around from there. We thought, OK, it will take a little longer, but at least we will have an easier drive/live to tell the tale. Mmm hmm.
It was not too bad all the way to Ouray (is that the Red Mountain Pass?). In fact, if I remember correctly, it was scarier getting to Silverton, with the sheer drop and the barrier-less roads.

But continuing on the road to Telluride...not only was it longer than hell and twisty and turny, but the thickest fog I'd ever seen appeared. We couldn't see ANYTHING, but we KNEW there were cars coming from the other direction, because they had been passing us fairly regularly all the way. We made it somehow, but a couple of other cars had a minor collision before we got there.
As far as I remember, the trip back was uneventful...unless I just blocked it out somehow. No way would I do that drive in the snow!!