First off, I'm glad you only get annoyed over important things
I don't shoot manual, except with flash, because that would simply cause a lot of wrongly exposed shots for me. Why on earth would I for example limit my shutter to 1/500s (In M) if the light suddenly changes and I could have 1/4000s? A conert for example, would you rather shoot 1000 images at 1/250s and hope, or would you like to have those explosive images where all the light go boom and the artist jumps perfectly frozen?
The way I shoot is always in Av and auto-iso and I set my shutterspeed range. Out with the kids, aperture set for dof, usually wide open. Auto-iso between two values I'm comfortable with and limit my lower shutter to 1/1000s or 1/2000s.
That way I always have perfectly exposed images, without motion blur, in the shadow, in a playhouse and out in the sun, all in the same 12 fps burst, try to dial that fast in M.... I also have shot so much with the 1dX it's very easy to know when to turn the right thumb a little for a little EC. (My cam is set to have 0 EV to +5/8)