Perhaps Canon had always intended to market a 24-70mm f/2.8L with IS, but just were not ready yet or they wished to maximize their revenue with early-adopters first with the non-IS mkII version? Who knows. But what I do know is that IS lenses are very different to their non-IS counterparts, not just in terms of additional weight (the f4L IS is 55g heavier than the non-IS and the mk1 70-200 f2.8 IS USM is 160g or 10oz more than the non-IS version), but also the internal workings have to be completely redesigned to accommodate the Image Stabilization mechanism - thus you end up with a different lens in terms of groups/elements etc.
Do people think that the adoption of a wider diameter (82mm instead of 77mm) on the new 24-70mm f2.8L mkII has anything to do with plans afoot that Canon Inc. has to launch an IS version? In other words, did they increase the width of the lens because they had planned all along to incorporate IS at a later date and wish to utilize common parts across the assembly of both products.