I think that this thread contains too much negativity about the 24-105. I had a 5D (classic) with the 28-135 (ex-film days) and found the move to the 24-105 to represent a significant and visible step forwards. I then bought a 7D. Although this had more pixels, the IQ of the 5D image was invariably superior, especially with higher ISOs and shadow detail. I then replaced my 5D with a 5DmkII and noticed an improvement is IQ. This combination is noticeably better than that of the 7D.
When comparing my 24-105 with my 50mm 2.5 macro, I see little difference. Both lenses out-resolve the 5DmkII in the centre and the macro at the edge, and the 24-105 at the edge when stopped down a couple of stops.
I haven't used either 24-70 f2.8 so can't comment. The DXO graphs for sharpness show the 24-105 to be similar to the original 28-70, although the new 2.8 is better. Those graphs also show the 5dII/24-105 to be sharper than the 7D/17-55. I'd like avoid debate about DXO, but just to say that it gels with my understanding of lenses I own.
And by the way, I had a 20mm f2.8 and was very disappointed on FF, and found that the 20-35 (3.5-4.5) was much superior.
I conclude that I am very happy with the 5DII / 24-105 combination. I will going on a week-long hike in New Zealand's South Island in a week. I will take my 5DII, 24-105, my Samyang 14mm and a small tripod. My 7D, 50mm, and 70-200 will stay home.
The new 24-70 f2.8 provides some future-proofing should a higher resolution sensor come available, but you pay quite a price premium for that.