Thanks for the replies.
I purchased the 70-200 f4 is. $1100 seemed like a good price. It's new and I know I can sell it later if need be for minimal loss. I think it complements my 24-105. Now that I have the telephoto covered. I am going for the 24-70 II year end or early next. Either way thanks for all the advice. I looked and held the 70-200 2.8 and it just is too heavy for the extra stop. Also the cost is soo much. I think this will let me see if I feel limited by the aperature and if so then I will sell it and go for the 70-200. At least then I will know I need it. I looked at the 200 2.8mm and 135l but for me I need zoom since my family makes me have to react fast and it's too hard to change lenses of focus on moving around. I think this will be a good start. If Canon releases the infamous 14-24 or 35l II then maybe that will be my next lens. I also will probably end up with the eos m and use my lenses on that for when I need to travel light. That makes the lens I purchased that much more useful vs the 2.8 counterpart. Anyway thanks everyone.
Congratulations on the purchase. Nothing can beat primes, but they do have their specific place and for a lot of us the versatility of an L zoom outweighs the IQ advantage of a fast prime.
Good point on the 70-200 2.8 IS II. It's better on all aspects, if you don't mind lugging the extra weight. Thing is, the 70-200mm f4 is so good already (it's even better than the 70-200 2.8 Mk I) that you wouldn't actually know there's a better zoom unless you've actually used the 2.8 II. So no regrets, enjoy and be confident that you've made the right decision.