I took advantage of the great prices that were available for a new body and upgraded to the 5dmk2. Now I find myself with only the 50 1.4 & 70-200 f4 non-IS that actually work with my body.
I tend to use the wide range much more than tele (definitely getting the 17-40L) but recently (after renting the 135L for a week) it was so sharp it really inspired me to start shooting people i.e. portrait, and candid shots. Never really had much of a desire to do so before, and now it's something I would like to learn and develop a much stronger skill for.
I'm going to throw a curve ball here and suggest you don't get either of them. At least not yet. The 17-40L is a great value lens, that's a good choice. I've used mine daily for commercial work since it was announced in 2003, and I've got fussy clients. The 17-40L is a very good flexible lens.
If you're uncertain about the 100L vs 135L don't rush in. You already have an extremely good lens in your 70-200 f/4L. Don't under-rate it.
Full frame is a different experience to APS-C. Use your 5DII for a few months with the 70-200 and see what focal lengths you tend to use the most. This will inform you on whether to get the 100L or the 135L. You might be perfectly happy with the 70-200. Your upgrade money may be better spent on a 70-200 f/2.8.
While I am in the fortunate position of having a comprehensive lens set, if I could only keep two lenses they would be the 70-200 f/2.8Lis and the 17-40L. I buy new lenses to cover a clear and obvious creative or commercial need.