I have the 100-400L which is about the same size/weight of the 2.8, so I know what it's like carrying a tree stump around all day. When you need to, you need to. But often I head out with my Think Tank Retro 5 stuffed with my 5Dmkll + SP24-70VC + either 17-40L or 70-200L with no particular photographic mission in mind. I just like to have my stuff. I don't think I'm likely to do that with the 2.8L. So I'm screwed in that I think I will "need" to keep my f/4 for such trips as well as when "traveling light."
On a positive note, I just got the shipping label from Canon so my new heavy toy should ship tomorrow, yipee!
I find the 100-400 is (a lot) easier to carry, esp with a tele converter! I very often have the 1.4TC on the 70-200 so here are the weights:
70-200 IS II : 1490 grams
100-400 : 1380 grams
70-200 IS II + 1.4 II (=98-280 f/4) : 1710 grams
Also, the 70-200 seems a lot more front-heavy than the 100-400, this gets worse obviously if you add the TC. The 100-400 gets long when you point it at (fast) things far-away which makes it easier to 'aim'.
This is why I prefer the 100-400 on sunny days when I need the extra reach, but I will live with the extra weight of the 70-200x1.4 when I need f/4
5Dmk3, 5Dmk2, Sony NEX-6 | SY14mm f/2.8, Ʃ20mm f/1.8, 35mm f/2, Ʃ35mm f/1.4A, 50mm f/1.8 I, Ʃ50mm f/1.4 EX, 100mm f/2.8L Macro, 17-40L, 24-105L, 70-200 f/2.8L IS II, 1.4x II, 70-300L, 100-400L | E-mount: 16-50 OSS, Ʃ30mm f/2.8 EX DN, 55-210 OSS | 2x FT-QL, AE-1 Program, some FD(n) & FL primes