I'll be waiting for the next post where you have sold the 6D with your L glass and bought into the Fuji X system.
Unless you concentrate on long telephotos, you may find that the X-Pro (or the shortly expected x-pro II) will
fulfill all your needs and expectations at about 1/3 the weight.
I would love to go all in on a smaller mirrorless rig. However, my personal opinion of the available systems is that they are not enough to cover all of my needs (along with some other shortcomings).
Although I love my x100s, it merely meets a day to day need where the shortcomings are only forgiven due to the convenience factor. I am able to produce images which I'm very happy with out of it. But it in no way replaces all the tools I need (as you've pointed out with re to tele). I feel the same even with the interchangeable lens models right now since AF is still not quite as fast as I need for certain situations and the ecosystem is still underdeveloped (lenses and flashes).
Also, if I were to jump on an interchangeable lens Fuji body, I would hope that it is full frame. Considering there is still ambiguity as to whether the XF lenses would provide enough coverage (with the limited number of them), I am not convinced that it will be a developed system very quickly. That being said, I am rooting for them and hope that they continue to come out with innovative and awesome imaging tools.