Well I'm pretty sure you will get a load of suggestions on why you shouldn't do this, and why Zooms are today just as good as Primes, but I've been through this exercise myself, and I recently did a trip to Japan to shoot the "Snow Monkeys" and decided for the first time ever to leave my Zooms at home.
For the record I have thee following Zooms; 8-15f/4 L, 16-35f/2.8 L II, 24-70f/2.8 L II, 70-200f/2.8L II, 70-300f/4-5.6L.
For Japan I packed the following; 14f/2.8L II, 24f/1.4 L II, Sigma 35f/1.4, 50f/1.2 L, 85f/12 L II, 135f/2 L, 200f/2 L.
The most used Lenses for this shoot, and probably the one's I'de suggest you could start with as a point of entry would be Sigma 35f/1.4, 85f/1.2 L II, 135f/2 & if you have the extra money there's nothing in the 200 range that can equal the 200f/2 L, keep in mind this was more of a Portrait shoot, only Monkeys as the subjects, around the city streets of Tokyo I relied more on the 24f/1.2 L II & the 50f/1.2 L.
There's no doubt in my own mind that any of these Primes, when compared to any of the Zooms I currently own, give a better IQ, though not necessarily a lot better, and you need to really peep when comparing to the 24-70 ii, but the Primes are marginally better, but there'll be a thousand opinions on this forum on that subject, what you do give up with out a doubt is the simple versatility of the Zooms, but I enjoyed the experience of having to think more about my shots when using the Primes, I believe it makes you a better photographer (I can here the howling in the background), a similar experience I had with the Leica M9, bought the gear, tried it for a year, then sold it all, I loved the Camera & the lenses, again, makes you a better Photographer, but my eye sight simply wasn't up to the Focusing system on the Leica, I'm pretty well screwed without Auto Focus or the time to use Live view.
Only other recommendation would be to think about the 17f/4 II TSE, this is a remarkable Lens, albeit somewhat of a specialised piece of Gear, but used properly it's about as good as it gets for a WA lens.