Well generally the 85L is slow. It is basically its only imperfection and likely the only change should Canon consider a III. I prefer shooting with the much cheaper, but still very sharp and wide 85 1.8 for this reason.
In terms of the 35L. My favourite Canon lens. Beautiful. The 24 is very nice too, but a bit too wide a prime for me.