I have both. The 24L ii is slightly sharper, has slightly better contrast and colour and I think is a bit better built. However the 35L is a great lens and is definitely more flexible/useful on a regular basis. That said, portraits from the 24L can be amazing and nothing else quite matches what it can produce. Certainly the practical choice is the 35L.
