As much as I love the 35, I don't think that lens would be the best bang for your buck right now.
And I don't know that the 24-105 should be on your short list, either. It's slow and it's long, especially on APS-C.
I think what you really want is the 17-55 f/2.8 IS. It'll be your perfect walkaround lens, it's stabilized, it's just as fast as the 16-35, and it's a much more useful range on APS-C than the 24-105. From everything I've heard about it, the only reason it doesn't have a red ring is because it's an EF-S lens.
You might also consider the Shorty McForty as an alternative to the 35L. It's a bit slower, yes, but it's an optically gorgeous lens, and it's cheap and small and lightweight (everything the 35 isn't).
I'm not trying to dissuade you from L glass, but merely suggesting that there are non-L alternatives that may actually be better for your circumstances. L lenses absolutely have their place, but that place generally doesn't include first / primary positions in small APS-C kits.