I would go in the way of the cheaper lenses too. I own a good amount of L glass as well, but I buy it only when it brings something I really need (17 and 24 TS-E for architecture, 100 macro L for the IS, 135mm for the USM and f/2). More expensive is not always better. I was with nikon before, used AI-S manual lenses that were all constructed the same (excellent) way. You had the 35mm f1.4, f2, f2.8, all built exactly the same, the f2 was the best of them, but some people needed 1.4 and other could only afford the f2.8. What I mean is not to fall in the trap of overkill: L is nice, better built, but Canon was clever enough to separate it from the "non L" lenses so you always feel poor when you don't have the L. That's the magic of marketing.
I earn my life with my lenses, and in some cases non L is better for me; I have the old 15mm Fisheye, and almost fell in the trap of swapping it for the 8-15 L (thanks to Canon cashback offer); the old one makes exactly the same images, but is 1 stop brighter, lighter, smaller and I paid 500€ instead of 1200€. I went hiking with the fisheye and am happy I did not buy the L zoom.
For the lenses you consider, my wife has the 85 1.8 and earns her life with it, no one ever complained; it's clear the 1.2 allows a more creamy bokeh and is a bit sharper, but is 5 times the price, big, heavy, not the fastest AF and is focus by wire in manual focus. If you make nice portraits, the 1.8 will do a perfect job, the 1.2 would probably do it a little bit better, but it's up to you if you want to spend 5 times the money.
For the 35mm, I was hesitating like you, I finally bought the f/2 IS, and could not be more satisfied with my choice, it's optically as good as the 1.4, almost half the weight, 1/2 of the price, the bokeh is really nice and the IS is for me a real plus, that makes you want all you primes would have it.
Construction quality ? Honestly all Canon lenses are good enough to work professionally, don't let yourself fool into thinking that you cannot make good pictures if it's not L, buy what you really need.