I have the EF 20mm f/2.8 USM still. It's definitely a character lens. If you want a native sharp performance for most places you need to hit f/5.6 and for everywhere you need f/8. f/2.8 is great for isolating a point and letting the surroundings drift away — think of a focal point in a bar or old barn where the rest is merely a suggestion of place.
With DLO the situation improves by leaps and bounds! It was DLO that kept the lens in my bag, and it remains a good option for autumn landscapes, casual wide travel (it is small), etc. You'll never shoot it for critical sharpness, but... but... it has a pleasant character to the rendering. One of those I like this chocolate better than that chocolate feelings. In the hand it has a nice feel. That stated, it will never be an EF 24mm f/1.4 II.
The EF 28mm f/1.8 USM never thrilled me. It has a great form factor, but I never liked the rendering. Even with DLO. Good on a crop, however, and so my kiddo now owns my copy.
20mm is a very pleasant framing for the world. When it comes to people, the subject is the scene and the person is a prop.