I've actually done that many times back in the days when I had access to two lenses: 50mm and 135mm. It never felt like I missed anything. And the two L versions of these lenses must be some of the best SLR lenses ever. I personally can easily live without a wide angle lens and the 85mm range is too "in-between" for me. Depends on your subject matter and personal preferences of course.