hendrik-sg said:
in My opinion Lenstip is much better, they are pysicians and have a look at many more possible aberrations than photozone. What i do not like at photozone as well is, that they jump the camera body without notifications. The 11-24 is tested on 5Ds and the 16-35 4.0 on 5Diii, so no comparision is possible. Lenstip at least are giving recommendations, how to compare between the bodies, even between the brands.
Next point is that there should be tested with raw files, as to measure lens performance, we do not want to have sharpening algorithms incuded in the test, especially as they can simulate (by guessing information which may be there or not, and wih may appear as noise or artefacts) a higer resolution which is not valid, even beyond the diffraction limit. In such aspects i would better trust lenstip.
Sure, lensrentals are the only testers who have access to pools of lenses and can measure sample variation, but they do resolution tests only and give no informaton about other aberrations, as lenstip do.
BUT: the best is to combine the statistic information of lensrentals with the detailed examination of lenstip
But LensRentals optical bench testing can show you things about the lens aberrations that you can't necessarily see in a resolution chart, too. Astigmatism is one clear example. The MTF chart also shows how the lens behaves as a function of spatial frequency, and again how these vary with image height, which is not always how Imatest results are reported.
People such as "dilbert" who criticize MTF charts at infinity focus as not being representative of how a lens performs on a camera body in real-world conditions only reveal that they don't understand how to read MTF charts. That's not to say that optical bench testing is the end-all and be-all of how a lens performs, no; not by any means. If I want to understand the nature and extent of color aberrations, for example, I will look at other sources of information. But not all review sites have information that I trust, because sometimes what I see being reported doesn't make sense when I gather all the information together.
The bottom line is that it's all splitting hairs anyway. Virtually all lenses produced today are excellent, and people should be happy with their performance. I would be more concerned about a lens that fails to focus consistently if it offers AF, or a lens that is easily damaged or not put together well, because that's an issue of value. But these have very little to do with whether a $5000 Zeiss lens or a $700 Sigma lens or a $1700 Canon lens are of equivalent optical performance. I just wish photographers would not use review sites as justification that one lens is "absolutely" better than another.