PicaPica said:[quote author=Mt Spokane Photography]
There are plenty of web sites that do competent testing of products, and a few that don't.
I'd suggest that you take advantage of advice from the many good photographers on this site, and go to some of the premiere test sites and read actual test reports rather than taking posters in forums at face value. Many forums have some really good photographers, but the test sites tend to be a cut above because they have expensive software and the knowhow to avoid the pitfalls that do it your self experts step into.
When was the last time one of the websites you mention have found a bug in one of the products they have tested? Found! Not just reported.
The light leak bug in the 5D MK3.
Not a bug some say.. yet canon has fixed it.
The "white rubber" issue.
Tons of other examples where the "Bugfinder" are ordinary people in photography forums.
A testchart and other testgear will not help you find issues outside their line of use.
Review sites are usually in a hurry to get their reviews out. Longtime tests.. who does them, beside Lensrentals?
Don´t be naive.
It is the same as with car magazines.
If you would believe them no car ever would need a recall.
[/quote]
All of the things you mention were investigated or reported on the major sites. I haven't heard of the light leak causing a actual issue, since you must have a lens cap on to detect it. Likewise, the white rubber issue has been around off and on for at least 30 years, and affected Minolta and Nikon most. They did not acknowledge or fix it, while
canon did.
Its true, tons of people find Bugs that are a issue, and 100 times more that cannot be confirmed. The issue comes when knowledgeable testers all over the world have not been able to find the issue, and even more amazing if 35% of the owners in Germany are so good at testing that they have found it.
I'm a skeptic, but there are certain people who I have followed over the past 20 years that have a good record for careful testing. Most test sites do not just test in a lab, but also test in the field, people throw up the "Real World" excuse because careful testing does not support their theory, rather than using it in conjunction with lab tests. I have had and operated a lab that did reports for Nasa, and we do look at standard tests, and certainly cannot test for everything, so having lots of users reporting issues they find is a good thing, but that does not mean that even 0.001 percent are actual problems. Most of them turn out to be operator error, or defective equipment.
Upvote
0