tow.com
   Home / Digital Journal / 2004 / High ISO Testing


High ISO Testing

Written: January 30, 2004
Last Updated: February 2, 2004

Mike Tanaka and I test the high ISO performance of the EOS-1D and EOS-10D digital cameras.

Ever since the Canon EOS-10D was released, I've been hearing about the wonderful high ISO performance. People have been raving on the forums that 10D images are clearer than many digital SLR's on the market today, including the Canon EOS-1D. I never had the opportunity to test this theory until last night when Mike came over to return my 28-70 lens.

I'm most interested in evaluating a camera's low-light, high ISO performance, since these are situations I face on a daily basis. By low-light, high ISO situations, I mean lighting conditions that necessitate setting a high ISO speed in order to maintain a reasonable hand-holdable shutter speed. Most high ISO tests on the Internet don't replicate these types of real-world conditions; they usually involve photographing the same well-lit scene, varying only the ISO speed. For instance, they test using ISO100, f/8.0, 1/50s all the way to ISO3200, f/8.0, 1/3200s. Unless you're shooting sports, you're rarely finding yourself in a situation where you're thinking, "Hmm... should I shoot ISO100 or ISO3200 if I can handhold the shot?" More often than not, you'll find yourself thinking, "I must use ISO1600 in order to handhold this shot."

Methodology (or lack thereof)

We used a tripod and hand-holding to test the performance of the 1D and 10D. We used the 24/1.4 lens at f/2.8 and the 17-40/4.0 lens at 4.0 for our testing. The tripod was not moved during testing, which means the 1.6 crop factor and sensor pixel density (6MP vs. 4MP) of the 10D makes its images look larger than the 1D's. When hand-holding, I tried to keep the relative size of the image the same. The 1D's noise reduction was set to NR1, meaning all exposures longer than 1/15 second would use a dark-noise subtraction algorithm to clean up the image (for more information on the 1D's noise reduction settings, read this article).

Here are full-size crops of the images that we had taken. The crops were saved in Photoshop at JPEG 11. You judge for yourself which camera produces the least noise.

ISO 1600
ISO 1600
ISO 1600
ISO 1600
ISO 3200
ISO 3200
ISO 3200
ISO 3200

Analysis

The 1D may have more noise, but the noise appears smaller and overall cleaner than the 10D's. The 10D's noise looks to be larger and more clumped together. In my opinion, this is not as appealing as the 1D's noise. My conclusion is that for these lighting conditions, the 1D has much better noise characteristics at high ISO than the 10D. I have no idea what the results would be in a hockey arena where you have to use ISO1600 or ISO3200 in order to freeze the action at 1/250 second.

As to people's claims that the 10D's high ISO performance is amazing, Mike hypothesizes that these people are probably former D30 or D60 users. Compared to the D30 and D60, the 10D has very good high ISO performance. When I had the D30, I rarely went above ISO400 because of what I perceived to be high noise at 800 or 1600. In retrospect, ISO 800 wasn't that bad on the D30. On the 10D, I wouldn't mind going to ISO1600, but 3200 is unacceptable for anything but web images (but remember, everything looks good at web resolution!).

More Photos

Here are web-sized images of the samples that we took. You can see even in these images that the 1D's images look better than the 10D's. They might not be noiser or cleaner, but they look nicer.

1D, ISO3200, 1/40s, f/2.8, 24mm
1D, ISO3200, 1/40s, f/2.8, 24mm
1D, ISO1600, 1/20s, f/2.8, 24mm
1D, ISO1600, 1/20s, f/2.8, 24mm
1D, ISO1600, 1/15s, f/4.0, 17-40mm
1D, ISO1600, 1/15s, f/4.0, 17-40mm
1D, ISO3200, 1/40s, f/4.0, 17-40mm
1D, ISO3200, 1/40s, f/4.0, 17-40mm
10D, ISO1600, 1/20s, f/2.8, 24mm
10D, ISO1600, 1/20s, f/2.8, 24mm
10D, ISO3200, 1/40s, f/2.8, 24mm
10D, ISO3200, 1/40s, f/2.8, 24mm
10D, ISO3200, 1/40s, f/4.0, 17-40mm
10D, ISO3200, 1/40s, f/4.0, 17-40mm
10D, ISO1600, 1/15s, f/4.0, 17-40mm
10D, ISO1600, 1/15s, f/4.0, 17-40mm

Enter The Photo Gallery
Enter The Photo Gallery


Reader Comments

I've been perusing the 1D/1D II/1Ds forums a bit the last few days and noticed this thread, to which I posted a link to your informal tests...hope that's okay by you.

http://www.robgalbraith.com/ubbthreads/showflat.php?Cat=&Number=208011&page=0&view=collapsed&sb=5&o=&fpart=1

--posted by Larry Gottschalk @ Sunday, February 1 2004, 23:23 pm EST


Larry:

Hey, no problem with the link love on Rob's site!

-adam

--posted by Adam @ Monday, February 2 2004, 1:29 am EST


Hi Adam,

I'd be interested to see ISO400/800 as well..

Stan

--posted by Stanley Chan @ Monday, February 2 2004, 20:51 pm EST


I have been comparing noise using the images posted in the reviews done by Steve's Digicams and Image-Resource.
Specifically, I use the Steve's red brick building and
IR's Far-Field Test.
I save the original image then open it in a viewer at 400% to 800% magnification. The area in shadows and the
sky are my points of comparison. 10D wins. In fact,
I haven't seen any camera beat the 10D in this test.
I have a 10D on order.

--posted by Lee @ Monday, February 2 2004, 22:58 pm EST


Those examples don't take into account low-light and it's effect on high ISO performance. That said, if you're happy with the 10D, great! My article was not to say buy one over the other. It was simply to compare the high ISO, low-light performance of the two cameras.

--posted by Adam @ Tuesday, February 3 2004, 12:34 pm EST


I just bought a 10D, and I have to say I am very disappointed in the level of noise, specially magenta in the shadow, even at 200ASA. I did notice that different lighting conditions create acceptable or unacceptable noise. My take on that is the softness (lack of contrast/sharpness) of the 10d image, would make noise even more visible in certain situations. Under good lighting conditions, I prefer images from my trusted G3. At this point, I'm considering using the 10D for six months or so, and then sell it.

--posted by Franck @ Wednesday, February 4 2004, 10:11 am EST


Your high iso tests were right on and exactly what I found when I had to choose between keeping my 1D and 10D. There's a test on imagingresource.com between a 1D and a Nikon D2H with very similar results. I think many users believe the 10D must be cleaner because it's newer, but it's just not the case. Also, the 1D offers ISO adjustments to a third of a stop; not so with the 10D. It'll be interesting to see how the 1D compares to the new 1D Mark II.

--posted by David Ho @ Wednesday, February 18 2004, 2:01 am EST