Fastest CPU / Fastest GPU data skewed #74214

New Issue

Johan Walles · 2020-02-25T22:07:31+01:00

Johan Walles commented

2020-02-25 22:07:31 +01:00

Hi!

Look at the top graphs here:
https://opendata.blender.org/

From the two top lists you can get these numbers, showing that the AMD CPU is about 1.2x faster than the GeForce card:

Threadripper 3970X at 494s
GeForce RTX 2080 Ti at 601s

However, if you look at benchmark numbers for these two, where both have been run on the same...

Scene
Blender version
OS

... it turns out that it's actually the GeForce card that is faster by a factor of 1.2:
https://github.com/walles/blender-opendata-comparer/tree/walles/toplist
Branch: walles/toplist
SHA: 4fb12bb13b5e4e5a2e70862b844f76de28ae1ae9

So due to sampling bias, where not all rendering devices have been run under the same conditions, the current comparisons sometimes come out wrong.

Not entirely sure how to do better comparisons unfortunately, but this is something that you may want to think about.

Regards /Johan

Hi! Look at the top graphs here: https://opendata.blender.org/ From the two top lists you can get these numbers, showing that the AMD CPU is about 1.2x faster than the GeForce card: * Threadripper 3970X at 494s * GeForce RTX 2080 Ti at 601s However, if you look at benchmark numbers for these two, where both have been run on the same... * Scene * Blender version * OS ... it turns out that it's actually the GeForce card that is faster by a factor of 1.2: https://github.com/walles/blender-opendata-comparer/tree/walles/toplist Branch: `walles/toplist` SHA: `4fb12bb13b5e4e5a2e70862b844f76de28ae1ae9` So due to sampling bias, where not all rendering devices have been run under the same conditions, the current comparisons sometimes come out wrong. Not entirely sure how to do better comparisons unfortunately, but this is something that you may want to think about. Regards /Johan

Johan Walles commented

2020-02-25 22:07:31 +01:00

Added subscriber: @Walles

Sem Mulder commented

2020-02-26 09:26:46 +01:00

Added subscriber: @SemMulder

Sem Mulder commented

2020-02-26 09:26:46 +01:00

I think this is mainly due to the CUDA vs OptiX difference (see #73322) and compare the following:
https://opendata.blender.org/benchmarks/query/?device_name=GeForce%20RTX%202080%20Ti&group_by=benchmark&group_by=device_type
https://opendata.blender.org/benchmarks/query/?device_name=Threadripper%203970X&group_by=benchmark

So I'm merging this into #73322.

I think this is mainly due to the CUDA vs OptiX difference (see #73322) and compare the following: https://opendata.blender.org/benchmarks/query/?device_name=GeForce%20RTX%202080%20Ti&group_by=benchmark&group_by=device_type https://opendata.blender.org/benchmarks/query/?device_name=Threadripper%203970X&group_by=benchmark So I'm merging this into #73322.

Sem Mulder commented

2020-02-26 09:27:23 +01:00

Closed as duplicate of #73322

Sem Mulder closed this issue

2020-02-26 09:27:23 +01:00

Sign in to join this conversation.