Page MenuHome

Blender BenchmarkProject
ActivePublic

Members (6)

Details

Description

This is a project about Blender's benchmark bundle and website. Both of this projects are highly under development, more information will be available once things are stabilized and ready for public tests.

Recent Activity

Mon, May 2

ExLibris (ExLibris68) added a comment to T97763: Blender Benchmark 2.0.4 Error while communicating with the server..

As far I can see in the data, this is not a specific Quadro k2200 issue, because there were several successful submissions with this card before.

Mon, May 2, 8:08 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) edited projects for T97763: Blender Benchmark 2.0.4 Error while communicating with the server., added: Blender Benchmark, Blender Open Data; removed BF Blender.
Mon, May 2, 4:47 AM · Blender Open Data, Blender Benchmark

Wed, Apr 20

Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Classroom may be older but is still a 2.8.x Blender demo file.

Wed, Apr 20, 8:32 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

The source code is here, I don't know if there is documentation outside of that.
https://developer.blender.org/source/blender-open-data/

Wed, Apr 20, 8:09 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Also, where can I find documentation on how the Open Data Benchmark performs its Benchmark ? What are the settings for the files you are computing ? Why and how those settings were chosen ? How can I correlate the Open Data Benchmark results with what I can expect to see in Blender ?

Wed, Apr 20, 7:41 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Brecht Van Lommel (brecht) What is the CPU score of Junkshop on your 16G machine ?

Wed, Apr 20, 7:24 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Ok, perhaps the junkshop scene is running out of memory and causing issues on both CPU and GPU. Swapping and running very slowly on the CPU, and just failing on the GPU.

Wed, Apr 20, 7:07 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Brecht Van Lommel (brecht) I'm looking at the number of samples per second at the very end of the log.

Wed, Apr 20, 5:53 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Matthieu (MHEonM1) regarding CPU rendering time, which numbers are you looking at exactly?

Wed, Apr 20, 5:36 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) updated subscribers of T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Thanks, there is indeed an error that doesn't seem to stop the render:

BLENDER: CommandBuffer Failed: cycles_metal_integrator_reset

@Michael Jones (michael_jones) I guess there are two issues to fix here. One is to stop the render on this error, and the other would be to figure out why the error happens in the first place. Would you have time to look into this?

Wed, Apr 20, 5:33 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Here we go.

Wed, Apr 20, 5:11 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Likely there is an error while rendering, which causes the render to stop quickly, but this goes undetected and the render time is considered correct.

Wed, Apr 20, 2:54 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

I am still having nonsensical numbers (13inch MBP M1 8 GPU cores, 8Go RAM), both on CPU and GPU

Wed, Apr 20, 2:33 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Since April 10th I see no new unrealistic scores. I don't know if that is a coincidence.

Wed, Apr 20, 11:25 AM · Blender Open Data, Blender Benchmark
Patrick Mours (pmoursnv) closed T73657: Benchmark GUI launcher does not run on Quadro cards as Resolved.

This turned out to be a driver issue that has been fixed in 512.15+.

Wed, Apr 20, 11:13 AM · Blender Benchmark, Blender Open Data

Apr 6 2022

Omar Emara (OmarSquircleArt) merged task T83898: Bug in the benchmark into T85513: Blender benchmark issue.
Apr 6 2022, 12:54 PM · Blender Open Data (1.0.0-beta.2), Blender Benchmark

Mar 28 2022

ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

That is usefull info for the Metal/Blender developers I think if they are going to look into this bug.

Mar 28 2022, 4:24 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Concerning the CPU score of Junkshop:

Mar 28 2022, 3:56 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

No problem :)

Mar 28 2022, 2:54 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Sorry for the late response. Here are some screenshots of what I get in OpenData :

Mar 28 2022, 1:57 PM · Blender Open Data, Blender Benchmark

Mar 25 2022

ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

I cannot see the low overal scores for Apple M1 CPU scores for junkshop (see screenshot), but I notice quite a large difference between the lowest and highest scores. Is your score specific for your benchmark?

Mar 25 2022, 2:27 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Just to add a precision

Mar 25 2022, 1:24 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

The unrealistic values are still being submitted. Because the very high values the overall scores of Apple benchmarks are not really usable:

Mar 25 2022, 8:32 AM · Blender Open Data, Blender Benchmark

Mar 22 2022

David Butterworth (Frappe) added a comment to T96635: Launcher hanging.

Hi Sergy,

Mar 22 2022, 3:36 PM · Blender Benchmark

Mar 21 2022

Sergey Sharybin (sergey) added a comment to T96635: Launcher hanging.

Need to know system information (windows version, GPU, usual things like that).

Mar 21 2022, 4:39 PM · Blender Benchmark
Francesco Siddi (fsiddi) reassigned T96635: Launcher hanging from Francesco Siddi (fsiddi) to Sergey Sharybin (sergey).

Thanks for the report. Sergey, is there anything that we can do to investigate this issue further?
Something similar has been reported by @Pablo Vazquez (pablovazquez) as well.

Mar 21 2022, 3:56 PM · Blender Benchmark
Francesco Siddi (fsiddi) renamed T96635: Launcher hanging from benchmark-score : launcher is hanging to Launcher hanging.
Mar 21 2022, 3:55 PM · Blender Benchmark

Mar 19 2022

David Butterworth (Frappe) created T96635: Launcher hanging.
Mar 19 2022, 7:05 PM · Blender Benchmark

Mar 18 2022

Germano Cavalcante (mano-wii) closed T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0 as Resolved.

Good to know the problem is gone!
Thank you for the report.
If the problem reappears, feel free to submit a new report.

Mar 18 2022, 1:01 PM · Blender Open Data, Blender Benchmark

Mar 17 2022

Grzegorz Wereszko (Prodeous) added a comment to T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0.

I can confirm that I can submit results.

Mar 17 2022, 10:30 PM · Blender Open Data, Blender Benchmark
Jesse Yurkovich (deadpin) merged T96548: Blender Open Data is broken into T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.
Mar 17 2022, 6:55 PM · Blender Open Data, Blender Benchmark
Jesse Yurkovich (deadpin) changed the status of T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data from Needs Triage to Confirmed.
Mar 17 2022, 6:54 PM · Blender Open Data, Blender Benchmark

Mar 16 2022

Pratik Borhade (PratikPB2123) edited projects for T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data, added: Blender Benchmark; removed BF Blender.
Mar 16 2022, 1:44 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a watcher for Blender Benchmark: ExLibris (ExLibris68).
Mar 16 2022, 12:33 PM

Mar 15 2022

Dalai Felinto (dfelinto) changed the status of T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0 from Needs Triage to Needs Information from User.

Let's leave the Cycles project out of this. I also suspect the error is no longer relevant given all the changes that went through with Cycles and Open Data.

Mar 15 2022, 11:02 AM · Blender Open Data, Blender Benchmark

Feb 21 2022

Omar Emara (OmarSquircleArt) changed the status of T80156: Blender Benchmark segfaults with Optix initialization error from Needs Triage to Needs Information from User.

To clarify, the only remaining issue is the one in your last comment? If it is the case, can you edit report to contain the exact problem as there is currently three problems mentioned?
And are you still able to reproduce it?

Feb 21 2022, 4:34 PM · Blender Benchmark, Cycles, BF Blender

Feb 9 2022

Germano Cavalcante (mano-wii) edited projects for T95605: Blender benchmark is not working in centos 7 , added: Blender Benchmark, Blender Open Data; removed Add-ons (Community).
Feb 9 2022, 10:46 PM · Blender Open Data, Blender Benchmark

Jan 24 2022

Pratik Borhade (PratikPB2123) edited projects for T92343: Benchmark CLI segfaults, added: Blender Open Data; removed BF Blender.
Jan 24 2022, 11:43 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) edited projects for T92344: Benchmark CLI device list easy to miss entries, added: Blender Open Data; removed BF Blender.
Jan 24 2022, 11:42 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) removed a project from T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0: BF Blender.
Jan 24 2022, 7:24 AM · Blender Open Data, Blender Benchmark

Jan 5 2022

Gary Ritchie (secundar) added a comment to T73657: Benchmark GUI launcher does not run on Quadro cards.

Nvidia RTX A5000 here. Windows 10. Won't produce a window when launched. Changed compatibility mode to Windows 8 to get it running.

Jan 5 2022, 10:22 PM · Blender Benchmark, Blender Open Data

Dec 20 2021

Björn Martin (bmartin_de) closed T83431: Unable to finish benchmarks with Victor as Resolved.

I just benchmarked with an AMD Radeon RX 6900 XT using Benchmark Launcher 2.0.4 which offers Blender 2.93.1 by now, and the Victor benchmark works now.

Dec 20 2021, 11:16 PM · Blender Benchmark

Nov 8 2021

Dmitrii (CEVEl) changed the status of T92919: Useful use of the viewport background from Needs Triage to Needs Information from Developers.
Nov 8 2021, 9:38 AM · EEVEE & Viewport

Oct 26 2021

Evan Wilson (EAW) added a project to T92343: Benchmark CLI segfaults: Blender Benchmark.
Oct 26 2021, 5:25 AM · Blender Open Data, Blender Benchmark

Oct 25 2021

Germano Cavalcante (mano-wii) added a project to T92344: Benchmark CLI device list easy to miss entries: Blender Benchmark.
Oct 25 2021, 2:45 AM · Blender Open Data, Blender Benchmark

Jul 25 2021

Aaron Carlisle (Blendify) closed T90126: object and edit mode as Archived.
Jul 25 2021, 4:28 PM · Blender Benchmark
sudhavijyan1978@gmail.com (Subashri) created T90126: object and edit mode.
Jul 25 2021, 4:05 PM · Blender Benchmark

Feb 27 2021

Robert Guetzkow (rjg) changed the status of T83431: Unable to finish benchmarks with Victor from Needs Information from User to Needs Triage.
Feb 27 2021, 6:57 PM · Blender Benchmark

Feb 19 2021

Philipp Oeser (lichtwerk) closed T83421: Blender benchmark error as Archived.

No activity for more than a week. As per the tracker policy we assume the issue is gone and can be closed.

Feb 19 2021, 3:04 PM · Blender Open Data, Blender Benchmark, BF Blender

Jan 28 2021

Germano Cavalcante (mano-wii) added projects to T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0: Blender Benchmark, Blender Open Data.
Jan 28 2021, 6:44 PM · Blender Open Data, Blender Benchmark