Page MenuHome

Blender Open DataProject
ActivePublic

Members (5)

Details

Description

Blender Open Data is a platform to collect and display the results of hardware and software performance tests, analytics, telemetry and more.

The first purpose of the Blender Open Data project is to host Blender Benchmark results. We are currently in Beta phase and we would love to hear your feedback!

Reporting an issue?

Please fill in the form. Thanks!

Feedback and ideas?

Join the discussion on devtalk.blender.org.

Recent Activity

Thu, May 12

WillyChen (a7149311) added a comment to T98064: Error message "An unexpected error occurred while benchmarking: Did not receive Benchmark JSON Data" occurred while running Blender of GPU score on NV GeForce MX550.

Please help us confirm NVIDIA MX550 and Blender 3.1.0 compatibility, thanks.

Thu, May 12, 3:39 AM · Blender Open Data
WillyChen (a7149311) created T98064: Error message "An unexpected error occurred while benchmarking: Did not receive Benchmark JSON Data" occurred while running Blender of GPU score on NV GeForce MX550.
Thu, May 12, 3:26 AM · Blender Open Data

Tue, May 10

Erica Lee (Erica) added a comment to T98008: Document minimum memory requirements.

Hi,
The system memory on the test system is 12GB and 16GB.
The VRAM of dGPU(NV GeForce MX550) is 2GB.
I didn't see the min. memory requirement should at least be documented.
Could you help to provide the document?
Thank you!

Tue, May 10, 9:46 AM · Blender Open Data
Francesco Siddi (fsiddi) changed the status of T98008: Document minimum memory requirements from Needs Triage to Confirmed.
Tue, May 10, 8:52 AM · Blender Open Data

Mon, May 2

ExLibris (ExLibris68) added a comment to T97763: Blender Benchmark 2.0.4 Error while communicating with the server..

As far I can see in the data, this is not a specific Quadro k2200 issue, because there were several successful submissions with this card before.

Mon, May 2, 8:08 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) edited projects for T97763: Blender Benchmark 2.0.4 Error while communicating with the server., added: Blender Benchmark, Blender Open Data; removed BF Blender.
Mon, May 2, 4:47 AM · Blender Open Data, Blender Benchmark

Tue, Apr 26

Erica Lee (Erica) changed the status of T97619: Error message "An unexpected error occurred while benchmarking: Did not receive Benchmark JSON Data" occurred while running Blender of GPU score on NV GeForce MX450 from Needs Triage to Needs Information from Developers.
Tue, Apr 26, 11:45 AM · Blender Open Data

Apr 20 2022

Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Classroom may be older but is still a 2.8.x Blender demo file.

Apr 20 2022, 8:32 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

The source code is here, I don't know if there is documentation outside of that.
https://developer.blender.org/source/blender-open-data/

Apr 20 2022, 8:09 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Also, where can I find documentation on how the Open Data Benchmark performs its Benchmark ? What are the settings for the files you are computing ? Why and how those settings were chosen ? How can I correlate the Open Data Benchmark results with what I can expect to see in Blender ?

Apr 20 2022, 7:41 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Brecht Van Lommel (brecht) What is the CPU score of Junkshop on your 16G machine ?

Apr 20 2022, 7:24 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Ok, perhaps the junkshop scene is running out of memory and causing issues on both CPU and GPU. Swapping and running very slowly on the CPU, and just failing on the GPU.

Apr 20 2022, 7:07 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Brecht Van Lommel (brecht) I'm looking at the number of samples per second at the very end of the log.

Apr 20 2022, 5:53 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

@Matthieu (MHEonM1) regarding CPU rendering time, which numbers are you looking at exactly?

Apr 20 2022, 5:36 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) updated subscribers of T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Thanks, there is indeed an error that doesn't seem to stop the render:

BLENDER: CommandBuffer Failed: cycles_metal_integrator_reset

@Michael Jones (michael_jones) I guess there are two issues to fix here. One is to stop the render on this error, and the other would be to figure out why the error happens in the first place. Would you have time to look into this?

Apr 20 2022, 5:33 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Here we go.

Apr 20 2022, 5:11 PM · Blender Open Data, Blender Benchmark
Brecht Van Lommel (brecht) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Likely there is an error while rendering, which causes the render to stop quickly, but this goes undetected and the render time is considered correct.

Apr 20 2022, 2:54 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

I am still having nonsensical numbers (13inch MBP M1 8 GPU cores, 8Go RAM), both on CPU and GPU

Apr 20 2022, 2:33 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Since April 10th I see no new unrealistic scores. I don't know if that is a coincidence.

Apr 20 2022, 11:25 AM · Blender Open Data, Blender Benchmark
Patrick Mours (pmoursnv) closed T73657: Benchmark GUI launcher does not run on Quadro cards as Resolved.

This turned out to be a driver issue that has been fixed in 512.15+.

Apr 20 2022, 11:13 AM · Blender Benchmark, Blender Open Data

Apr 6 2022

Omar Emara (OmarSquircleArt) changed the status of T85513: Blender benchmark issue from Needs Triage to Confirmed.

Can confirm with various commands, including:

Apr 6 2022, 12:56 PM · Blender Open Data
Omar Emara (OmarSquircleArt) merged T83898: Bug in the benchmark into T85513: Blender benchmark issue.
Apr 6 2022, 12:54 PM · Blender Open Data

Mar 28 2022

ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

That is usefull info for the Metal/Blender developers I think if they are going to look into this bug.

Mar 28 2022, 4:24 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Concerning the CPU score of Junkshop:

Mar 28 2022, 3:56 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

No problem :)

Mar 28 2022, 2:54 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Sorry for the late response. Here are some screenshots of what I get in OpenData :

Mar 28 2022, 1:57 PM · Blender Open Data, Blender Benchmark

Mar 25 2022

ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

I cannot see the low overal scores for Apple M1 CPU scores for junkshop (see screenshot), but I notice quite a large difference between the lowest and highest scores. Is your score specific for your benchmark?

Mar 25 2022, 2:27 PM · Blender Open Data, Blender Benchmark
Matthieu (MHEonM1) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

Just to add a precision

Mar 25 2022, 1:24 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.

The unrealistic values are still being submitted. Because the very high values the overall scores of Apple benchmarks are not really usable:

Mar 25 2022, 8:32 AM · Blender Open Data, Blender Benchmark

Mar 19 2022

Francesco Siddi (fsiddi) edited Description on Blender Open Data.
Mar 19 2022, 6:50 PM

Mar 18 2022

Germano Cavalcante (mano-wii) closed T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0 as Resolved.

Good to know the problem is gone!
Thank you for the report.
If the problem reappears, feel free to submit a new report.

Mar 18 2022, 1:01 PM · Blender Open Data, Blender Benchmark

Mar 17 2022

Grzegorz Wereszko (Prodeous) added a comment to T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0.

I can confirm that I can submit results.

Mar 17 2022, 10:30 PM · Blender Open Data, Blender Benchmark
Jesse Yurkovich (deadpin) merged task T96548: Blender Open Data is broken into T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.
Mar 17 2022, 6:55 PM · Blender Open Data
Jesse Yurkovich (deadpin) merged T96548: Blender Open Data is broken into T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data.
Mar 17 2022, 6:55 PM · Blender Open Data, Blender Benchmark
Jesse Yurkovich (deadpin) changed the status of T96519: Some benchmarks considering Metal device type show unrealistic values in Blender Open Data from Needs Triage to Confirmed.
Mar 17 2022, 6:54 PM · Blender Open Data, Blender Benchmark
ExLibris (ExLibris68) added a comment to T96548: Blender Open Data is broken.

This is because the same issue as I submitted yesterday in issue:[[ URL | https://developer.blender.org/T96519 ]]. Some values with the device_type="Metal" and scene="Junkshop" have unrealistic values.

Mar 17 2022, 2:11 PM · Blender Open Data
Matthieu (MHEonM1) created T96548: Blender Open Data is broken.
Mar 17 2022, 8:50 AM · Blender Open Data

Mar 15 2022

Dalai Felinto (dfelinto) changed the status of T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0 from Needs Triage to Needs Information from User.

Let's leave the Cycles project out of this. I also suspect the error is no longer relevant given all the changes that went through with Cycles and Open Data.

Mar 15 2022, 11:02 AM · Blender Open Data, Blender Benchmark

Mar 14 2022

Patrick Mours (pmoursnv) closed T91849: Support for Blender 3.0 as Resolved.
Mar 14 2022, 4:19 PM · Blender Open Data

Feb 24 2022

Francesco Siddi (fsiddi) added a member for Blender Open Data: Anna Sirota (railla).
Feb 24 2022, 12:37 PM

Feb 9 2022

Germano Cavalcante (mano-wii) edited projects for T95605: Blender benchmark is not working in centos 7 , added: Blender Benchmark, Blender Open Data; removed Add-ons (Community).
Feb 9 2022, 10:46 PM · Blender Open Data, Blender Benchmark

Jan 31 2022

Francesco Siddi (fsiddi) added a comment to T91849: Support for Blender 3.0.

Hi, Sergey already worked on the client side of the benchmark client and we are now planning work on the server side. The goal is to have this done before the. 3.1 release.

Jan 31 2022, 1:04 PM · Blender Open Data
Patrick Mours (pmoursnv) added a comment to T91849: Support for Blender 3.0.

Are there any news or is there help needed for this?

Jan 31 2022, 12:43 PM · Blender Open Data
Francesco Siddi (fsiddi) removed a member for Blender Open Data: Sem Mulder (SemMulder).
Jan 31 2022, 2:33 AM
Francesco Siddi (fsiddi) removed a member for Blender Open Data: Mike Newbon (mikenewbon).
Jan 31 2022, 2:33 AM

Jan 24 2022

Pratik Borhade (PratikPB2123) edited projects for T92343: Benchmark CLI segfaults, added: Blender Open Data; removed BF Blender.
Jan 24 2022, 11:43 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) edited projects for T92344: Benchmark CLI device list easy to miss entries, added: Blender Open Data; removed BF Blender.
Jan 24 2022, 11:42 AM · Blender Open Data, Blender Benchmark
Pratik Borhade (PratikPB2123) removed a project from T85132: OpenData submitting error 81bdf55d407a4fa3a1c1a52ce1612ae0: BF Blender.
Jan 24 2022, 7:24 AM · Blender Open Data, Blender Benchmark

Jan 5 2022

Gary Ritchie (secundar) added a comment to T73657: Benchmark GUI launcher does not run on Quadro cards.

Nvidia RTX A5000 here. Windows 10. Won't produce a window when launched. Changed compatibility mode to Windows 8 to get it running.

Jan 5 2022, 10:22 PM · Blender Benchmark, Blender Open Data

Oct 1 2021

Francesco Siddi (fsiddi) changed the status of T91849: Support for Blender 3.0 from Needs Triage to Confirmed.

I confirm there are plans to tackle this by updating the launcher, as well as the benchmark suite.

Oct 1 2021, 10:35 AM · Blender Open Data