Blender Open DataExperimental
ActivePublic

Details

Description

Blender Open Data is a platform to collect and display the results of hardware and software performance tests, analytics, telemetry and more. The infrastructure is made of two components:

  • Open Data: public portal where all data samples are available to view and download
  • My Data: portal where user can manage the samples they submit to the Open Data portal

The first purpose of the Blender Open Data project is to host Blender Benchmark results. We are currently in Beta phase and we would love to hear your feedback!

Reporting an issue?

Please fill in the form. Thanks!

Feedback and ideas?

Join the discussion on devtalk.blender.org.

Recent Activity

Fri, Nov 9

Flor Guilini (Fl_GUI) added a comment to T57191: server 503 blender open data full benchmark.

Unfortunately my system changed since this bug report, I switched back from linux to windows 10.
I just ran the quick CPU benchmark and publishing resulted in the same error. BUT when I refreshed the browser tab I was met with some nice bar graphs and the shocking realisation that my render times are twice the average.

Fri, Nov 9, 8:50 PM · Blender Open Data

Wed, Nov 7

Sybren A. Stüvel (sybren) merged T56406: Open Data Submission is not showing up under "Your Data" into T56329: MacOS benchmark client misses SSL module.
Wed, Nov 7, 2:11 PM · Blender Open Data
Sybren A. Stüvel (sybren) merged task T56406: Open Data Submission is not showing up under "Your Data" into T56329: MacOS benchmark client misses SSL module.
Wed, Nov 7, 2:11 PM · Blender Open Data
Sybren A. Stüvel (sybren) renamed T56329: MacOS benchmark client misses SSL module from Error submitting results: Max retries exceeded to MacOS benchmark client misses SSL module.
Wed, Nov 7, 2:10 PM · Blender Open Data
Sybren A. Stüvel (sybren) added a comment to T57191: server 503 blender open data full benchmark.

This should be resolved now, can you try again?

Wed, Nov 7, 2:08 PM · Blender Open Data

Mon, Nov 5

Laurence Yates (notbyhalf) added a comment to T56329: MacOS benchmark client misses SSL module.

Experiencing the same error here.
macOS High Sierra 10.13.6 with Blender Benchmark 1.0beta2.
Error log is attached.

Mon, Nov 5, 11:53 PM · Blender Open Data

Tue, Oct 30

Brecht Van Lommel (brecht) added a comment to T57486: Unable to connect to the open data platform..

There is an issue with the macOS benchmark, will be fixed in the next update.

Tue, Oct 30, 11:33 AM · Blender Open Data
Brecht Van Lommel (brecht) merged T57486: Unable to connect to the open data platform. into T56329: MacOS benchmark client misses SSL module.
Tue, Oct 30, 11:33 AM · Blender Open Data
Brecht Van Lommel (brecht) merged task T57486: Unable to connect to the open data platform. into T56329: MacOS benchmark client misses SSL module.
Tue, Oct 30, 11:33 AM · Blender Open Data

Mon, Oct 29

Valerio Liberati (Valerio_Liberati) added a comment to T57486: Unable to connect to the open data platform..

Sorry.
I didn't know I couldn't.

Mon, Oct 29, 12:40 PM · Blender Open Data
Antonio Vazquez (antoniov) raised the priority of T57486: Unable to connect to the open data platform. from High to Needs Triage.

Please don't change priority yourself.

Mon, Oct 29, 11:21 AM · Blender Open Data
Valerio Liberati (Valerio_Liberati) triaged T57486: Unable to connect to the open data platform. as High priority.
Mon, Oct 29, 11:15 AM · Blender Open Data

Sun, Oct 21

Francesco Siddi (fsiddi) renamed T56306: Customizable dashboards from Sortable Charts in landing page to Customizable dashboards.
Sun, Oct 21, 7:54 PM · Blender Open Data
Francesco Siddi (fsiddi) added a comment to T56302: Sample Comparison.

This is now partially implemented (when viewing a result, we can compare with the average).

Sun, Oct 21, 7:50 PM · Blender Open Data
Francesco Siddi (fsiddi) triaged T57337: UI: Improve presentation of raw data when viewing charts as Normal priority.
Sun, Oct 21, 7:18 PM · Blender Open Data

Wed, Oct 17

Roman Gischig (rgischig) added a comment to T57191: server 503 blender open data full benchmark.

same for the Windows64-bit version:

Wed, Oct 17, 9:33 PM · Blender Open Data
Roman Gischig (rgischig) added a comment to T56443: Blender Benchmark - multi socket CPU setup does not allow to run the benchmark.

if changed in the script manually to the right value, all works fine:

Wed, Oct 17, 9:31 PM · Blender Open Data

Oct 13 2018

Flor Guilini (Fl_GUI) created T57191: server 503 blender open data full benchmark.
Oct 13 2018, 11:48 PM · Blender Open Data

Oct 4 2018

austin meyers (mchmnd) added a comment to T56329: MacOS benchmark client misses SSL module.

Same here. We're seeing this on our production builds at 10.12.5 and our beta builds at 10.13.6 tested across iMacs, Mac Pros and MBPs and iMac Pros. error report attached.

Oct 4 2018, 8:23 AM · Blender Open Data

Sep 29 2018

Franck Martin (FranckMartin) added a comment to T56329: MacOS benchmark client misses SSL module.

Same thing for me on MacOS 10.13.6

Sep 29 2018, 11:09 PM · Blender Open Data

Sep 20 2018

Sean Maffucci (seanradio) added a comment to T56329: MacOS benchmark client misses SSL module.

same thing just happened to me
MacOS 10.12.6

Sep 20 2018, 4:47 PM · Blender Open Data

Sep 14 2018

Brecht Van Lommel (brecht) merged T56806: can not upload the benchmark result on macOS into T56329: MacOS benchmark client misses SSL module.
Sep 14 2018, 7:42 PM · Blender Open Data
Brecht Van Lommel (brecht) merged task T56806: can not upload the benchmark result on macOS into T56329: MacOS benchmark client misses SSL module.
Sep 14 2018, 7:42 PM · Blender Open Data
Brecht Van Lommel (brecht) triaged T56329: MacOS benchmark client misses SSL module as Normal priority.
Sep 14 2018, 7:42 PM · Blender Open Data
Krisztián Szabó (exploding) created T56806: can not upload the benchmark result on macOS.
Sep 14 2018, 7:33 PM · Blender Open Data

Sep 9 2018

Francesco Siddi (fsiddi) updated subscribers of T56302: Sample Comparison.

Addressed feedback on the implementation in the wip-compare-results. Can we have another round of feedback and merge this @Sybren A. Stüvel (sybren)?

Sep 9 2018, 8:48 PM · Blender Open Data
Francesco Siddi (fsiddi) triaged T56730: Improve error reporting when deleting samples in My Data as Normal priority.
Sep 9 2018, 6:19 PM · Blender Open Data

Sep 5 2018

Francesco Siddi (fsiddi) triaged T56694: Alphabetical sorting of query results as Normal priority.
Sep 5 2018, 10:14 AM · Blender Open Data

Aug 28 2018

Sybren A. Stüvel (sybren) triaged T56594: Auto-cleanup of old Open Data downloads as Low priority.
Aug 28 2018, 2:20 PM · Blender Open Data
Sybren A. Stüvel (sybren) closed T56476: Strip '(Display)' from device name as Resolved.

Resolved in My Data 5250b653f34cb168afa77e51f32e6f70141dae28, Open Data 02f37fae5a7b69d53cda349e10e7b2ef13195c08, and Benchmark Bundle 4726ee0c9c058d755acb2bbbbac997f1d88c3c90

Aug 28 2018, 12:50 PM · Blender Open Data
Francesco Siddi (fsiddi) closed T56320: Downloadable Dataset as Resolved.

The data is accessible via https://opendata.blender.org/raw-data/.

Aug 28 2018, 8:48 AM · Blender Open Data

Aug 27 2018

Brecht Van Lommel (brecht) merged T56480: Interface Call-To-Action Buttons missing into T56443: Blender Benchmark - multi socket CPU setup does not allow to run the benchmark.
Aug 27 2018, 11:01 AM · Blender Open Data
Brecht Van Lommel (brecht) merged task T56480: Interface Call-To-Action Buttons missing into T56443: Blender Benchmark - multi socket CPU setup does not allow to run the benchmark.
Aug 27 2018, 11:01 AM · Blender Open Data

Aug 24 2018

Sybren A. Stüvel (sybren) added a comment to T56476: Strip '(Display)' from device name.

Sergey says it's important to have the display/non-display info in there, so simply stripping is not an option.

Aug 24 2018, 3:09 PM · Blender Open Data

Aug 22 2018

Daniel Houghton (dhoughto) added a comment to T56406: Open Data Submission is not showing up under "Your Data".

Hi Sybren,

Aug 22 2018, 6:49 PM · Blender Open Data
Guy Capra (alomphega) added a comment to T56492: Search code problem on OpenData.Blender website.

Thank you very much for your answers Francesco :-)

Aug 22 2018, 4:50 PM · Blender Open Data
Francesco Siddi (fsiddi) added a comment to T56492: Search code problem on OpenData.Blender website.

We definitely plan to provide some more in-depth metrics for certain results.
Check the rest rest of the work board to get an idea of what is coming next. In particular T56478 and T56323 will (at least partially) address your question. For the rest, there's T56320.

Aug 22 2018, 4:32 PM · Blender Open Data
Guy Capra (alomphega) added a comment to T56492: Search code problem on OpenData.Blender website.

Ok, thanks for the answer, so... Why to show only the 5 fastest GPUs and CPUs and not all the tried ones ?
This could be very useful for all users, and more motivating to everybody trying the benchmark software, you don't think so ?

Aug 22 2018, 4:28 PM · Blender Open Data
Francesco Siddi (fsiddi) closed T56492: Search code problem on OpenData.Blender website as Resolved.

This actually the expected behaviour of the "view benchmark" page. The code that you see is the actual result of the benchmark.
We plan to add a description that better explains that, as well as some charts that show the result in context of the other results on the platform. Thanks for the feedback!

Aug 22 2018, 3:10 PM · Blender Open Data
Francesco Siddi (fsiddi) closed T56301: Time Series as Resolved.

Time series support has been introduced via Line Charts in 9587483.

Aug 22 2018, 11:55 AM · Blender Open Data
Francesco Siddi (fsiddi) closed T56452: Web: text shown when no tokens are there is strange. as Resolved.

Fixed in bdab754.

Aug 22 2018, 11:54 AM · Blender Open Data
Francesco Siddi (fsiddi) moved T56480: Interface Call-To-Action Buttons missing from Backlog to Benchmark Client on the Blender Open Data board.
Aug 22 2018, 11:50 AM · Blender Open Data
André (KnickDesign) added a comment to T56480: Interface Call-To-Action Buttons missing.

The command line gives me 6 times this Error:

Aug 22 2018, 10:54 AM · Blender Open Data
Guy Capra (alomphega) created T56492: Search code problem on OpenData.Blender website.
Aug 22 2018, 8:48 AM · Blender Open Data

Aug 21 2018

Chippy (Chippy) added a comment to T56394: Blender Benchmark crashing.

No crash on NVIDIA dGPU.

Aug 21 2018, 11:42 PM · Blender Open Data
Brecht Van Lommel (brecht) triaged T56480: Interface Call-To-Action Buttons missing as Incomplete priority.

Can you try running the Benchmark from the command line and checking if there are any errors printed in the?

Aug 21 2018, 10:54 PM · Blender Open Data
Chippy (Chippy) added a comment to T56394: Blender Benchmark crashing.

I see the same issue on macOS 10.13.6 and Windows 10, and in my case it (seems to crash only when the test is running via AMD GPU (either dGPU or eGPU). Also I notice the test seems to fail at the same point (early in the Classroom image test) but without warnings or error dialogs afterward. The test just hangs and sits there on screen indefinitely, Mac and PC.

Aug 21 2018, 9:02 PM · Blender Open Data
André (KnickDesign) created T56480: Interface Call-To-Action Buttons missing.
Aug 21 2018, 2:36 PM · Blender Open Data
Sybren A. Stüvel (sybren) triaged T56478: Custom filters on top of predefined queries as Normal priority.
Aug 21 2018, 10:42 AM · Blender Open Data
Sybren A. Stüvel (sybren) moved T56443: Blender Benchmark - multi socket CPU setup does not allow to run the benchmark from Backlog to Benchmark Client on the Blender Open Data board.
Aug 21 2018, 10:39 AM · Blender Open Data